Skip to main content
Photo of DeepakNess DeepakNess

Fine-tuning gpt-oss

Unproofread notes

Found this quick guide to fine-tune gpt-oss model completely locally by using the Unsloth AI and Hugging Face transformers. It's a very simple-to-follow tutorial. I think, the only complex task here is to prepare the dataset for fine-tuning, otherwise it's straightforward.

Apart from this, there is also a blog post on the Unsloth AI website about fine-tuning the new OpenAI's gpt-oss model. And there's this video as well that I found to be very helpful.

Comment via email