To get started, just run a single command in the OpenAI command line tool with a file you provide. Your custom version will start training and then be available immediately in our API.

Last year we trained GPT‑3⁠(opens in a new window) and made it available in our API⁠. With only a few examples, GPT‑3 can perform a wide variety of natural language tasks⁠(opens in a new window), a concept called few-shot learning or prompt design. Customizing GPT‑3 can yield even better results because you can provide many more examples than what’s possible with prompt design.

It takes less than 100 examples to start seeing the benefits of fine-tuning GPT‑3 and performance continues to improve as you add more data. In research published last June⁠, we showed how fine-tuning with less than 100 examples can improve GPT‑3’s performance on certain tasks. We’ve also found that each doubling of the number of examples tends to improve quality linearly.

With one of our most challenging research datasets, grade school math problems⁠, fine-tuning GPT‑3 improves accuracy by 2 to 4x over what’s possible with prompt design.