We’ve released new versions of GPT‑3⁠(opens in a new window) and Codex⁠(opens in a new window) which can edit or insert content into existing text, rather than just completing existing text. These new capabilities make it practical to use the OpenAI API⁠(opens in a new window) to revise existing content, such as rewriting a paragraph of text or refactoring code. This unlocks new use cases and improves existing ones; for example, insertion is already being piloted in GitHub Copilot⁠(opens in a new window) with promising early results.

GPT‑3 and Codex have traditionally added text to the end of existing content, based on the text that came before. Whether working with text or code, writing is more than just appending—it’s an iterative process where existing text is revised. GPT‑3 and Codex can now edit text, changing what’s currently there or adding text to the middle of content.

The new insert⁠(opens in a new window) capability⁠(opens in a new window) adds contextually relevant text in the middle of existing content. Providing future context to the model can improve the quality of completions for applications such as writing long-form text, transitioning between paragraphs, following an outline, or guiding the model toward an ending.

In the example above, the desire is to fill-in text between two section headers of an outline. Without the context of future sections, the model generates a completion that isn’t relevant to the second section. When the context of future sections are accounted for, the model generates a completion that ties the two sections together.