With the OpenAI Pioneers program, we will be working with companies building new products in high-impact verticals to expand their product capabilities through individualized efforts with our research teams. Companies in the program will be supported by researchers of the OpenAI team to create:

We believe that industries like legal, finance, insurance, healthcare, accounting, and many others are missing a unified source of truth for model benchmarking.

We are excited to spend time assisting eval creation with multiple companies in each sector over the coming months. Our team will work intensively with each company to design evals tailored to their domain—establishing clear benchmarks that guide model development and improve trust in AI systems, and sharing them publicly. Industry specific evals will be published at a later date.

Companies in the program will have the opportunity to collaborate with our team to create model improvements with reinforcement fine tuning (RFT)—a model customization technique that enables the creation of “expert models” for a narrow set of tasks in their domain—and train custom models for the company’s top three use cases. With RFT companies can better solve customers’ pain points and improve model inefficiencies.