OpenAI made the last big breakthrough in artificial intelligence by increasing the size of its models to dizzying proportions, when it introduced GPT-4 last year. The company today announced a new advance that signals a shift in approachâa model that can âreasonâ logically through many difficult problems and is significantly smarter than existing AI without a major scale-up.
The new model, dubbed OpenAI-o1, can solve problems that stump existing AI models, including OpenAIâs most powerful existing model, GPT-4o. Rather than summon up an answer in one step, as a large language model normally does, it reasons through the problem, effectively thinking out loud as a person might, before arriving at the right result.
âThis is what we consider the new paradigm in these models,â Mira Murati, OpenAIâs chief technology officer, tells WIRED. âIt is much better at tackling very complex reasoning tasks.â
The new model was code-named Strawberry within OpenAI, and it is not a successor to GPT-4o but rather a complement to it, the company says.
Murati says that OpenAI is currently building its next master model, GPT-5, which will be considerably larger than its predecessor. But while the company still believes that scale will help wring new abilities out of AI, GPT-5 is likely to also include the reasoning technology introduced today. âThere are two paradigms,â Murati says. âThe scaling paradigm and this new paradigm. We expect that we will bring them together.â
LLMs typically conjure their answers from huge neural networks fed vast quantities of training data. They can exhibit remarkable linguistic and logical abilities, but traditionally struggle with surprisingly simple problems such as rudimentary math questions that involve reasoning.
Murati says OpenAI-o1 uses reinforcement learning, which involves giving a model positive feedback when it gets answers right and negative feedback when it does not, in order to improve its reasoning process. âThe model sharpens its thinking and fine tunes the strategies that it uses to get to the answer,â she says. Reinforcement learning has enabled computers to play games with superhuman skill and do useful tasks like designing computer chips. The technique is also a key ingredient for turning an LLM into a useful and well-behaved chatbot.
Mark Chen, vice president of research at OpenAI, demonstrated the new model to WIRED, using it to solve several problems that its prior model, GPT-4o, cannot. These included an advanced chemistry question and the following mind-bending mathematical puzzle: âA princess is as old as the prince will be when the princess is twice as old as the prince was when the princessâs age was half the sum of their present age. What is the age of the prince and princess?â (The correct answer is that the prince is 30, and the princess is 40).
âThe [new] model is learning to think for itself, rather than kind of trying to imitate the way humans would think,â as a conventional LLM does, Chen says.
OpenAI says its new model performs markedly better on a number of problem sets, including ones focused on coding, math, physics, biology, and chemistry. On the American Invitational Mathematics Examination (AIME), a test for math students, GPT-4o solved on average 12 percent of the problems while o1 got 83 percent right, according to the company.
