Osegi
AI·1 min read

GPT-6.2 Sol and Astra face backlash from early testers

OpenAI's new GPT-6.2 Astra and Sol beat their predecessors on benchmarks, yet early testers call Astra "lazy" and one calls it among OpenAI's worst releases.

A person at a laptop looking skeptically at AI model benchmark charts and a chat window.
Image: CNET

OpenAI released GPT-6.2 Astra and GPT-6.2 Sol this week, and the benchmark charts look good. The people actually using them are less sure.

Astra is the model for complex tasks, while Sol is the more "everyday" one. Both are limited to paid subscribers for now and are available in ChatGPT Work and Codex. Both beat their predecessors on benchmarks, which are standardised tests used to compare AI models.

But the feedback from developers and early testers is mixed. Ethan Mollick, a professor who directs the Generative AI Lab at Wharton, wrote on LinkedIn that GPT-6.2 Astra was "harder to steer and work with" and "frequently seemed 'lazy'" compared with rival models. Jason J. Fleagle, head of AI at NETSYNC, was blunter: "I think GPT-6.2 has to be one of the worst AI models OpenAI has ever released."

Is GPT-6.2 good enough for everyday use?

Probably. According to the early feedback, ordinary users should find Sol and Astra more than serviceable. The complaints come mainly from people pushing the models into professional work, who may hit hiccups they did not see before.

Were the testers using the final version?

Maybe not. Thibault Sottiaux, known as Tibo, who leads OpenAI's Codex, said on X that early builds of Sol and Astra went to influencers some time ago. He said the models were updated within the past couple of days and that he assumes no retesting happened since.

So some of the criticism may describe an older build. Whether the changes make a real difference will only show up with more testing. OpenAI did not immediately respond to a request for comment.

Apps worth a look

SUMO: the number puzzle

Tap the right tiles, add them up, hit the target. Easy to learn, hard to master. Free, for all ages.

Tags:openaigpt-6.2astrasolchatgptcodex

More from this day

See all →

More in: AI

See all →