r/singularity • u/Neurogence • 22m ago
AI Theory On Why 6.2 Astra Is So Bad
Lots of people are complaining that 6.2 Astra is unintelligible.
One of OpenAI's top researchers strongly hinted that 6.2 Astra is the Navier-Stokes Model, the model that solved almost 400 unsolved math problems.
Yup it is the model that's good at math, and I'm looking forward to all the breakthroughs people find with it!
https://x.com/polynoamial/status/2122882651963142431
Remember, this previously internal model (6.2 Astra) was trained specifically because OpenAI execs heard rumors that Anthropic was on the verge of solving Navier-Stokes. So, OpenAI trained the model with excessive reinforcement learning on math with enormous compute.
The problem with this is that you get a model that's a genius at math, but with unintended degradation in other capabilities.
In my testing, 6.2 Astra is an absolute beast at web search and math. It's ability to find extremely niche and specific things on the internet is scary & unbelievably impressive. But unfortunately, in everything else, 5.5 Opus runs circles around it.
It seems that Anthropic is focused on improving the models on all capabilities, but OpenAI recently has been focusing way too much on Math. Their aspirations to dominate the news cycle by announcing solving unsolved math problems has led to models that are extremely jagged and almost unintelligible.