r/OpenAI • u/mboazak • 16h ago
Discussion Coding Benchmarks
How are you all feeling about the latest and greatest in representative benchmarks nowadays? It feels like TB4 is now benchmaxxed. AA also doesn't quite feel like it's hitting the mark as far as my experience.
My sense is the closest to reality is somewhere between Frontier 2.0 and TB Science 0.1 oddly enough. What are your alls' go tos?
1
Upvotes
2
u/coblade14 14h ago edited 14h ago
I go around X, YouTube, and Bilibili (Chinese YouTube) to find privately made benchmarks and testing scenarios for 2 reasons.
3
u/pas_possible 15h ago
Tried Sol 6.2 today, seems to work fine for me