Hacker Newsnew | past | comments | ask | show | jobs | submitlogin

It's odd, that on many benchmarks, including mine[0], Nano does better than Mini.

5.4 mini seems to struggle with consistency, and even with temperature 0 sometimes gives the correct response, sometimes a wrong one...

[0]: https://aibenchy.com/compare/openai-gpt-5-4-medium/openai-gp...



Guidelines | FAQ | Lists | API | Security | Legal | Apply to YC | Contact

Search: