Epoch AI tests six leading LLMs, and none match its own employees

Share

Epoch AI evaluated six language models on open-ended tasks drawn from the real work of its employees, including graphic design and research design. No model met the organization’s human quality standard, with the best performers averaging approximately 65%. Claude Fable 5.1 and GPT-6 Astra shared the top spot, while Gemini 3.8 Flash ranked last with 42%. The models performed better on coding and data analysis but struggled with tasks requiring judgment or adaptation to a particular audience.

Source: Read the original article

Disclaimer: this content is for information purposes only and is not financial advice. Cryptocurrencies are highly volatile: you may lose all of your capital. Always do your own research. Legal notice
Telemac
Telemachttp://cryptoinfo.ch
Passionné de nouvelles technologies, j’explore l’univers de la blockchain et des cryptomonnaies pour partager l’actualité et les innovations du secteur.

Read More

Items