Anthropic’s new AI leads freelance benchmarks, yet fails 58% of the tasks

Share

Anthropic’s Fable 5.2 model leads Scale’s Remote Labor Index with a 41.30% success rate, ahead of Opus 5.5’s 21.25%. The index evaluates complete deliverables from 240 projects across 23 freelance work categories by comparing them with professional human references. The projects include documents, audio and video files, 3D models, and computer-aided design files. Despite its high score, Anthropic provides no details on the execution setup, cost per project, or level of human support used.

Source: Read the original article

Disclaimer: this content is for information purposes only and is not financial advice. Cryptocurrencies are highly volatile: you may lose all of your capital. Always do your own research. Legal notice
Telemac
Telemachttp://cryptoinfo.ch
Passionné de nouvelles technologies, j’explore l’univers de la blockchain et des cryptomonnaies pour partager l’actualité et les innovations du secteur.

Read More

Items