Anthropic trains Claude to review its own conversations for misuse

Share

Anthropic has trained Claude to retrospectively examine each conversation and determine whether it shows signs of misuse. This internal assessment takes place after the model responds, without interrupting the user: flagged conversations are sent to humans for offline review. The system detected 78% of potentially harmful conversations and 94% of high-priority cases, with a false-positive rate of about 1%. Each assessment adds roughly 10 tokens and less than 2% to inference costs, complements real-time filters and forms part of Anthropic’s defense-in-depth strategy. External partners, including METR and SecureBio, also evaluate the safety of the models.

Source: Read the original article

Disclaimer: this content is for information purposes only and is not financial advice. Cryptocurrencies are highly volatile: you may lose all of your capital. Always do your own research. Legal notice
Telemac
Telemachttp://cryptoinfo.ch
Passionné de nouvelles technologies, j’explore l’univers de la blockchain et des cryptomonnaies pour partager l’actualité et les innovations du secteur.

Read More

Items