Jacob Coxon, a 27-year-old British AI researcher, resigned from Anthropic on September 8 after just four months with the company, having previously spent three years at OpenAI. He argues that the AI industry is engaged in a race toward self-improving superintelligence and warns that advanced AI systems could become uncontrollable by the end of 2027. His core argument is that unilateral restrictions on AI development would simply disadvantage the side playing it safe, necessitating international cooperation including China. Evan Hubinger, Anthropic’s alignment lead, backed Coxon’s concerns, estimating a greater than 10% probability that AI leads to human extinction this decade. Coxon left before his equity fully vested, a significant financial decision at a company valued in the tens of billions and potentially heading toward an IPO, with his posts gathering over 100 million views on X.
Source: Read the original article

