Jacob Coxon, an artificial intelligence researcher, quit his job at Anthropic on Tuesday, claiming that both it and OpenAI were putting humanity in danger by gambling with AI.
"Neither company is acting responsibly," he wrote in a series of posts on X/Twitter. "They are racing straight to self-improving superintelligence and gambling with our lives."
Coxon also warned not to underestimate the power of AI, saying that soon there would be "superhuman systems that can hack anything, revolutionize any field overnight, and acquire real power and resources."
According to Coxon, OpenAI members have not fully internalized the stakes of artificial intelligence, while Anthropic is "locked in a race to get there first - they believe no one else will act responsibly, so they must do it themselves, despite the risk."
He urged lab researchers to exercise caution over the next few years of AI development.
Anthropic Alignment Science lead agrees on AI danger to humanity
In a reply to Coxon's posts, Evan Hubinger, Alignment Science lead for Anthropic, said that he was correct.
"We really do earnestly believe AI could kill all humans!" Hubinger said.
"I personally think it is >10% within the next decade. I believe Anthropic is trying its best, but we do not yet have a plan to solve alignment for superintelligence and are not clearly on track to."