KABUL (Pajhwok): A lead researcher at Anthropic has warned that advanced artificial intelligence could pose a serious risk to humanity, saying he believes there is more than a 10 percent chance of an extreme outcome within the next decade.
According to CBS News, Evan Hubinger, Anthropic’s Alignment Science Lead, made the remarks in a post on X, saying the company takes the potential risks of AI to humanity seriously.
Hubinger said he believed there was more than a 10 percent chance that AI could cause an extreme outcome for humanity within the next 10 years.
He said Anthropic was working to reduce the risks but acknowledged that the company did not yet have a clear plan to solve the “alignment” problem for superintelligent AI and was not clearly on track to do so.
The remarks came after the resignation of Jacob Coxon, another Anthropic researcher.
Coxon said on Tuesday that he had resigned from Anthropic after three years of conducting AI safety research at OpenAI and Anthropic.
He accused both companies of rapidly developing “self-improving superintelligence” without adequately addressing the associated risks. He said Anthropic was aware of the dangers but continued its development amid competition to achieve superintelligence first.
Meanwhile, the UK Cabinet Office said the country’s AI Security Institute was working with companies in the sector, including Anthropic, to make AI models safer.
It said AI risks do not stop at national borders and that no country can address them alone.
CBS also reported that OpenAI Chief Scientist Jakub Pachocki warned earlier this month that AI development requires “extreme caution.”
The report said that in July, an OpenAI model being tested in an isolated environment went rogue and hacked AI company Hugging Face. OpenAI later disclosed the incident.
Anthropic and Meta have also reported cases in recent weeks in which their AI tools carried out cyberattacks, according to CBS.
sa
