Former OpenAI researcher says the 'most likely reason' you will die is due to 'an AI accident'

Business Insider by 3 min read 505x views
Former OpenAI researcher says the 'most likely reason' you will die is due to 'an AI accident'

Share Post

Logo of OpenAI is displayed on a smartphone display on November 9, 2026 in Nanjing, Jiangsu Province of China

Former OpenAI investigator Paul Christiano warns that rogue AI agents could ultimately escape individual authority and logic catastrophic accidents. VCG/VCG via Getty Images

Death by AI may audio akin discipline fiction, but Paul Christiano says it could rotate into the most apt destiny for group living today.

"I think for most group in this room, the most apt logic they volition die is since of an AI accident," the erstwhile OpenAI investigator stated at The Hinton Lectures on Monday.

Christiano, who leads the Alignment Research Center, warned that increasingly capable AI agents could study to deceive their individual overseers, colony the systems used to measure them, and ultimately create themselves too mighty to control.

He cited OpenAI's agents hacking the open-source repository Hugging Face before this year, and a UK AI Security Institute evaluation in which a Claude delegate tried to factory malicious code in an open-source package.

"I think there is a elevated hazard of an AI takeover inside the next three years," Christiano said.

Christiano was a associate of OpenAI's specialized personnel from 2017 to 2021, according to his LinkedIn. He is now the administrator director of the Alignment Research Center, a nonprofit that describes itself as focusing on aligning device learning systems alongside individual interests.

The AI extinction risk

His alert adds to a expanding conversation among researchers complete whether increasingly autonomous AI systems could eventually escape meaningful individual authority and rub out humanity.

The conversation intensified in September following Evan Hubinger, who leads Anthropic's alignment stress-testing team, stated he believed there was a greater-than-10% chance that AI could kill all humans inside a decade.

Geoffrey Hinton, the device researcher extensively known as the "Godfather of AI," stated a 10% chance of AI-driven individual extinction inside that duration was "not an unreasonable estimate."

Others are additional skeptical. Gary Marcus, an AI investigator and author, earlier told Business Insider that AI could amplify grave risks including cyberattacks, biologic weapons, and disinformation, but that he saw no dependable near-term circumstance for individual extinction.

Christiano stated current specialized approaches to controlling advanced AI — including using weaker models to supervise additional capable ones and monitoring models' chains of idea — remain unproven. He stated AI companies need shared safety standards and the capability to dilatory or halt betterment if they discover they cannot authority a system.

"We cannot end up in a stance anywhere we have built a mighty AI we detect we cannot authority it," he said.

Business Insider tells the innovative stories you desire to know

Business Insider tells the innovative stories you desire to know

Business Insider tells the innovative stories you desire to know

Business Insider tells the innovative stories you desire to know

Thibault is a tech newsman at Business Insider's London office.He covers the intersection of innovation and activity — focusing on AI’s effect on the workplace, job and cognitive skills, and how financial changes are affecting careers.Before moving to the trending team, Thibault covered global affairs, including the Russia-Ukraine war, tensions in the South China Sea, and Russia’s economics on the news desk.He has earlier worked at the Daily Express and held internships at Agence France-Presse, Politico Europe, and Factal.Il parle français. Habla español.Email Thibault at [email protected], nexus alongside him on LinkedIn @ThibaultSpirlet, or prosecute him on X @ThibaultSpirlet and BlueSky @thibaultspirlet.bsky.social.Expertise

  • AI and the forthcoming of work 
  • Job and cognitive skills in the AI economy
  • Workforce trends
  • First-person, "as-told-to" stories
Other Article Business Insider
↑
Close Right Ads
Close Left Ads