DeepMind Co-Founder Warns AI Safety Must Keep Pace
AI agents are increasingly able to write software, carry out autonomous tasks and help develop other AI systems, intensifying concern that capabilities could advance faster than the safeguards designed to monitor and control them. Google DeepMind co-founder Shane Legg said safety must keep pace as the industry moves toward artificial general intelligence, or AGI, which the company defines as a system possessing the cognitive capabilities of the human brain.
Legg launched the DeepMind Institute on Sept. 16, 2026, to broaden debate over AGI deployment, with initial essays addressing AI safety, economic policy and principles for a “new utopianism.” He said Anthropic CEO Dario Amodei’s proposal to slow, but not halt, frontier-model releases was worth considering, while cautioning that implementation details remain unresolved. Legg also maintained his forecast of a 50% chance that “minimal” AGI will be achieved by 2028.
All Coverage
2 original reportsThe Backstory
The history behind this eventGoogle DeepMind Researcher Quits, Warns AI Could Kill Humanity
Google DeepMind, Alphabet’s main artificial-intelligence research unit, is competing with OpenAI and Anthropic to build increasingly capable frontier systems. The dispute centers on alignment: whether developers can ensure advanced models act in accordance with human intentions and values. Safety researchers warn that capabilities are improving faster than techniques for understanding and controlling them, raising the prospect of systems acting autonomously or being misused. The debate has sharpened divisions over how quickly companies should advance AI and how much oversight governments should impose.
Bilal Chughtai, who worked on AGI safety and alignment at Google DeepMind, resigned in July 2026 and published an exit statement on Sept. 14. He said AI could “kill us all,” called alignment difficult and unsolved, and urged companies to coordinate, slow development to a pace society can manage and provide greater transparency. His warning followed former Anthropic researcher Jacob Coxon’s resignation and estimate of a 10% chance that AI could cause human extinction within a decade. Coxon’s social-media posts drew more than 150 million views.
Google DeepMind CEO Hassabis Warns of AI Threats, Urges Stronger Regulation and Safety Research
Google DeepMind is Google’s artificial intelligence research unit, led by co-founder and CEO Demis Hassabis. As generative AI advances rapidly, countries face risks ranging from misuse and autonomous model behavior to systems slipping out of control. Balancing innovation and safety has become a central issue for regulators worldwide.
Speaking recently at an AI Impact Summit, Hassabis warned that superintelligent AI could pose extreme risks, including human extinction, and said the global development race was showing signs of spinning out of control. He predicted that AI would become a “superpower” within the next 10 years and urged governments to pursue smart regulation, strengthen safety research and establish cross-border safeguards before it is too late.
Subscribe to Mark Radar Weekly
Every Friday, the week's strongest signals in your inbox. Unsubscribe anytime.
If you search news on Google, you can set Mark Radar as a preferred source—our coverage will show up more often in your results. Set as preferred source on Google →