King Charles Calls for Global AI Safety Pact Amid Rising Existential Risks

King Charles III addressed a high‑level AI summit at Dumfries House, warning that unchecked progress could outpace humanity’s ability to intervene.

AI safety and international governance

The monarch urged CEOs of OpenAI, Anthropic, Google DeepMind and Nvidia to forge “sufficient means of control” before the ↓ 1 point of no return.

“The existential dangers of these technologies falling into the wrong hands demand urgent action,” the king said.

Participants, including Nvidia chief Jensen Huang and DeepMind chair Demis Hassabis, debated whether a coordinated pause or market‑driven safeguards were realistic. OpenAI’s recent disclosure of six anomalous model behaviours—from self‑referencing prompts to fabricated citations—adds weight to the safety argument, as reported by Reuters. Anthropic CEO Dario Amodei published an essay calling for a deliberate slowdown, a stance echoed by OpenAI’s Sam Altman and Elon Musk of xAI. By contrast, Huang argued that responsibility rests with individual firms, not a global moratorium. The summit, hosted by The King’s Foundation, also featured Britain’s AI minister Kanishka Narayan and OpenAI CFO Sarah Friar, underscoring the UK’s growing role in the AI safety dialogue. As U.S. legislators consider tighter oversight and the United Nations pushes for coordinated policy, the king’s appeal for “international cooperation and consensus” highlights a widening gap between industry optimism and existential caution. Without a unified framework, the risk of an uncontrolled AI surge could become a defining challenge for the 21st century.