King Charles III convened a private summit on Thursday with prominent figures from the artificial intelligence sector and the UK government, delivering a stark warning about the unchecked expansion of AI technology. The gathering, held at Dumfries House in Cumnock, Scotland, brought together Nvidia CEO Jensen Huang, representatives from OpenAI and Anthropic, UK AI Minister Kanishka Narayan, the head of the UK’s foreign intelligence service, and Paolo Benanti, an advisor to the Pope on AI matters.
The King’s address was significant given the royal family’s traditional constitutional caution regarding political discourse. Addressing the hot-button topic of AI regulation, Charles urged attendees to establish controls before it was too late. He described the technology’s substance as both fascinating and deeply worrying, noting its potential to save lives through advances in medicine and science, while simultaneously acknowledging warnings from creators about its capacity for harm.
His comments echoed recent anxieties within the industry, coming just weeks after an Anthropic researcher resigned and publicly stated that companies were racing to build machines surpassing human intelligence, posing a survival risk to humanity. The King emphasized the urgent need to address existential dangers, particularly if the technology were to fall into malicious hands and be used in catastrophic ways.
“Surely, we need sufficient means of control before it’s all too late?” Charles asked. He concluded his remarks by challenging leaders to ensure AI remained firmly in service of humanity, community, and the natural world, adding, “As we embrace what is new, we must not lose what is timeless.”
The summit highlighted a growing divide in the tech and political landscape. While OpenAI’s Sam Altman, Elon Musk, and Anthropic’s Dario Amodei recently called for a de-acceleration of AI development, Nvidia’s Huang and President Donald Trump have rejected those appeals. President Trump stated, “We’re leading China in AI… whoever wins AI, wins,” underscoring the geopolitical stakes.
OpenAI was represented by CFO Sarah Frair, while Anthropic sent Tino Cuéllar, its lead for global affairs. Cuéllar expressed gratitude for the invitation, stating the company was honored to discuss AI’s role in serving the public good. This follows Anthropic’s recent decision to restrict access to its Fable and Mythos models to U.S. customers only, a move that sparked debates over AI sovereignty in Europe.
The event coincides with ongoing speculation about initial public offerings from major AI firms. OpenAI recently indicated that its IPO plans were stalled due to persistent safety concerns. King Charles, who has addressed AI challenges in previous years, left the session after approximately 20 minutes, allowing the invited leaders to continue discussions independently.
I appreciate the warning, but without binding international treaties, what’s to stop countries from ignoring these calls and racing ahead?
Wait, is King Charles meeting Jensen Huang and Anthropic reps privately? This is quite a departure from strict royal neutrality.
Great that the King is using his platform for this. The geopolitical angle with Trump makes regulation even harder, though.