The heads of OpenAI, Anthropic, and Hugging Face recently joined AI researcher Yoshua Bengio at the United Nations headquarters in Upcoming York on September 23 to warn the UN Security Council about the security risks of increasingly capable AI.
Sources indicate that they did not offer a single plan for managing those risks. Bengio called for licensing and independent safety reviews. OpenAI's Sam Altman proposed common standards that countries could adopt through their own laws. Anthropic's Dario Amodei urged AI developers to slow down when safety work cannot keep pace. Hugging Face's Clément Delangue warned that limiting access to capable systems could leave defenders at a disadvantage.
France, which held the Security Council's rotating presidency, convened the meeting on AI and international security. The discussion exposed a difficult question for governments: how to oversee technology that crosses borders when countries disagree about who should set the rules.
Bengio, co-chair of the UN's Independent International Scientific Panel on AI, challenged the idea that competition forces companies to keep building more powerful systems. "The race is not a law of nature: it is the product of choices," he stated in his published remarks. "They've told us they would slow down if they could. They can.".
He called on developers to show independent experts that frontier systems are safe to train and deploy. He also proposed incident reporting, licensing, and liability insurance. Bengio identified catastrophic misuse, concentrated power, and the loss of human control as risks that require international cooperation.
In a recent development, altman acknowledged the danger of moving too swiftly. "We have unilaterally slowed down in the past. We will do so in the future," he said, according to remarks published by OpenAI. Decisions about AI's direction "cannot be made by labs in San Francisco alone," he added.
Sources indicate that altman proposed complementary national and international standards to measure frontier AI capabilities, assess risks, and test safeguards. He remarked countries should be able to compare evidence and verify commitments. He also called for faster reporting of serious incidents and secure channels for sharing emerging threats. Such standards should accommodate both open and closed models without favoring established companies, he said.
In a recent development, amodei made a more direct commitment about the pace of Anthropic's releases: "We will slow down as much as necessary," he told the council. He identified two principal concerns: the misuse of AI to develop biological weapons and the possibility that advanced systems could outstrip developers' ability to control them.
The Anthropic chief proposed placing outside evaluators inside AI companies with access comparable to employees. He suggested that governments begin with a narrow agreement against using AI to make biological weapons, then develop ways to evaluate models and verify commitments across borders. He also called for common testing standards and a system for notifying other countries of significant AI incidents.
Delangue drew on a July incident in which Hugging Face disclosed an AI agent cyberattack. He called for stronger monitoring and disclosure, but argued that safety also depends on giving defenders access to capable tools. The central danger, he said, was "asymmetry of powerful AI" between attackers and defenders, large companies and everyone else, and wealthy countries and the rest of the world. His team used an open-source model while responding to the attack, he said.
It has been revealed that the U.S. government opposed a broader international regulatory role. White House science adviser Michael Kratsios told the council that countries should develop their own ability to use and govern the technology. In the U.S. statement, he rejected new global governance structures and used the phrase "superintelligence, formerly known as AI," adopting President Donald Trump's terminology from his General Assembly speech the previous day.
According to recent reports, the four AI briefers differed on how far oversight should go and how widely capable systems should be available. They agreed on a narrower point: Governments need better ways to understand what advanced AI systems can do and to detect when safeguards fail.
John K. Waters is the editor in chief of a number of Converge360.com sites, with a focus on high-end development, AI and future tech. He's been writing about cutting-edge technologies and culture of Silicon Valley for more than two decades, and he's written more than a dozen books. He also co-scripted the documentary film Silicon Valley: A 100 Year Renaissance, which aired on PBS. He can be reached at [email protected].
Increasingly, cyber criminals are sharing AI prompts, jailbreak techniques, and access to existing models that can be incorporated into fraud and phishing operations, according the latest AI Threat Report from Flashpoint.
Sources indicate that as an umbrella term, education technology encompasses everything from learning management systems and student information systems to productivity tools and AI platforms. More specific language clarifying the difference between ed tech and consumer-facing tools would allow state leaders to match the right evidence, expertise, and policy to the right questions.
Artificial intelligence is saving scientists significant amounts of time, but researchers are giving some of those gains back by checking the technology's work, according to a newly introduced study involving Google, Google DeepMind, and MIT.
Microsoft is combining its security information and event management and threat protection products within Microsoft Defender, creating what the organization calls an Integrated Security Operations Center built for an era of AI-driven attacks.
