联合国称：AI 安全护栏不能等待确定性

各国政府需要在能力日益增强的 AI Agent 风险被完全理解之前加以约束。联合国一个科学小组在该全球组织首次对今年早些时候 OpenAI 入侵 Hugging Face 事件进行重大评估时发出了这一警告。

这份报告巩固了 AI 本周在全球外交议程中的地位：各国领导人正聚集纽约参加联合国大会，美国和中国也将举行 AI 会谈。上周，联合国秘书长安东尼奥·古特雷斯（António Guterres）呼吁各国政府合作应对 AI 带来的威胁，并警告称：“世界无法承受在 AI 安全问题上竞相降低标准。”

这是独立国际人工智能科学小组（Independent International Scientific Panel on AI）发布的首份专题简报。该小组于去年成立，被联合国称为“首个全球人工智能科学机构”。简报呼吁，在各国采取不同法律路径的同时，应投入更多关注和资源来管理先进 AI 带来的新兴风险，并加强有关安全与问责的国际协调。

关键的是，该小组表示，世界无需等待科学家精确确定此类事件发生的方式或原因，才开始实施更严格的安全护栏。小组认为，失控风险正是预防原则旨在应对的那类问题：“潜在危害可能是灾难性或不可逆的，即使其发生概率在科学上仍不确定。”

这一原则最早被写入 1992 年联合国《关于环境与发展的里约宣言》之中，详见相关说明。该原则指出，科学不确定性不能成为推迟采取措施、防范潜在严重或不可逆危害的理由。此后，它在环境和公共卫生政策中产生了重要影响，尤其是在欧盟。

自 Hugging Face 被入侵事件首次被报道以来，包括 OpenAI、Anthropic、Google 和 Meta在内的公司均已出现有记录的相关事件，其中包括针对现实世界目标的入侵，以及成群 Agent接管在线留言板。

Governments need to rein in increasingly capable AI agents before their risks are fully understood, a United Nations scientific panel warned in the global organization’s first major assessment of OpenAI’s hack of Hugging Face earlier this year.

The report cements AI’s place on the global diplomatic agenda this week as leaders gather in New York for the UN General Assembly and the US and China hold talks on AI. Last week, UN secretary general António Guterres called on governments to cooperate on addressing the threats posed by AI, warning that “the world cannot afford a race to the bottom on AI safety.”

It is the first thematic brief from the Independent International Scientific Panel on AI, established last year as the UN’s “first global scientific body on Artificial Intelligence.” It calls for much greater attention and resources to manage emerging risks from advanced AI, alongside stronger international coordination on safety and accountability, even as individual countries take different legal approaches.

Crucially, the panel says the world does not need to wait for scientists to establish exactly how or why such incidents occur to begin implementing stronger safeguards. Loss-of-control risk, the panel argues, is exactly the kind of problem the precautionary principle was designed to address: “one where potential harm may be catastrophic or irreversible, even as its likelihood remains scientifically uncertain.”

The principle, first enshrined in the 1992 UN Rio Declaration on Environment and Development, says that scientific uncertainty is no excuse for delaying measures against potentially serious or irreversible harm. It has since become influential in environmental and public health policy, particularly in the European Union.

Since the Hugging Face hack was first reported, incidents have been documented at companies including OpenAI, Anthropic, Google, and Meta, including hacks on real-world targets and swarms of agents taking over online messaging boards.