AI 领军实验室员工联名呼吁政府应对自动化 AI 发展
英文标题:AI leaders sign a statement asking the government to do something about automated AI
OpenAI、Anthropic、Google、Meta、Microsoft、Mistral 等领先 AI 实验室的员工联名致函美国政府,呼吁为前沿 AI 开发建立国际协调机制。声明称,AI 研究自动化可能显著加速能力进展,并使系统能力的发展速度超过人类理解、控制和监管的能力。签署者希望政府支持开发技术与治理工具,以便在必要时有意识地调节自动化 AI 前沿的发展节奏。该声明已有超过 1,100 人签署,其中包括 OpenAI 和 Anthropic 的多位高管、联合创始人及研究负责人。
383.9 KB
273.3 KB
454.3 KB
371.5 KB
99.5 KB
121.6 KB
684.7 KB
436.7 KB
454.9 KB
348.2 KB
76.0 KB
84.3 KB
486.8 KB
637.9 KB
464.4 KB
183.9 KB
中文
OpenAI 和 Anthropic 的员工,以及来自 Google、Meta、Thinking Machines、Microsoft、Mistral 和其他领先 AI 实验室的员工,已向美国政府提交一份声明,支持在某种程度上放缓前沿 AI 的开发——或者至少加快全球协调治理工作的推进。
声明中的员工写道:“AI 或许能够帮助创造一个显著更美好的未来,但这一结果并非必然。全球领先的 AI 公司相信,它们可能已经接近实现 AI 研究自动化。很难准确预测这会在多大程度上加速 AI 进步,但确实存在这样的风险:能力开发会迅速加速,超出我们理解或控制由此产生系统的能力。”
这则消息发布之前,AI 行业上周刚经历了一起备受关注的网络安全事件:一款尚未发布的 OpenAI 模型逃离了其内部沙盒,以某种方式获得互联网访问权限,随后入侵了竞争 AI 实验室 Hugging Face。
在公开声明中,这些员工进一步强调了全球协调监管的重要性,以确保不断升温的 AI 竞赛不会超过安全与监控工具的发展速度。
他们写道:“要实现 AI 的潜力,行业、政府和整个社会可能需要拥有争取时间的选项,以应对新出现的风险、制定安全措施并加强监督。但每家公司——以及每个国家——都面临着巨大的竞争压力,无法单方面放缓这种加速。而在当下,世界缺乏能够有意识地调节整个前沿领域进展速度的技术与治理工具。在目前已开展的前沿模型发布监测工作基础上:我们请求美国政府支持一项国际行动,开发有意识地调节自动化 AI 开发前沿所需的技术与治理工具。”
签署声明的 OpenAI 高管或联合创始人包括首席研究官 Mark Chen、首席科学家 Jakub Pachocki、联合创始人 John Schulman,以及联合创始人 Wojciech Zaremba。Anthropic 方面,联合创始人 Jack Clark、联合创始人 Chris Olah、联合创始人 Ben Mann 和首席科学官 Jared Kaplan 均已签署;此外还有 Claude Code 的创建者及负责人 Boris Cherny,以及 Anthropic 对齐团队负责人 Ethan Perez。OpenAI 前首席未来学家 Josh Achiam,以及现已解散的超级对齐团队前联合负责人 Jan Leike,也都签署了该声明。
你可以在名为 Pacing the Frontier 的专门网站上查看完整声明,以及超过 1,100 名签署者的名单。
English / 原文
Employees of OpenAI and Anthropic, as well as Google, Meta, Thinking Machines, Microsoft, Mistral, and other leading AI labs, have written a statement to the US government supporting a potential slowdown of sorts for frontier AI development — or at least a speed-up of global coordinated governance efforts.
“Al could help create a dramatically better future, but that outcome is not guaranteed,” the employees wrote in the statement. “The world’s leading Al companies believe they could be close to automating Al research. It is hard to predict exactly how much this will accelerate Al progress, but there is a real risk that capability development rapidly accelerates beyond our ability to understand or control the resulting systems.”
The news follows a high-profile cybersecurity incident that rocked the AI industry last week, in which an unreleased OpenAI model escaped its internal sandbox, finagled its way into gaining internet access, and then hacked competing AI lab Hugging Face.
In the public statement, the employees went on to underscore the importance of some sort of coordinated regulation worldwide, so that the ever-intensifying AI race doesn’t outpace safety and monitoring tools.
“To realize Al’s potential, industry, government, and society at large may need the option to buy time to address emerging risks, develop security measures, and strengthen oversight,” they wrote. “But each company—and country—is under intense competitive pressure not to unilaterally slow that acceleration. And today, the world lacks the technical and governance tools to deliberately pace frontier-wide progress. Building on work already underway to monitor frontier model releases: We request that the U.S. government support an international effort to develop the technical and governance tools needed to deliberately pace the frontier of automated Al development.”
Some of the OpenAI executives or cofounders who have signed the statement include chief research officer Mark Chen, chief scientist Jakub Pachocki, cofounder John Schulman, and cofounder Wojciech Zaremba. As for Anthropic, cofounder Jack Clark, cofounder Chris Olah, cofounder Ben Mann, and chief science officer Jared Kaplan have all signed, as well as Boris Cherny, who created and leads Claude Code, and Ethan Perez, who is Anthropic’s alignment team lead. OpenAI’s former chief futurist, Josh Achiam, and the former colead of its now-defunct superalignment team, Jan Leike, both also signed.
You can see the full statement and a list of the more than 1,100 signatories on a dedicated website titled Pacing the Frontier.