🔶 OpenAI 正在放缓 AI 训练进度

这是 OpenAI 首次采取这样的行动。这一不同寻常的决定出台之际，OpenAI 正为预计中的 IPO 做准备，同时还在与主要竞争对手 Anthropic 展开高度激烈的竞争；研究人员也正在应对 AI 能力的迅速进展，这些进展已让行业领袖担忧自己是否有能力控制它们。

此次放缓重新分配了 OpenAI 两项最重要的资源：研究人员和算力。Altman 告诉我，一些他从未预料会投身对齐工作的研究人员——对齐即让 AI 系统遵循人类意图的工作——最近告诉他，他们正转向这一领域。“我们已经将大量算力转移，不仅用于对齐研究，也用于这些新的监控系统。”他说。

这些变化发生在一起涉及 Hugging Face 的重大安全事件之后。Hugging Face 是开发者托管 AI 模型的热门平台。一套尚未发布的 OpenAI 系统逃出了内部网络安全评估的沙箱，并入侵了 Hugging Face 的生产系统。OpenAI 研究人员大约用了一周时间才发现这一事件。该公司首席科学家 Jakub Pachocki 承认了这一疏漏，称 OpenAI 已构建能够检查模型计划行为的监控器，但由于低估了该系统的能力，并未将这些监控器应用于接受评估的系统。“对于 AI，你应该预料到意料之外的情况。”他告诉我。

It is the first time OpenAI has made such a move. The extraordinary decision comes as OpenAI gears up for an anticipated IPO amid a highly competitive race with arch-rival Anthropic, and as researchers grapple with rapid advancements in AI capabilities that have left industry leaders worried about their ability to control them.

The slowdown has redirected two of OpenAI’s most important resources: researchers and computing power. Altman told me several researchers he never expected to focus on alignment—the work of making AI systems follow human intent—recently told him they were switching to it. “We’ve shifted a lot of compute, not just to alignment research, but also to these new monitoring systems,” he says.

The changes follow a remarkable breach involving Hugging Face, the popular platform where developers host AI models. An unreleased OpenAI system escaped the sandbox of an internal cybersecurity evaluation and compromised Hugging Face’s production systems. It took OpenAI researchers roughly one week to discover the incident. Jakub Pachocki, the company’s chief scientist, acknowledged the lapse, saying OpenAI had built monitors capable of inspecting what its models were planning, but had not applied them to the system in the evaluation because it underestimated their capabilities. “For AI, you should expect the unexpected,” he told me.