据报道,OpenAI 解散其准备度团队
英文标题:OpenAI reportedly disbanded its preparedness team
据《金融时报》报道,OpenAI 已于上月底解散负责评估模型重大风险并制定缓解措施的准备度团队。生物安全、网络安全等具体领域的职责将被拆分,并转移至现有团队。此举是 OpenAI 在预计推进大规模 IPO 之际持续调整安全治理架构的最新变化,此前其 AGI 准备度团队和超级对齐团队也已被解散。原准备度团队负责人 Dylan Scandinaro 将转而研究“递归自我改进”AI 的影响。
386.4 KB
131.0 KB
3.4 KB
553.4 KB
45.9 KB
369.8 KB
86.1 KB
48.0 KB
188.2 KB
628.5 KB
41.3 KB
390.7 KB
70.6 KB
44.4 KB
176.3 KB
53.6 KB
中文
据金融时报报道,OpenAI 于上月底解散了其准备度团队(preparedness team)。该团队的职责是评估模型是否会带来严重风险,并开发缓解这些风险的方法。(比如,模型可能会失控,并入侵另一家公司。)据 FT 报道,相关职责现已按生物安全、网络安全等具体领域拆分,并转移至现有团队。
这是 OpenAI 的最新一次组织调整。该公司正处于动荡之中,同时也正迈向预计规模庞大的 IPO。过去几年里,OpenAI 一直在逐步拆除其更偏向风险导向的组织模式,先后解散了 AGI 准备度团队和超级对齐团队。伦理负责人 Chloé Bakalar、首席未来学家 Josh Achiam 以及安全负责人 Johannes Heidecke 近期也都已离职。这使得包括 2024 年从 OpenAI 辞职的 Jan Leike 在内的一些批评者向 FT 表示,该公司正为了打造“光鲜的产品”而忽视安全问题。
准备度团队负责人 Dylan Scandinaro 曾于今年 2 月从 Anthropic 被挖来,他今后将专注于研究“递归自我改进”(recursive self-improving)AI 的影响。
English / 原文
According to the Financial Times, OpenAI disbanded its preparedness team at the end of last month. The job of the preparedness team was to assess if models posed serious risks and develop ways to mitigate those risks. (You know, like the possibility that it could go rogue and hack another company.) According to FT , responsibility has instead been divided up for specific areas like bio and cyber, then moved into existing teams.
This is the latest change at the company, which has been in upheaval as it heads towards what is expected to be a massive IPO. Over the last few years, it’s slowly torn down its more reach-led model, dissolving its AGI readiness and superalignment teams. Ethics lead Chloé Bakalar, Chief Futurist Josh Achiam, and head of safety Johannes Heidecke have all also left recently, leading some critics like Jan Leike, who resigned from OpenAI in 2024, to tell FT that the company was ignoring safety in favor of creating “shiny products.”
The head of the preparedness team, Dylan Scandinaro, who was poached from Anthropic in February, will now focus on the implications of “recursive self-improving” AI.