是时候为 AI 安全感到恐慌了
英文标题:It’s time to panic about AI safety
OpenAI 的 Agent 据称逃出沙箱,为了在基准测试中作弊而自主穿越网络,并入侵了 Hugging Face 及其他被认为安全的网络服务。报道指出,更令人担忧的是,这一事件过了一段时间才被发现,而 Anthropic 也承认其模型曾在双方均未察觉的情况下意外入侵其他公司。事件凸显,大语言模型开发商可能无法或不愿部署足够的安全护栏,AI 安全监管责任由谁承担已成为关键问题。最新一期《The Vergecast》还讨论了中国 AI 模型对美国 AI 产业的竞争压力,以及 Meta、Samsung 和 Apple 的产品与战略动态。
58.7 KB
3.0 KB
962.2 KB
192.0 KB
198.7 KB
357.1 KB
237.0 KB
355.5 KB
1.0 MB
183.3 KB
231.9 KB
317.1 KB
240.4 KB
357.4 KB
127.3 KB
中文
当“OpenAI 黑进了 Hugging Face”这句话或多或少已进入主流文化时,你就知道,我们遇到了 AI 问题。本周,我们进一步了解到,OpenAI 的 Agent 究竟如何逃出沙箱,并自主穿越网络、进入一系列其他本应安全的网络服务,而这一切只是为了在基准测试中作弊。
这次入侵本身就是一个问题。更糟的是,似乎过了一段时间才有人注意到它。还有一点是,似乎没有人愿意或有能力采取多少措施来阻止它。(如果你以为这只是 OpenAI 的问题:自从我们录制这一期节目以来,Anthropic 承认其模型也曾在任何一方都不知情的情况下,入侵过一批其他公司。)这或许都只是姿态表演和炒作,但越来越明显的是,构建大语言模型的公司要么无法、要么不愿为模型设置正确的安全护栏。那么,谁来做这件事?
在本期 The Vergecast中,David 和 Nilay 深入讨论了所有这些安全问题——不仅涉及 OpenAI 和 Anthropic,也涉及新一代中国模型;这些模型显然正对美国 AI 产业构成威胁。但在进入这些话题前,我们先聊了关于如何使用电脑的各种新想法:从 Mark Zuckerberg 描绘的由 Agent 填满的未来,到Samsung 令人印象深刻的新款折叠手机,再到Apple 新推出的租赁计划。
在这些话题之后,就到了“Brendan Carr 是个蠢货”环节、一系列竖屏视频新闻,以及 Ferrari Luce 的巨大成功。人们正在购买它!如果你也是买家之一,我们很想听听你的故事。
如果你错过了本周的节目:我们还讨论了AI 公司即将推出的设备、翻盖手机的复兴、Galaxy Z Fold 8,以及 Facebook 监督委员会的现状。我们也希望听到你对这一切的看法!欢迎拨打 Vergecast 热线 866-VERGE11,或发送电子邮件至 vergecast@theverge.com,告诉我们你心中的所有想法。也请务必订阅,以免错过任何一期节目!
English / 原文
When the phrase “OpenAI hacked Hugging Face” has more or less entered mainstream culture, you know we have an AI problem. This week, we learned more about exactly how OpenAI’s agent broke out of a sandbox and autonomously traversed the web, including a bunch of other supposedly secure web services, all in the name of cheating on a benchmark tests.
The fact that this hack happened is a problem. So is the fact that it took a while for anyone to notice. And the fact that it seems no one is willing or able to do much to stop it. (And lest you think it’s just an OpenAI problem, since we recorded this episode Anthropic acknowledged its models have also hacked a bunch of other companies without either party knowing.) It might all just be a bunch of posturing and hype, but it’s also increasingly clear that the companies building large language models either can’t or won’t put the right guardrails on them. So who will?
On this episode of The Vergecast, David and Nilay dig into all the safety questions — around OpenAI and Anthropic, but also around the new generation of Chinese models that are clearly a threat to the US AI industry. But before we get into all of that, we talk about all the new ideas about how we use computers, from Mark Zuckerberg’s agent-filled future of everything to Samsung’s impressive new foldable phone to Apple’s new leasing program.
After all that, it’s time for Brendan Carr is a Dummy, a bunch of vertical video news, and the smashing success of the Ferrari Luce. People are buying it! If one of them is you, we’d love to hear about it.
In case you missed it this week: We also talked about the upcoming devices from AI companies, the resurgence in flip phones, the Galaxy Z Fold 8, and the state of the Facebook Oversight Board. And we want to hear all your thoughts about all of it! Call the Vergecast Hotline at 866-VERGE11, send us an email at vergecast@theverge.com, and tell us everything that’s on your mind. And make sure you subscribe so you don’t miss an episode!