ControlAI 的 Connor Leahy：为什么超级智能“不是武器，而是对手”

AI 公司一直在将超级智能描述为一种不可避免的趋势，但近期的安全事件——例如 OpenAI 的 Hugging Face 泄露事件——正在显示，部署能力超越人类的 AI 系统可能带来怎样的危险。那么，当我们无法可靠地控制这些系统的行为时，会发生什么？

在本期 TechCrunch Equity 播客中，Rebecca Bellan 邀请了 Connor Leahy。Leahy 是 AI 研究员、创业者，同时也是非营利组织 ControlAI 的美国执行董事。ControlAI 正在推动一种更为激进的 AI 安全路径：彻底阻止企业开发超级智能。Leahy 解释了为何他认为，风险已经大到无法仅通过对齐和遏制来管理；他还谈到，那些在六个月前听起来还很遥远的想法，如今正获得一波新立法的支持。

收听完整节目，了解更多内容：

• 他如何看待前沿 AI 实验室：这些机构不只是追逐回报的公司，更是政治行动者；以及这对正在投入数据中心建设的数万亿美元资金意味着什么。

• 为什么 Leahy 认为，真正不可逆转的临界点，是 AI 能够构建更强的 AI，从而形成可能失控的自我改进循环。

• 支持国际“信任但验证”协议的理由，以及为什么 Leahy 认为，建设超级智能实际上并不符合中国的利益。

订阅 Equity：YouTube、Apple Podcasts、Overcast、Spotify 及其他播客平台。你还可以在 X 和 Threads 关注 Equity，账号为 @EquityPod。

AI companies have been talking about superintelligent AI like it’s inevitable, but recent safety incidents like OpenAI’s Hugging Face breach are demonstrating the potential dangers of deploying AI systems that are more capable than humans. So what happens when we can’t reliably control what these systems do?

On this episode of TechCrunch’s Equity podcast, Rebecca Bellan is joined by Connor Leahy, an AI researcher, entrepreneur, and now the U.S. Executive Director of nonprofit ControlAI, which is pushing for a far more radical approach to AI safety: stopping companies from developing superintelligence altogether. Leahy explains why he thinks the risks have become too great to manage through alignment and containment alone, and how what sounded far-fetched six months ago is now being backed by a wave of new legislation.

Listen to the full episode to hear more about:

• How he views frontier AI labs less as companies simply chasing returns and more as political actors, and what that means for the trillions of dollars being poured into data center buildouts.

• Why Leahy thinks the real point of no return is when AI can build better AI, creating a potentially runaway cycle of self-improvement

• The case for international “trust but verify” agreements, and why Leahy thinks it isn’t actually in China’s interest to build superintelligence.

Subscribe to Equity on YouTube, Apple Podcasts, Overcast, Spotify and all the casts. You also can follow Equity on X and Threads, at @EquityPod.