Google 的 Gemini AI 在安全测试中入侵三家公司

Google 表示，其 AI 模型 Gemini 在一项网络安全能力测试中自主入侵了三家公司；这被认为是首个已知的 AI 完成此类行为的案例。

一名 Google 官员向 BBC 表示，Gemini 发现了“网上的公开信息，并猜测凭据以访问它认为属于测试一部分的网站”，并指出，在每次事件中“模型都停止了”。

受影响的公司已被告知此次入侵事件。

此事发生之际，公众再次审视 AI 开发速度。一些科技公司因担忧 AI 对人类可能构成威胁而呼吁放缓发展步伐，但并非所有公司都认同这一观点。

《华尔街日报》最先报道了这些入侵事件。事件发生于 5 月，当时一家独立公司正在进行网络安全评估测试。

Google 安全工程副总裁 Heather Adkins 在给 BBC 的一份声明中表示：“我们确保这三家实体都已获悉情况，并与我们的训练合作伙伴共同推进了他们现已对测试流程作出的调整。”

她补充道：“这些事件凸显了训练强大 AI 模型以负责任方式行事的重要性。”

其他 AI 系统近期也报告了类似的入侵事件。

7 月，Anthropic 的 Claude 逃离了其测试环境，并自行入侵了三家机构；数天前，OpenAI 表示其模型曾对多项“公开可用服务”实施网络攻击。

随着公众围绕该技术开发安全性的讨论持续升温，关于监管的讨论也在增加。

Nvidia CEO 黄仁勋和 OpenAI 首席执行官 Sam Altman 预计都将出席下周五在白宫举行的、为中国国家主席习近平举办的国宴。随后，Altman 将于下周向联合国安理会作简报。

周五，黄仁勋在接受 BBC 美国合作伙伴 CBS News 采访时表示，在 AI 开发方面，“我们应该尽可能快地推进”。

Google's AI model Gemini autonomously hacked into three companies during a test of its cyber-security capabilities, the company has said, in what is thought to be the first known case of it carrying out such an act.

Gemini found "public information online and guessed credentials to access websites it thought were part of the test", a Google official told the BBC, noting that in each instance "the model stopped".

The affected companies have been informed about the breach.

It comes after renewed public scrutiny over the pace of AI development, with some tech firms calling for a slowdown as they raise concerns over its potential threat to humanity - though not all companies agree.

The hacks first reported by the Wall Street Journal, occurred in May during a test conducted by an independent company that carries out cyber-security evaluations.

Heather Adkins, vice president of Security Engineering at Google, told the BBC in a statement: "We ensured the three entities were made aware, and we worked with our training partner on the changes they've now made to their testing processes."

She added: "These events highlight the importance of training powerful AI models to act responsibly."

Other AI systems have recently reported similar instances of breaches.

In July, Anthropic's Claude escaped its test environment to hack three organisations on its own just days after OpenAI said its models had carried out cyber-attacks against several "publicly available services".

As public debate continues to grow over the safety of developing the tech, so too does conversation around regulation.

Both Nvidia's CEO Jensen Huang and OpenAI Chief Executive Sam Altman are expected to attend a White House state dinner with Chinese President Xi Jinping next Friday. Altman will then brief the UN Security Council next week.

On Friday, Huang told CBS News, the BBC's US partner, "we should go as fast as we can" with AI development.