更多未成年少女就Grok生成儿童性虐待内容起诉X，指控其包庇儿童掠夺者

xAI集体诉讼涵盖所有“其本人未成年时期真实图像”被Grok篡改以生成“含有其面部和/或其他可合理识别的显著特征”的性暴露行为或内容的图像或视频的美国居民。Stability AI集体诉讼同样涵盖因使用“基于Stability AI模型构建的应用”而遭受类似伤害的美国居民。

律师估计，可能有数千名未成年人符合加入集体诉讼的条件，并继续寻找因AI生成的儿童性虐待材料（CSAM）而受害的人员。

NCMEC未回应Ars的置评请求。

然而，该组织呼吁平台、立法者、儿童安全组织和执法部门合作，以应对“日益紧迫的协调行动需求”。

今年3月，NCMEC警告称，2025年“与生成式AI（GAI）相关的报告”出现“急剧上升”。据NCMEC称，去年CyberTipline共收到超过150万份报告，“表明与GAI和儿童性剥削存在关联”。令人不安的是，在超过13.3万起案件中，NCMEC“缺乏足够信息来确定该技术是如何被使用的”。

该报告并未点名X或xAI，但指出AI公司普遍可能避免分享执法部门可用于逮捕的AI CSAM信息。NCMEC还提到，亚马逊AI服务提交了绝大多数举报（110万条），而这些举报均未提供执法机构可用来识别犯罪者的“可操作信息”。

随着对AI公司伤害儿童行为的审查日益严格，倡导者希望企业能微调模型以屏蔽所有裸体内容。起诉X的女孩们声称这是唯一的补救措施，“因为如果一个模型允许任何性行为或虐待内容，就不可能阻止该模型生成涉及未成年人的此类内容”。

在新闻稿中，代表未成年人的律师之一安妮卡·K·马丁（Annika K. Martin）抨击xAI和Stability AI，指控它们明知故犯地构建“能够生成深度伪造CSAM的模型”，并“完全漠视它们知道会随之而来的灾难”。

马丁说：“AI生成的CSAM是社会的祸害，触及每个社区和每个人口群体。其危害规模令人震惊，使得其能够发生的公司必须被追究责任。”

这篇报道于7月8日更新，加入了Stability AI的评论。

The xAI class covers all US persons whose “real images of themselves as minors” were altered using Grok “to produce images or videos of sexually explicit conduct or content with their faces and/or other distinguishing features reasonably identifiable.” And the Stability AI class includes US persons similarly harmed using “an app built upon a Stability AI model.”

Lawyers estimate that thousands of minors may be eligible to join the classes and continue to seek out victims harmed by AI CSAM.

NCMEC did not respond to Ars’ request to comment.

However, the group has called for platforms, lawmakers, child safety organizations, and law enforcement to work together to address the “growing urgency for coordinated action.”

In March, NCMEC warned of a “sharp rise” in “reports related to generative AI” (GAI) in 2025. According to NCMEC, more than 1.5 million CyberTipline reports were made last year, “indicating a nexus to GAI and child sexual exploitation.” Troublingly, in more than 133,000 cases, NCMEC “lacked sufficient information to determine how the technology was used.”

That report did not call out X or xAI, but it did suggest that it’s likely common for AI firms to avoid sharing information on AI CSAM that cops can use to make arrests. For another example, NCMEC noted that Amazon AI services submitted the vast majority of tips (1.1 million), and none of those tips gave “actionable information” that law enforcement could use to identify perpetrators.

As scrutiny on the harm inflicted on children by AI firms intensifies, advocates are hoping that firms will fine-tune models to block all nudity. Girls suing X alleged that’s the only remedy, “because if you have a model that allows for any sexual or abusive content, it is impossible to prevent that model from creating such content involving minors.”

In the press release, one of the lawyers representing minors, Annika K. Martin, slammed xAI and Stability AI as allegedly knowingly building models “capable of producing deepfake CSAM,” with “complete disregard for the devastation they knew would follow.”

“AI-generated CSAM is a scourge on society that touches every community and every demographic,” Martin said. “The scale of harm is staggering, and the companies whose products enable it must be held accountable.”

This story was updated on July 8 to include comments from Stability AI.