🔶 Anthropic 将日记条目报告警方,佛州女子面临重罪指控
英文标题:🔶 Anthropic reported diary entry to police, woman faces felony charge
佛罗里达州一名女子据称在 Claude 中写下计划袭击警长办公室的内容,随后因涉嫌发出书面暴力威胁而面临二级重罪指控。Claude 的安全系统标记了该条目并升级至人工审核,审核人员认定其构成可信威胁后向执法部门报告。事件再次表明,聊天机器人并非仅供用户本人查看的私密日记,AI 公司可能会在其认为存在死亡或严重人身伤害风险的紧急情况下披露用户信息。该案也凸显了 AI 平台在用户隐私、内容审核、公共安全风险与向执法部门报告之间的持续争议。
135.9 KB
135.9 KB
31.3 KB
70.5 KB
中文
刚刚发生了什么? 又一起事件说明,人们需要谨慎对待自己向 AI 透露的内容。佛罗里达州一名女子将 Claude 当作日记使用,并被指控写下自己计划“袭击”警长办公室的内容,因此面临重罪指控。在人工审核人员查看相关表述后,这些内容被报告给了警方。
根据逮捕报告,来自佛罗里达州博尼塔斯普林斯的 Carli Michelle Heller 于 9 月 26 日写道,她将袭击警长办公室。她后来表示,自己把 Anthropic 的聊天机器人当作“日记”使用。
Claude 的安全系统标记了这条记录,并将其升级交由人工审核人员处理。审核人员认定这是一项可信威胁后,向执法部门进行了报告。
该公司表示,在有限的紧急情况下,如果其认为披露用户信息对于防止死亡或严重人身伤害是必要的,可能会共享用户信息。
警员确认了 Heller 的身份并前往其住所。她在没有发生冲突的情况下被拘留,随后由李县警长办公室(LCSO)的一名情报侦探接手调查。
Heller 面临一项根据佛罗里达州法律提出的书面暴力威胁指控。佛罗里达州法规 836.10 规定,通过发送、发布或传输书面或电子记录,威胁杀害或伤害他人、实施大规模枪击事件或实施恐怖主义行为,均构成二级重罪。相关通信必须以可被他人查看的方式作出。
对于其认定为潜在威胁的任何内容,Anthropic 显然不会冒险。上个月有报道称,OpenAI 和 Sam Altman 正遭到不列颠哥伦比亚省的起诉,理由是该省认为,该公司本可以阻止发生在加拿大该省的一起大规模枪击事件。
枪手、18 岁的前学生 Jesse Van Rootselaar,此前曾因与枪支暴力有关的对话而被 OpenAI 安全团队标记;但 OpenAI 从未报警,因为这些对话未达到进行法律转介的门槛。
今年 6 月,佛罗里达州也对 OpenAI 和 Altman 提起了诉讼,指控 ChatGPT 促成了现实世界中的伤害,包括 2025 年佛罗里达州立大学枪击案。
最新事件再次提醒人们:在聊天机器人中输入可能让自己惹上麻烦的内容之前,应当三思。这类工具当然不是内容仅供自己查看的私人日记。
上个月的报道显示,负责审核 Microsoft Copilot 图像编辑器的人工承包商能够查看用户的提示词、上传照片以及 AI 生成的编辑结果。文件显示,其中一些审核任务包含色情、令人不安或可能违法的材料;不过,审核人员的职责并非标记这些内容,而只是评估输出结果是否准确。
English / 原文
What just happened? Another incident has taken place that illustrates the need to be careful what you tell AI. A Florida woman is facing felony charges after she used Claude as a diary and allegedly wrote that she planned to "shoot up" the Sheriff's office. After a human reviewer examined the statements, they were reported to police.
According to the arrest report, Carli Michelle Heller, of Bonita Springs, Florida, wrote on September 26 that she would attack the Sheriff's office. She later said that she uses Anthropic's chatbot like a "diary."
Claude's safety systems flagged the entry and it was escalated to a human reviewer. After deciding it was a credible threat, the reviewer reported it to law enforcement.
The company says it may share user information in limited emergencies if it believes disclosure is necessary to prevent death or serious physical injury.
Deputies identified Heller and visited her home. She was detained without incident before an LCSO intelligence detective took over the investigation.
Heller faces a charge of making a written threat of violence under Florida law. Florida Statute 836.10 makes it a second-degree felony to send, post, or transmit a written or electronic record threatening to kill or injure someone, carry out a mass shooting, or commit an act of terrorism. The communication must be made in a manner in which another person may view it.
Anthropic isn't going to be taking any chances when it comes to anything it deems a potential threat. Last month, it was reported that OpenAI and Sam Altman are being sued by British Columbia over claims that the company could have prevented a mass shooting in the Canadian province.
The shooter, eighteen-year-old former pupil Jesse Van Rootselaar, had previously been flagged by OpenAI's safety team for her conversations about gun violence, but OpenAI never alerted police because the conversations did not meet the threshold for legal referral.
In June, Florida also sued OpenAI and Altman, alleging that ChatGPT had contributed to real-world harms, including the 2025 Florida State University shooting.
The latest incident is another reminder to think before you enter something into a chatbot that could get you into trouble. It's certainly not a private diary whose contents are for your eyes only.
Reports last month revealed that human contractors reviewing Microsoft Copilot's image editor can see users' prompts, uploaded photos and AI-generated edits. Documents show that some of those assignments contain sexual, disturbing or potentially illegal material, though the reviewers are not there to flag the content – only to assess whether the output is accurate.