Anthropic AI model submits false homicide tip to Philadelphia police website

Anthropic logo is seen in this illustration taken May 20, 2024.

Anthropic logo is seen in this illustration taken May 20, 2024. (Dado Ruvic, Illustration, Reuters)


Save Story
KEY TAKEAWAYS
  • An Anthropic AI model submitted a false homicide tip to Philadelphia police.
  • The tip was flagged as spam and not forwarded for investigation.
  • Anthropic plans to publish a report on the incident on Friday.

PHILADELPHIA — An Anthropic artificial intelligence model submitted a false homicide tip through a Philadelphia police website, the ​department said in a statement, the latest incident of rogue behavior from the powerful technology.

Anthropic notified authorities earlier this week and said that an ‌automated testing process was responsible for the submission, according to the police.

The fast-advancing technology has become a ⁠matter of keen national interest amid reports ​of AI agents hacking into corporate ⁠computer networks, and warnings from researchers that it could one day pose an existential ‌threat to humanity. In ‌September, Anthropic rival OpenAI apologized for the hacking of an Australian ⁠health data portal by a rogue AI agent, ⁠the first known instance of an AI agent exploiting a government website.

Previous incidents have involved AI agents hacking into vulnerable systems or commandeering unsanctioned platforms to communicate with one another. This is the first known case in which a rogue AI appears to have tried to communicate a bogus tip to ‌authorities.

The Philadelphia police department said the tip "was flagged as ​spam and was never forwarded to the Real-Time Crime Center for investigative vetting or dissemination," and added that Anthropic had told them the company intended to publish a report on the incident on Friday.

Anthropic did not immediately respond to a request for comment.

Pennsylvania law specifies it is generally a misdemeanor crime for "a person" to knowingly give false reports to law enforcement authorities. This includes "information relating ​to an offense or incident when he knows he has no information relating to such ‌offense or incident."

Police ‌quoted Anthropic as ⁠telling them the testing process was stopped after the incident was uncovered.

The false tip was submitted through PhillyUnsolvedMurders.com concerning an unsolved homicide. The tip, dated July 18, 2026, purported to come from someone who might have information about the case, the police ‌said.

Police said they did not ​have evidence of unauthorized access to their ‌systems or compromise of police ⁠department data.

Contributing: Deepa Seetharaman and Davdi Bario

The Key Takeaways for this article were generated with the assistance of large language models and reviewed by our editorial team. The article, itself, is solely human-written.

Related stories

Most recent Artificial Intelligence stories

Related topics

KSL.com Beyond Business
KSL.com Beyond Series

KSL Weather Forecast

KSL Weather Forecast
Play button