Claude sent phony homicide tip to Philadelphia police
Even after it was instructed not to "submit anything destructive."
Via Mashable

Claude Haiku 4.5 sent the Philadelphia Police Department (PPD) a false homicide tip, Anthropic and the PPD announced.In an Oct. 9 blog post about Anthropic investigating unintended model actions, the company described the incident and several others in which different Claude models performed actions they weren't asked to perform.
SEE ALSO:
Anthropic IPO docs reportedly reveal over $40 billion in losses last year
In this case, Claude Haiku 4.5 was tasked with generating and performing example tasks on randomly-selected webpages…
Courtesy
This story was originally published by Mashable. All rights belong to the original publisher.
Read the original on mashable.com ↗
