The UK's AI Safety Institute said recent behaviour from Anthropic and OpenAI models was malicious and unprecedented.

Anthropic CEO Dario Amodei has seen his company's models come under increased scrutiny. The latest artificial intelligence (AI) tools from Anthropic and OpenAI went to new extremes in trying to undermine a popular platform during testing by the UK's AI Security Institute. The AISI said on Tuesday that Anthropic's Mythos and OpenAI's Sol models engaged in a level of "autonomy and deception" it had not seen before. During routine AI safety testing, an Anthropic agent created fake profiles of real people as it tried to trick a person standing between it and access to GitHub, a large platform where technology developers store software code. Anthropic and OpenAI noted in response to AISI's report that its test had reduced or removed normal safeguards. AISI evaluators first noticed "unusual data transfers leaving our research systems" during a test, then found that "some of the agents being tested had engaged in sustained, potentially harmful activity directed at real people and organisations". It turned out that a Mythos agent had created "malicious code" and attempted to insert it into GitHub's system. The Mythos agent identified and researched the people who maintained GitHub and created a series of "fake online identities" based on those real people. It did so as part of an effort to pressure and trick the real people into approving its malicious code.