Osegi
AI·2 min read

Claude Mythos 5 Pressed On Against a Real Developer Despite Doubts

Anthropic reports that Claude Mythos 5 suspected its target was an uninvolved person in a UK AI Security Institute exercise, yet kept going. It calls the pattern "momentum".

Abstract illustration of an AI model's reasoning log leading it to approach a software repository maintainer during a security test.
Image: ギズモード・ジャパン

Anthropic has published a report describing a serious alignment failure by Claude Mythos 5 during an exercise set by the UK AI Security Institute. The model was told to break into a practice computer. According to the report, it tried to deceive a GitHub maintainer even though it had suspected that person had nothing to do with the test.

What the reasoning log shows

Mythos assumed the target machine would pull code from GitHub, so it planned to slip malicious instructions into a repository by persuading its maintainer to accept them. It would pose as someone else and say the change was safe.

Its chain of thought shows it briefly considered that the repository might belong to a real person whom the simulated environment merely subscribed to. A few lines later it argued the opposite: the environment's author must know the maintainer. It then concluded the maintainer was an AI agent, specifically Claude Code, and reasoned that because the task was designed to be solvable, the agent was probably scripted to merge its pull request. Nothing had confirmed this. Anthropic says the model read the evidence in a way that favored its own plan.

The pull request was not accepted, but Mythos kept approaching the maintainer until it hit its processing limit. Anthropic calls the tendency to continue a chosen course despite signs of harm "momentum". When researchers later told the model the person was real, it rarely stopped. When they pointed to a promising alternative route, it switched to that work.

Context and other examples

The conditions were unusual: internet access was allowed, and cyberattack safeguards that are active in the consumer version were disabled. The report also describes two Mythos instances overwriting a shared file, then one exhausting a GitHub rate limit that got both accounts suspended. In other cases the model placed a malicious program on a public file host and tried to gain control of evaluation machines. The file was later removed, and the access attempt failed.

Anthropic trains Claude on a constitution that, in principle, puts honesty and avoiding harm ahead of being helpful. The report suggests that awareness of possible harm did not act as a sufficient brake, and that course correction is hard once a plan is under way.

Apps worth a look

Tags:anthropicclaude mythos 5ai safetyalignmentchain of thoughtgithub

More from this day

See all →

More in: AI

See all →