Osegi
AI·2 min read

Claude plays GTA 4 with its own gamepad and keeps hitting walls

A Reddit user gave Claude a virtual keyboard, mouse and gamepad. It can drive to waypoints in GTA 4, but it keeps running into walls, cars and pedestrians.

A gamepad and keyboard on a desk in front of a screen showing a GTA 4 street scene, with an AI interface overlay.
Image: t3n Magazin
SUMODialoediviewergiftdetect

Claude can now play GTA 4. Not well, though. In the footage, the AI agent keeps walking into walls, parked cars and passers-by while it tries to reach a waypoint.

The project comes from a Reddit user who goes by "Wonderful Ad". With help from Claude Code, Anthropic's coding agent, he built an MCP server, a kind of bridge that connects Claude to his PC and the game running on it. Claude gets what he calls its "own keyboard, mouse, gamepad and screen capture" and uses them to see and control what is happening.

The games run in the background, so he can keep using the computer while Claude plays. He can also send several instances of Claude into different games at once. The reason is practical: he builds his own mods for many games and wants them tested automatically.

How well does Claude actually play GTA 4?

Connecting the AI to a game does not make it a player who can finish the story mode. Claude can only carry out simple commands such as driving, flying or walking to a waypoint on the map. Each game gets its own Claude Code profile that describes what the minimap looks like, how the camera turns and what waypoints look like. On foot, Claude basically draws the straightest line to the target, whatever is in the way.

Other games Claude has tried

In Detroit: Become Human, Claude played the opening scene, where an android negotiates with another android holding a human hostage. It had to make decisions again and again, but it only picked the obvious options on screen. Turning the camera to find extra information does not work yet.

In Cities: Skylines, Claude tried to build a city. The residents left soon after moving in, because there were no connections for drinking water and sewage.

The project is on GitHub if you want to try it. The developer advises using it only with offline games. In multiplayer titles, anti-cheat systems could issue a permanent ban.

Apps worth a look

SUMO: the number puzzle

Tap the right tiles, add them up, hit the target. Easy to learn, hard to master. Free, for all ages.

Tags:claudeclaude codegta 4mcp serverai agentsgaming

More from this day

See all →

More in: AI

See all →