An independent developer has built a Model Context Protocol (MCP) server that allows Claude to play PC games in the background while the user continues to work on the same computer.
MCP server · Computer-use agents
An AI plays a game in the background while the user keeps working
A Model Context Protocol server gives Claude its own virtual keyboard, mouse, and gamepad, plus screen capture of a single game window. In the demonstration, Claude reached a waypoint in Grand Theft Auto IV, then flew and landed a helicopter.
How the input streams are separated
Claude's inputs go to its own virtual devices, so the user's keyboard and mouse stay free for other work.
Claude
Reads the captured game screen and decides the next action
→
Virtual devices
Keyboard, mouse, and gamepad owned by the agent
→
Game window
Acts on the game only, as a separate player
↺
Screen capture feeds back to Claude in a continuous loop
User
Keeps their own keyboard and mouse for other work on the same machine
Earlier desktop agents
Operated on the whole desktop, which tended to block the user during a session
What the demonstration does and does not show
The evidence covers one game and one short sequence of actions.
Shown
Navigation to a set waypoint in GTA IV
Taking control of a helicopter
Flying and landing the helicopter
Input and capture running alongside other desktop work
Not yet reported
Success rates or reliability data
Response latency
Performance across other titles or longer sessions
Open-source status, installation, and the Claude model used
Independent community reactions
Why it matters
Running AI in parallel with human activity on one machine is a practical direction for agents.
Game QA
Testing game behavior with an agent
Accessibility
Assistive control of applications
Desktop automation
Repetitive tasks run while the user works
Each of these depends on broader testing, public code, and reliability data.
Continue reading The rest of this article is for AI News Blitz readers. Choose an option below to keep reading.
Already purchased? Sign in ✓ Signed in — this article isn’t included in your current plan.Unlocking the full article...