Breaking

iPhone Use Open-Source Plugin Lets OpenAI Codex Control a Real iPhone

October 9, 2026 at 20:46 EDT

AI Agents
Software Dev & Coding
Open Source

iPhone Use, a new open-source plugin for Codex, gives the agent a way to operate a real iPhone connected to a Mac over USB. The package combines a local MCP server, setup skills and a live sidebar widget so Codex can launch apps, inspect screens, tap, swipe, type and collect lists on the physical device. Codex plugin documentation

Oct. 9, 2026 - iPhone Use

Codex gets hands on a real iPhone

The open-source plugin links a Mac-hosted Codex session to a USB-connected iPhone, combining WDA control, MCP tools and a live sidebar view.

model tools

widget tools

v0.3.8

latest release

~1.7k

repository stars

Tool surface, drawn to scale

17 model tools

observe, tap, type, collect

2 widget tools

live screen controls

Most of the surface is for agent actions; the smaller set supports the visible sidebar preview.

How the control loop works

User task

→

Codex MCP call

→

WDA Runner

→

iPhone UI

Screenshots and compact UI observations return to the model for the next action or a verified stop.

Why it matters

Codex can work against real installed apps, accounts, notifications and native screens instead of only a simulator or an API.

What slows adoption

Users still need full Xcode, device trust, signing, an unlocked phone and a healthy WDA session.

Continue reading

The rest of this article is for AI News Blitz readers. Choose an option below to keep reading.