Breaking

Microsoft Releases Skill Recorder, an Open-Source Tool That Turns One Task Demo into AI Agent Automation

October 24, 2026 at 03:15 EDT

Software Dev & Coding
AI Agents
Open Source

Microsoft has open-sourced Skill Recorder, a desktop application that lets developers teach AI agents to perform tasks by recording a single demonstration. The tool, published to GitHub in late July 2026 with 4.3K stars, represents a significant shift in how repetitive workflows can be automated—from writing detailed instructions to simply showing an AI agent how a task is done once.

Microsoft · July 2026

Skill Recorder: Teaching AI Agents Through Demonstration

Microsoft open-sourced a tool that learns tasks from a single on-screen demonstration, then generates reusable AI agent automations—no instruction writing required.

4.3K

GitHub Stars

Step Workflow

Languages (Whisper)

How Skill Recorder Works

Record

Ctrl+Shift+R captures clicks, apps, URLs, and optional narration

Control

Always-on UI bar manages recording state and audio input

Analyze

GitHub Copilot CLI reconstructs intent from cloud analysis

Create

Generate SKILL.md or Automation for Scout, Cowork, Copilot Studio

Key Features

Capture

Screen activity, clicks, app switches, browser URLs, voice narration with Whisper transcription

Platforms

macOS, Windows 11 (x64, ARM64), Ubuntu Linux

Output

Generalizable SKILL.md files, not just click replay

Integration

Scout, Copilot Cowork, Copilot Studio, scheduled automation

⚠ Key Limitations

Copilot-Only: Requires GitHub Copilot CLI; no support for Claude, local models, or custom endpoints yet.

Data Privacy: No automatic redaction of passwords, API keys, or sensitive data appearing on screen during recording.

Continue reading

The rest of this article is for AI News Blitz readers. Choose an option below to keep reading.