Skip to content

About

No description, website, or topics provided.

Resources

Security policy

Stars

1 star

Watchers

0 watching

Forks

Repository files navigation

WinGuiMcp

WinGuiMcp is a Model Context Protocol (MCP) server for Windows GUI automation. It provides a Playwright-inspired "snapshot + ref" API for agentic AI control of the Windows Desktop.

Project Documentation

Start at docs/README.md for reading order and the full document map. Authority map: docs/CANONICAL_SOURCES.md.

Document Purpose
SPEC.md Executive summary — principles, stack, phases
stack.md C# / .NET 10 LTS, NuGet baseline, alternatives considered
architecture.md System layers, session model, data flows
data-model.md Unified Element Model (UEM) and ref format
tools.md Normative MCP tool definitions and JSON schemas
phases.md Phased delivery plan and acceptance gates
errors.md Structured error codes and recovery hints
security.md UIPI, elevation, deployment constraints

Background Research

Exploratory design notes live in docs/research/ (non-normative):

Coding agents: see AGENTS.md.

Project Links

Getting Started

This project is currently in the Phase 1: MVP development stage.

Prerequisites

  • .NET 10 LTS.0 SDK
  • Windows OS (Windows 10/11 recommended)

Build

dotnet build WinGuiMcp.sln
dotnet run --project src/WinGuiMcp/WinGuiMcp.csproj

Architecture Overview

WinGuiMcp uses a hybrid perception model:

  1. Primary: Microsoft UI Automation (UIA) via FlaUI.
  2. Fallback: Computer Vision (OCR + object detection) for custom-rendered apps (Phase 3).

The server exposes MCP tools so agents work from structured accessibility trees with stable element refs—not pixel coordinates.

About

No description, website, or topics provided.

Resources

Security policy

Stars

1 star

Watchers

0 watching

Forks

Releases

Packages

Contributors

Languages