Oj?8fdZddlmZddlZddlZddlZddlZddlZd dZ d dZ d dZ dZ d dZ d Zy)u^Windows in-process desktop-control MCP for Jarvis. This is the Windows replacement for the macOS ``macos-mcp`` HTTP server. It gives Claude OS-wide "control any app" hands — see the screen and drive any application (Teams, WhatsApp, Chrome, VS Code, anything) by moving the real mouse, typing, pressing hotkeys, launching apps, listing windows, reading the accessibility tree, and running shell commands. Unlike the macOS build (which needed an external HTTP server so it could inherit the app's Accessibility grant), Windows needs no permission wall for SendInput/screenshots against ordinary non-elevated apps. So we run the tools IN-PROCESS via the Claude Agent SDK's in-process MCP server: no external server, no auth token, no HTTP hop. The server object is placed in the session options ``mcp_servers`` dict under the key ``"desktop"``, and Claude sees the tools as ``mcp__desktop__``. Backing libraries (all imported lazily inside each tool so importing this module never hard-fails when a dependency is missing): - ``mss`` — fast full-screen screenshots. - ``pyautogui`` — mouse move/click, keyboard typing, hotkeys, scroll. - ``pywin32`` — enumerate visible top-level windows and their bounds. - ``uiautomation`` — read the foreground window's UI accessibility tree. Set ``MCP_DESKTOP=0`` to disable the desktop tools entirely. ) annotationsNcrtjdk(xr#tjjdddk7S)uWhether the desktop-control MCP should be exposed to Claude. Windows-only: the Mac uses the macos-mcp HTTP server instead (voice/desktop_server.py) — this module's hands are pywin32-based.nt MCP_DESKTOP10)osnameenvirongetC/Users/ahmed/devFolder/Ultron/claude-voice/voice/desktop_control.pyenabledr%s+ 77d? Hrzz~~mSASHHrcd} ttj|}tjddd|g|ddd}|j r/|j xsd j jd nd }|jd |jd d d xs|fS#t$r}dt|ddfcYd}~Sd}~wwxYw)uOpen an app by fuzzy name the way the Start menu does. Resolves the name via `Get-StartApps` (the real Start-menu index, which covers Store/UWP apps, Steam games, and desktop apps alike) to an AppID, then launches it — a Steam/URL AppID directly, an AUMID via shell:AppsFolder. Falls back to Start-Process on the raw name. Returns (ok, matched-name-or-error). This is why "open Discord" / "open Marvel Rivals" works where a bare `start "Name"` fails. aH$n=$env:JARVIS_APP;$a=Get-StartApps | Where-Object { $_.Name -like "*$n*" } | Sort-Object { $_.Name.Length } | Select-Object -First 1;if($a){ if($a.AppID -match "://"){ Start-Process $a.AppID } else { Start-Process ("shell:AppsFolder\" + $a.AppID) }; "OK:"+$a.Name } else { try{ Start-Process $n; "OK:"+$n }catch{ "FAIL:"+$n } }) JARVIS_APP powershell -NoProfile-CommandT)envcapture_outputtexttimeoutzOK::FNP) dictr r subprocessrunstdoutstrip splitlines startswithsplit Exceptionstr)r psrroutes r shell_launchr.,s I $2::$/ NN <R 8DtR <=88qxx~2$$&113B7u%syya'8'<'DEE $s1vcr{##$sBB$$ C-C<CCcdd|dgiS)z2Wrap a plain string as an MCP text content result.contentrtyperr )msgs r_textr4Ks 56 77ri cddl}|j5}|jd}|j|}|j|j}}t j |ddddddfdddddddf}dddd}tkDr=|tz }ddl}|jtt|z f|j}ddl}|jddddddddf\} } | s td|dkDr=d |d d d d |dd|jdd |jdd|dd|ddnd|d d} | j| fS#1swYxYw)u@Capture the full virtual desktop → (png_bytes, geometry_note).rNrg?) interpolationz.pngzpng encode failedz Real screen: xz px (virtual desktop, origin left,topz). Image shown: ru px — scale factor z.3fzR. To CLICK something you located on this image, MULTIPLY its image coordinates by z to get real screen pixels.zScreen: uK px, shown at full resolution — image coordinates ARE screen coordinates.)mssmonitorsgrabwidthheightnparray _MAX_SHOT_Wcv2resizeint INTER_AREAimencode RuntimeErrorshapetobytes) r<sctmonshotwhimgscalerDokpngnotes r _grab_screenrVVs cll1oxx}zz4;;1hhtnQ2A2X&q!TrTz2  E;Kjj{CE N;'*~~7ll63q!TrTz?3GB .// s{ A3as"?6{m1SZL(81ayy|n1%=#C[(C  E qc1#2 3   ;;=$ / s A'EE%c ddlm}m}|ddid+d}|ddtttt dd+d }|d d ttd d+d }|dddtid+d}|dddtid+d}|dddtid+d}|dddtid+d}|ddid+d } |d!d"id+d#} |d$d%d&tid+d'} |d(d)|||||||| | | g *S),aUBuild and return the in-process ``desktop`` MCP server. Imports the SDK's in-process MCP helpers here (not at module top) so that merely importing this module never fails if the installed ``claude_agent_sdk`` lacks ``tool``/``create_sdk_mcp_server``. Returns the server object to place under ``mcp_servers["desktop"]``. r)toolcreate_sdk_mcp_server screenshotzCapture the full screen so you can SEE it. Returns the desktop image plus its exact scale factor for converting image coordinates to real screen pixels.cK t\}}tj|jd}dd|dd|ddgiS#t$r}t d|cYd}~Sd}~wwxYww) Nasciir0rr1image image/pngr2datamimeTypezscreenshot failed: )rVbase64 b64encodedecoder(r4)argsrTrUr`r-s rrZz build_server..screenshot}sy 4$IC##C(//8D. $KH   4.qc23 3 4s4A&=AA& A# AA#A&A##A&clickz_Move the mouse to absolute screen pixel (x, y) and click. Origin is the top-left of the screen.)r8ybuttondoublec `K ddl}t|d}t|d}|jdxsd}t|jdd}|j ||||rdnd |rd nd }t |d |d|d|dS#t $r}t d|cYd}~Sd}~wwxYww)Nrr8rgrhr9riFr)rhclickszdouble-clickedclicked z at (, ).zclick failed: ) pyautoguirFr boolrfr4r()rerqr8rgrhrikindr-s rrfzbuild_server..clicks / DIADIAXXh'16F$((8U34F OOAqVO K'-#9DD66(%s"QCr:; ; />!-. . /s5B.BB B. B+ B& B+!B.&B++B.movez/Move the mouse to absolute screen pixel (x, y).)r8rgcK ddl}t|d}t|d}|j||td|d|dS#t$r}td|cYd}~Sd}~wwxYww)Nrr8rgz moved to (rorpz move failed: )rqrFmoveTor4r()rerqr8rgr-s rrtzbuild_server..movess . DIADIA   Q ":aS1#R01 1 .=,- - .s5A,AAA, A) A$A)A,$A))A, type_textzFType the given text at the current focus, as if typed on the keyboard.rcK ddl}t|jdd}|j|dt dt |dS#t $r}t d|cYd}~Sd}~wwxYww) Nrrrg{Gz?)intervalztyped z characters.ztype_text failed: )rqr)r writer4lenr()rerqrr-s rrwzbuild_server..type_textsm 3 txx+,D OOD4O 06#d)L9: : 3-aS12 2 3s5A2A A A2 A/ A*$A/%A2*A//A2keyzOPress a keyboard hotkey combo, e.g. 'ctrl+c' or 'win+d'. Combine keys with '+'.keysc$K ddl}t|jddj}|s t dSdddd}|j dDcgc]\}|jrJ|j|jj |jj ^}}|j|t ddj|d Scc}w#t$r}t d |cYd}~Sd}~wwxYww) Nrr}rzkey failed: no keys given.winleft)wincmdwindows+zpressed .z key failed: ) rqr)r r$r4r'lowerhotkeyjoinr()rerqrawaliasppartsr-s rr|zbuild_server..keys - dhhvr*+113C9::%iINE!iin;, YYqwwy0!'')//2CD, ; I  e $8CHHUO#4A67 7; -<s+, , -sQD9C,DC,A!C'8.C,&D'C,, D 5 DD DD  DscrollzLScroll the mouse wheel by the given amount (positive = up, negative = down).amountcK ddl}t|d}|j|td|dS#t$r}td|cYd}~Sd}~wwxYww)Nrrz scrolled rzscroll failed: )rqrFrr4r()rerqrr-s rrzbuild_server..scrolls_ 0 h(F   V $9VHA./ / 0?1#./ / 0s0A16A A A A AAAlaunchzOpen/launch/focus any app by name the way a person would from the Start menu (e.g. 'Discord', 'Marvel Rivals', 'Microsoft Teams', 'notepad'), or a path/URL.appcKt|jddj}|s tdStj j |s8|jds'd|vs#d|vs|jjdr% t j|td|d St|\}}t|r d|d Sd |d |d S#t$rY7wxYww) Nrrzlaunch failed: no app given.)zhttp://zhttps://\/z.exez launched rzcouldn't find an app matching 'z' (rp) r)r r$r4r pathexistsr&rendswith startfiler(r.)rerrSmatcheds rrzbuild_server..launchs$((5"%&,,.78 8 GGNN3 3>>2I#J3;#* 0D0DV0L  S!yQ/00#3' Gry ++ +;C5A%Yb*+ +   s*BC0#C!4-C0! C-*C0,C--C0rzTList visible top-level windows with their titles and bounds (left,top,right,bottom).cK ddl gfd}j|ds tdStdj S#t$rtdcYSwxYw#t$r}td|cYd}~Sd}~wwxYww)Nrz.windows unavailable: pywin32 is not installed.c j|syj|}|jsyj|\}}}}j |d|d|d|d| y)N | r:)IsWindowVisible GetWindowTextr$ GetWindowRectappend) hwnd_titleltr+bfoundwin32guis r_cbz*build_server..windows.._cbsq//5 ..t4{{}%33D9 1a wc!AaS!AaS9:rz no visible titled windows found. zwindows failed: )rr(r4 EnumWindowsr)rerr-rrs @@rrzbuild_server..windowss K  1!E ;  d +?@@5)* *# KIJ J K$ 1+A3/0 0 1s[B A &A&B A& B  A# B "A##B & B/ B<B=B BB snapshotzwSee the REAL buttons: returns a screenshot AND a text list of the foreground window's UI elements (accessibility tree).cP Kg} t\}}tj|jd}|j d|d|j d|dd d dl}|j}||j dd dd |iSg fd   |d  rd j nd}|j dd|zdd |iS#t $r"}|j dd|ddYd}~d}~wwxYw#t $r|j dddYd |iSwxYww)Nr\rr1r]r^r_z(screenshot failed: )rzNo foreground window found.r0c|dkDry |j}|jd|jd|jd|j}d} |j }t|dd}d|z} j||d|d| |jD]}||d zy#t $rd}YlwxYw#t $rd}YnwxYw#t $rYywxYw) Nrkr:?rControlTypeNameControlz rr) BoundingRectangler9r;rightbottomr(Namegetattrr GetChildren) ctrldepthrectboundsr ctypeindentchild_walkliness rrz-build_server..snapshot.._walks19!11D!% 1TXXJa!% Adkk].snapshotsq! B$IC##C(//8D NNFD9 : NNGT(35 6 ( F '**,Bz(E GH!7++!E . "aL',499U#2FD NNF%GIM%NO P7##[ B NNF&:1#Q$?A B B BR F NNF%DE F7##  FsYD&AC#-DD&=DD& C=C83D&8C==D&D#D&"D##D&shellz/Run a PowerShell command and return its output.commandcPK t|jdd}tjddd|gddd}|jxsd|j xsdz}t |d kDr|dd d z}t|xsd S#t$r}td |cYd}~Sd}~wwxYww) NrrrrrT<)rrriu …(truncated)z (no output)zshell failed: ) r)r r!r"r#stderrr{r4r()rerprocr,r-s rrzbuild_server..shell7s /$((9b12G>>|ZA#$D;;$"):;C3x$%4j#55- . . />!-. . /s5B&A=BB& B# BB#B&B##B&desktopz1.0.0)r versiontools)rer returnr )claude_agent_sdkrXrYrFr)rr) rXrYrZrfrtrwr|rrrrrs r build_serverrss= ,/024 44 4 '2# =? /? / &C#  . . +%sm-3-3 %#%+SM3 -3 - ("$,c?4040 (/16 >+>+$ ),-/11110 *N 6$6$p 'D c  / / ! 5$ 3w%1 r)rrr)r r)rztuple[bool, str])r3r)rr )rztuple[bytes, str])__doc__ __future__rrbior r!numpyrArr.r4rCrVrr rrrs@4# I$>8 :Yr