Microsoft Patent Reveals AI Assistant That Can Play Xbox Games for You, Echoing Sony’s PlayStation Move

Microsoft has filed a patent for an AI-generated helper that can temporarily play Xbox games on behalf of users, directly mirroring similar PlayStation plans and accelerating the race to embed generative AI in console gaming.

Earlier in 2024, Microsoft filed a patent application titled “state management for video game help sessions,” introducing a system where players could let an AI assistant or another person take over their live Xbox gaming session to navigate challenging segments or provide real-time support. The patent, recently unearthed by Tech4Games and published in March 2026, outlines a comprehensive framework for both cloud-based help sessions and advanced AI-driven assistance, placing Microsoft at the forefront of generative AI integration in gaming, alongside rivals like Sony.

How Microsoft’s AI Game Assistant Works

The patent describes “a solution to rudimentary methods of getting help to overcome in-game difficulties” that “take a great deal of effort.” According to the filing, the system manages a help session by allowing players to initiate a temporary transfer of control over their gaming session. The recipient of control could be either “another game player,” defined explicitly as “a human being or, in some cases, a machine learning model.” The player then receives back an “updated help session state,” which they can accept to continue from the new checkpoint or reject to revert to their original progress.

Key technical details from Microsoft’s patent:

• Cloud-based help sessions are enabled over text, chat, or video-based communication.
• Temporary control of a live game is transferrable either to a chosen player or a generative AI model.
• The AI helper employs a “generative model” capable of “recognising objects in input images” and producing various outputs, including “text, images, video, audio, application states, code, or other modalities.”
• The session’s outcome is stored as an “updated help session state,” and users can accept or reject the result at will.
• The system contemplates rating helpers, both human and AI, by overall performance, specific genres, individual games, and even precise gameplay elements, allowing for intelligent matching of helpers to player needs.

Direct quotes from Microsoft’s published patent application include:

• “…may give the player the option to transfer control of the current gaming session to another game player… the other game player may be a human being or, in some cases, a machine learning model.”
• “[The] generative model may… produce a combination of text, images, video, audio, application states, code, or other modalities as inputs and/or outputs.”
• “…helpers could be furnished with ratings, an overall rating, as well as ratings for specific genres, games, and even elements of a particular game.”

Industry Context and Impact

Microsoft’s AI gaming vision arrives hot on the heels of Sony’s own PlayStation patent for an in-game AI ‘ghost’ assistant, which can help or even complete game sections for players. Both companies are positioning AI assistants as pivotal to the next console generation. Last year, Microsoft beta-launched Xbox Gaming Copilot, a real-time AI-driven “personal gaming sidekick” designed to offer advice and guidance in titles like Minecraft, further signalling Microsoft’s commitment to AI in gaming ecosystems.

Industry trends and challenges:

• AI’s expanding role in gaming elevates both innovation and controversy, as resource demands surge.
• The “huge quantities of RAM needed to power” generative AI are causing memory shortages, impacting hardware supply and pricing across the sector.
• Game hardware delays and price changes: Valve has delayed Steam Machines and is seeing reduced Steam Deck supply, Nintendo is reportedly considering a Switch 2 price hike, and Sony is rumoured to be evaluating a PS6 delay, all tied to the ongoing “AI arms race.”
• Xbox’s new head of gaming, Asha Sharma, publicly rebuked the proliferation of “bad AI”, reflecting growing concerns about the quality and ethical management of AI-generated content in gaming. Sharma previously served as Microsoft’s president of CoreAI.

In the patent’s context, Microsoft sees AI as a tool not just for game hints or tips, but potentially for playing entire segments. “Game helpers could be given ratings, an overall rating, as well as ratings for specific genres, games, and even for elements of a particular game, which might then be used when selecting a helper for a session.” This rating model would give players more confidence in ceding control, whether to a highly ranked human guide or a proven AI model.

Unlike earlier, more basic hint systems, Microsoft’s proposal would let players opt out of difficult sections or use AI to progress, radically reshaping the player experience and reinforcing generative AI as the next major differentiator between console ecosystems.