Google released a new version of Gemini's Mac client that can interact with other apps on the user's computer, SiliconANGLE reported, and Google said computer use in the Gemini app for Mac helps get multi-step tasks done across local files, desktop apps, and the web.[1][2] Users can now describe a task in plain language, and Gemini will handle the clicking, typing, and form-filling across permitted apps while working in an isolated background window, the company said.[2]
Gemini operates in an isolated background window with a live preview in the chat, and users' main screen and cursor remain completely free so they can keep working without interruption, the company said.[2] Users choose which apps Gemini can access, can pause the agent at any time, and must approve key actions before they occur, Google said, with privacy and safety controls built in.[2][1] Google lists ways to try the feature such as batch color-grading photos, extracting data from local PDFs to fill out shipping quotes, turning dashboard metrics into Google Slides presentations, or staging resale listings from a local folder of clothing photos.[2]
The capability is rolling out now in English in the U.S., according to Google, and TNW reported that it is for paying subscribers to Google's AI Plus, Pro and Ultra plans and needs a Mac with Apple Silicon.[2][3] The Mac version of Meta's Muse can also interact with local apps and data, and Google may seek to match its rivals' cloud-based workflow hosting features in the future, SiliconANGLE reported.[1]
Google warns that Gemini can make mistakes, including permanently deleting or sharing files, though it is designed to ask permission first and can only access folders users connect.[3] The feature is not available in Europe or the UK, where Google’s Gemini Spark agent also does not operate, TNW reported.[3]
