Gemini adds new “Speak to Window” feature

Google is rolling out a new “Speak to Window” feature for the Gemini desktop app on macOS, expanding its voice capabilities beyond the Gemini interface. The update allows users to dictate, rewrite, summarize, and edit text in virtually any application by simply holding the Fn (Function) key and speaking naturally. The feature is rolling out globally in English and represents Google’s latest effort to make Gemini a system-wide AI assistant rather than just a standalone chatbot.

The launch brings Gemini closer to competitors such as ChatGPT and Claude, which already offer deep desktop integration. Instead of requiring users to copy and paste text into the Gemini app, Speak to Window enables AI-assisted writing directly within emails, documents, messaging apps, and other macOS applications, streamlining productivity workflows.

Gemini’s New Speak to Window Feature

The new capability lets users invoke Gemini from almost any active application.

To use it:

• Hold the Fn (Function) key while working in any supported app.
• Speak naturally to Gemini.
• Gemini automatically converts speech into polished text.
• The AI can rewrite, summarize, or edit the content before inserting it into the active window.

Unlike traditional voice dictation, the feature is designed to improve spoken input by removing filler words, correcting grammar, and restructuring sentences into polished writing.

Feature Snapshot

Item	Details
Feature	Speak to Window
Platform	Gemini for macOS
Availability	Global rollout in English
Activation	Hold the Fn key while in an app
Primary Functions	Dictation, rewriting, summarization, text editing

What Users Can Do

Speak to Window transforms Gemini into a voice-powered writing assistant that works across macOS.

Supported tasks include:

• Drafting emails.
• Writing documents.
• Summarizing selected text.
• Rewriting paragraphs.
• Editing grammar and tone.
• Creating notes using voice.
• Generating text inside third-party applications.

Because the feature works within active application windows, users no longer need to switch between apps to use Gemini for writing assistance.

Example Use Cases

Task	How Gemini Helps
Email drafting	Converts spoken ideas into polished emails
Document editing	Rewrites and improves text
Meeting notes	Dictates and formats notes
Content summarization	Condenses long passages
Brainstorming	Generates ideas directly in documents

Optional Screen-Aware AI

Google is also introducing optional screen-context awareness for certain tasks.

With user permission, Gemini can understand the content displayed in the active window, enabling more contextual assistance such as:

• Summarizing on-screen documents.
• Rewriting highlighted content.
• Editing text based on what is currently visible.
• Providing more relevant responses using the active application as context.

Google says these capabilities are optional and require user consent before accessing screen content.

Expanding Gemini Beyond Chat

Speak to Window is part of Google’s broader strategy to transform Gemini into a desktop AI assistant integrated throughout macOS.

Recent additions to the Gemini Mac app include:

• Native macOS support.
• Voice interactions.
• Notebook integration.
• Project organization tools.
• Deep Research.
• Music generation.
• AI-powered visualizations.

The company is steadily moving Gemini from a browser-based chatbot toward an AI assistant that can help users across their everyday desktop workflows.

Competition in Desktop AI Intensifies

Google’s latest update reflects increasing competition among AI companies to become the default desktop assistant.

Major players are investing heavily in:

• Voice-first AI interfaces.
• Context-aware assistants.
• System-wide productivity tools.
• Multimodal AI experiences.
• Cross-application integrations.

Rather than limiting AI interactions to chat windows, companies are embedding AI directly into operating systems and productivity workflows to make assistance more seamless and accessible.

Looking Ahead

The introduction of Speak to Window marks an important step in Google’s effort to make Gemini a fully integrated desktop assistant for macOS. By enabling users to dictate, rewrite, summarize, and edit text directly inside virtually any application using a simple keyboard shortcut, Google is reducing the need to switch between apps while making AI assistance more natural and accessible. The optional screen-aware capabilities further extend Gemini’s usefulness by allowing it to provide context-sensitive help based on what users are actively working on.

Looking ahead, Google is expected to continue expanding Gemini’s desktop capabilities with deeper system integration, additional languages, and more advanced multimodal features. As competition intensifies among AI assistants from Google, OpenAI, Anthropic, and others, the focus is increasingly shifting from standalone chatbots to intelligent assistants that can seamlessly enhance productivity across the entire desktop experience.