Gemini for macOS adds new natural language capabilities

The Gemini app for macOS was built to keep you in your flow. Today, we’re introducing a new way to create, edit, and summarize with Gemini using just your voice, right where you are already working.

By long-pressing the Fn key, you can speak naturally into any window on your desktop. By default, this enables intelligent dictation, letting you easily transcribe your spoken words into clean, polished text — automatically removing the “ums” and “ahs,” catching mid-sentence corrections, and dropping the formatted text instantly at your cursor.

If you want Gemini to do more than intelligently transcribe, you can opt into Gemini reasoning through your settings. Once enabled, Gemini can understand the context on your screen to help you execute complex tasks. For example, you can:

• Extract and summarize information: Highlight local files, images, or documents on your desktop and tell Gemini exactly what you need. For example, you can say "Read these vet files and summarize my dog's medical history in an email to the kennel."
• Compose and rewrite text: Highlight text anywhere on your screen and use your voice to instantly rewrite it, tweak the tone, and drop the polished version right where you need it. Try saying, “Turn these notes into an executive summary with a TL;DR at the top.”
• Generate and edit images: Use your voice to create visuals when conceptualizing an idea or enhancing a travel itinerary, or iterate on a design on your desktop by referencing it to request quick updates. Try saying, "Take this illustration and generate a dark-mode version of it."

This new voice capability is rolling out globally to all users of the Gemini app for macOS in English, with more languages coming soon. Download the app at gemini.google/mac to get started.