I/O 2024: Gemini for Workspace

Year: 2024 · ▶ Watch on YouTube

Aparna Pappu (VP and GM, Google Workspace) · Tony Vincent (Director of Product Management)

Switch language → zh

Segments (5)

  • 00:00:12 · Introduction to Gemini in Workspace — Aparna Pappu
    • Aparna Pappu introduces the progress made on Gemini for Workspace, highlighting its adoption and the upcoming general availability of the side panel.
  • 01:21 · Gmail Mobile Demo with Gemini 1.5 Pro — Aparna Pappu
    • A demonstration of new Gemini 1.5 Pro capabilities in Gmail mobile, including cross-inbox summarization, Q&A, and contextual smart replies.
  • 04:23 · AI Workflows Demo: Receipt Management — Aparna Pappu
    • Showcasing a new AI workflow that automatically organizes email attachments (receipts) into Google Drive and creates a structured expense tracker in Google Sheets.
  • 07:58 · Future Vision: The AI Teammate — Aparna Pappu
    • Introducing the concept of a virtual, Gemini-powered AI Teammate that can be customized with a specific role and objectives to collaborate with human teams.
  • 09:24 · AI Teammate ‘Chip’ Demo — Tony Vincent
    • Tony Vincent demonstrates how to configure and interact with a virtual AI Teammate named ‘Chip’ in Google Chat to track projects and synthesize information.

Products Announced (9)

  • 00:00:36 · Gemini for Workspace Side Panel (General Availability)
    • Integrated AI assistance in Workspace apps · Summarize conversations · Draft emails
    • Generally available next month
  • 01:08 · Gemini in Meet (Feature Expansion)
    • Real-time captions with automatic language detection
    • Expanding to 68 languages
  • 01:31 · Gemini 1.5 Pro in Workspace (Integration)
    • Long context window for cross-document/email understanding
    • Coming to Workspace and AI Premium customers
  • 01:54 · Summarize in Gmail Mobile (Workspace Labs)
    • Summarizes long email threads in a mobile-friendly card
    • Rolling out this month
  • 02:40 · Gmail Q&A (Workspace Labs)
    • Ask natural language questions about content across your entire inbox · Synthesizes information from multiple emails and attachments
    • Rolling out in July
  • 03:32 · Contextual Smart Reply in Gmail (Workspace Labs)
    • Generates detailed, context-aware reply suggestions · Understands the intent of the entire email thread · Allows previewing the full reply before sending
    • Rolling out in July
  • 05:17 · AI Workflows in Workspace (Workspace Labs)
    • Automates multi-step tasks across different Workspace apps (e.g., Gmail to Drive to Sheets) · Users can approve and automate recurring workflows
    • Available this September
  • 06:36 · Data Q&A in Sheets (Workspace Labs)
    • Ask natural language questions about data in a spreadsheet · Generates analysis and visualizations (e.g., charts)
    • Available this September
  • 09:08 · AI Teammate (Prototype)
    • A virtual, Gemini-powered agent with its own Workspace account · Can be customized with specific roles, instructions, and permissions · Collaborates with teams in Chat, Docs, and other apps
    • Future concept, currently in prototyping

Commitments / Timelines (5)

  • 00:00:38 (Next month) — Gemini for Workspace Side panel will be generally available.
  • 04:11 (This month) — Summarize feature in Gmail will roll out to Labs users.
  • 04:13 (In July) — Gmail Q&A and Contextual Smart Reply will roll out to Labs users.
  • 07:45 (This September) — AI workflows for organizing attachments and generating sheets will be available in Workspace Labs.
  • 07:50 (This September) — Data Q&A in Sheets will be available in Workspace Labs.

Demos (3)

  • 01:38 ✓ · Gmail Mobile with Gemini 1.5 Pro — Aparna Pappu
    • A user receives an email from her husband about a roof repair. Using Gemini, she summarizes the long email thread, asks a comparative question to find the best contractor bid across multiple emails, and then uses a contextual smart reply to confirm the job.
  • 04:53 ✓ · AI Workflow for Receipt Management — Aparna Pappu
    • An AI workflow was triggered from an email containing a receipt. Gemini offered to find all receipts from the last 30 days, save them to a new Drive folder, and create a Google Sheet to track the expenses. The workflow was then automated for all future receipts.
  • 09:32 ✓ · AI Teammate ‘Chip’ in Google Chat — Tony Vincent
    • A virtual AI teammate named ‘Chip’ was configured with a specific role. In Google Chat, ‘Chip’ answered questions by searching across multiple conversations and documents, synthesized project status updates, and proactively created a document to address a flagged issue.

Notable Quotes (5)

  • 00:00:32 — Aparna Pappu:

    And now, we’re really excited that the new Gemini-powered side panel will be generally available next month.

  • 02:50 — Aparna Pappu:

    This new Q&A feature makes it so easy to get quick answers on anything in my inbox.

  • 04:43 — Aparna Pappu:

    But what if Gemini could make these journeys totally seamless, perhaps even automate them for you entirely?

  • 09:08 — Aparna Pappu:

    We’re prototyping a virtual, Gemini-powered teammate.

  • 11:48 — Tony Vincent:

    So much of this practical helpfulness comes from how we’ve customized Chip to our team’s needs and how seamlessly this AI is integrated directly into where we’re already working.

Visual Signals (Beyond the Transcript)

On-Screen Text Moments (8)

  • 00:00:05 · Introducing Aparna Pappu
    • Introduces the speaker for the Workspace segment.
  • 00:00:38 · Gemini for Workspace Side panel generally available next month
    • Key product availability announcement.
  • 01:00 · 30% Improved productivity for Sports Basement
    • Provides a specific metric to quantify the benefit of Gemini for a customer.
  • 01:10 · Gemini in Meet Now expanding to 68 languages
    • Announces a significant expansion of a core accessibility and collaboration feature.
  • 01:29 · Gemini 1.5 Pro
    • Names the underlying model powering the upcoming features.
  • 04:12 · Gmail in Workspace Labs Summarize this month Gmail Q&A and Contextual Smart Reply in July
    • Provides a clear timeline for the rollout of new Gmail features.
  • 07:45 · AI workflows available this September in Workspace Labs
    • Announces the availability of the new cross-app automation feature.
  • 09:10 · AI Teammate
    • Introduces the name of the new conceptual AI agent.

Stage Moments (4)

  • 00:00:05 · Aparna Pappu walks onto the stage to applause.
  • 00:00:40 · Audience applauds the announcement of the Gemini side panel’s general availability.
  • 06:29 · Strong audience applause and positive reaction to the automated workflow demo.
  • 09:25 · Tony Vincent is introduced and walks to a standing desk on stage to begin his demo.

Visual Demos (4)

  • 01:38 · Gmail mobile UI
    • A screen recording of a phone shows the Gmail app. A Gemini overlay card appears on top of the inbox to display a summary and a prompt box for Q&A. Contextual smart reply ‘chips’ appear above the keyboard.
  • 05:18 · Gmail desktop UI with AI Workflow
    • The Gemini side panel in the desktop Gmail interface shows a multi-step plan to organize receipts. It then presents an ‘Automate’ button to make the workflow recurring.
  • 06:41 · Google Sheets with Data Q&A
    • A fully populated spreadsheet is displayed. The Gemini side panel is used to ask a question, and it generates a bar chart visualization of the data directly in the panel.
  • 09:35 · AI Teammate configuration and Google Chat UI
    • A settings page for the ‘AI Teammate’ shows fields for its name, description, and jobs. The demo then switches to the Google Chat UI where the AI Teammate (‘Chip’) participates in conversations like a human user.

Production Signals (3)

  • 00:00:12 · Segment is a mix of live presentation and pre-recorded, narrated demos.
  • 01:50 · Close-up shots of the animated phone UI are used to highlight specific features during the demo.
  • 04:53 · The demo transitions from a mobile UI to a desktop UI, showing cross-platform capabilities.

Key Topics

Artificial Intelligence · Google Workspace · Gemini · Productivity · Automation · AI Agents · Gmail · Google Sheets · Google Drive · Google Meet · Collaboration Tools · Contextual AI · AI Teammate · Workflow Automation · Data Analysis

Takeaways

  • Google is deeply integrating its most powerful model, Gemini 1.5 Pro, into the core of Workspace to move beyond simple prompts to complex, multi-step tasks.
  • The focus is shifting from single-app features to seamless, automated ‘AI Workflows’ that connect information and actions across Gmail, Drive, Sheets, and more.
  • Gmail on mobile is getting a major upgrade with cross-inbox Q&A and highly contextual smart replies, aiming to significantly reduce time spent managing email on the go.
  • Google is prototyping the future of work with ‘AI Teammates’—customizable, persistent AI agents that act as virtual members of a team to monitor projects, synthesize information, and proactively assist.
  • The strategy is to make AI not just a tool you call upon, but an automated, proactive partner that understands the context of your work and team dynamics.
  • New features are being rolled out progressively to Workspace Labs users, indicating a strategy of gathering user feedback before wide release.
  • Productivity gains are being quantified, with Google citing a 30% improvement for customer support teams at client Sports Basement.