I/O 2024: Search and Infrastructure

Year: 2024 · ▶ Watch on YouTube

Sundar Pichai (CEO) · Liz Reid (Head of Google Search) · Rose Yao (VP of Product, Search)

Switch language → zh

Segments (6)

  • 00:00:07 · AI Infrastructure and Custom Silicon — Sundar Pichai
    • Sundar Pichai details Google’s massive investments in AI infrastructure, including the announcement of the 6th generation Trillium TPU, Axion CPUs, and NVIDIA Blackwell GPUs.
  • 00:03:31 · Introducing the Gemini Era of Search — Sundar Pichai
    • Pichai frames the next evolution of Google Search as a generative AI product that does the work for the user, powered by the Gemini model.
  • 00:05:04 · The New Google Search Experience — Liz Reid
    • Liz Reid introduces AI Overviews, multi-step reasoning, and planning capabilities that will transform Search into an intelligent agent.
  • 00:12:27 · Demo: Ask with Video — Liz Reid
    • Reid introduces the ability to ask questions using video in Search and brings Rose Yao on stage for a live demonstration.
  • 00:14:51 · The Future of Search — Liz Reid
    • Reid summarizes the new Search capabilities, framing them as a reimagining of the product for the Gemini era, before introducing a summary video.
  • 00:15:37 · The New Era of Search Sizzle Reel
    • A fast-paced video showcases various use cases for the new generative AI features in Google Search, from troubleshooting to planning.

Products Announced (8)

  • 00:00:56 · Trillium TPU (6th generation)
    • 4.7x improvement in compute performance per chip over the previous generation · Most efficient and performant TPU to date
    • Available to Cloud customers late 2024
  • 00:01:28 · Axion Processor (Previously Announced)
    • Google’s first custom Arm-based CPU · Industry-leading performance and energy efficiency
    • Available now
  • 00:01:47 · NVIDIA Blackwell GPUs on Google Cloud (New Offering)
    • Cutting-edge GPUs from NVIDIA
    • Available early 2025
  • 00:06:18 · AI Overviews (General Availability)
    • Generative AI summaries at the top of search results · Synthesizes information from multiple sources · Provides answers to complex questions directly
    • Rolling out to everyone in the US starting today; coming to over 1B people by end of year.
  • 00:07:15 · Multi-step reasoning in Search (Upcoming Feature)
    • Breaks down complex, multi-part questions into logical steps · Performs research on behalf of the user · Generates a comprehensive AI Overview for nuanced queries
    • Coming soon to Search Labs
  • 00:09:17 · Planning in Search (Upcoming Feature)
    • Generates plans for meals, trips, workouts, etc. · Allows for customization and replacement of items · Can export results to other apps or create shopping lists
    • Coming later this year in Search Labs
  • 00:10:54 · AI-organized search results page (Upcoming Feature)
    • Dynamically categorizes results into helpful clusters for brainstorming · Uncovers interesting angles and sub-topics for inspirational queries · Integrates diverse content types like articles, videos, and images
    • Starting with dining and recipes, coming soon to Search Labs
  • 00:12:27 · Ask with video (Upcoming Feature)
    • Allows users to record a video and ask a question about it · Uses multimodal understanding to analyze the video content · Provides troubleshooting steps or relevant information based on the visual input
    • Coming soon to Search Labs

Benchmarks Shown (3)

  • 00:01:07 · Trillium TPU Performance: 4.7x
    • Over previous generation TPU (TPU v5e)
  • 00:02:51 · Liquid Cooling Fleet Capacity: ~1GW
    • 70x the capacity of any other fleet
  • 00:03:13 · Network Fiber Reach: 2M+
    • 10x the reach of the next leading cloud provider

Commitments / Timelines (5)

  • 00:01:17 (late 2024) — Trillium TPUs will be available to Cloud customers.
  • 00:01:49 (early 2025) — NVIDIA’s Blackwell GPUs will be available on Google Cloud.
  • 00:06:41 (today) — AI Overviews will begin rolling out to everyone in the US.
  • 00:06:48 (by the end of the year) — AI Overviews will come to over a billion people.
  • 00:15:25 (in the coming weeks) — New Search features (Planning, Multi-step reasoning, Ask with video, AI-organized pages) will roll out.

Demos (1)

  • 00:12:41 ✓ · Ask with video: Troubleshooting a Record Player — Rose Yao
    • Rose Yao used her phone to record a video of a record player’s tonearm failing to stay in place, while verbally asking ‘Why will this not stay in place?’. Google Search processed the video and voice query, returning an AI Overview that identified the tonearm, diagnosed it as potentially unbalanced, and provided step-by-step instructions to fix it.

Notable Quotes (6)

  • 00:00:28 — Sundar Pichai:

    Google was built for this.

  • 00:04:43 — Sundar Pichai:

    Google Search is generative AI at the scale of human curiosity.

  • 00:05:25 — Liz Reid:

    Just ask. And Google will do the Googling for you.

  • 00:06:13 — Liz Reid:

    This is Search in the Gemini era.

  • 00:14:40 — Rose Yao:

    The result was music to my ears.

  • 00:15:12 — Liz Reid:

    Google will do the searching, the researching, the planning, the brainstorming, and so much more.

Visual Signals (Beyond the Transcript)

On-Screen Text Moments (10)

  • 00:00:59 · Trillium / 6th generation TPUs
    • Official branding for Google’s next-generation custom AI accelerator.
  • 00:01:08 · Delivers a 4.7x improvement in compute performance
    • Quantifies the performance leap of the new Trillium TPU.
  • 00:01:31 · Axion Processor / Custom Arm-based CPU
    • Highlights Google’s expansion of custom silicon beyond TPUs into general-purpose CPUs.
  • 00:01:49 · NVIDIA Blackwell / Available early 2025
    • Announces the availability of NVIDIA’s latest GPU architecture on Google Cloud, signaling a continued partnership.
  • 00:02:39 · Liquid cooling
    • Emphasizes a key, long-term infrastructure advantage for running powerful AI hardware efficiently.
  • 00:04:44 · Google Search / Generative AI at the scale of human curiosity
    • Presents the new mission statement and framing for Google Search in the AI era.
  • 00:05:26 · Google will do the Googling for you
    • A catchy phrase summarizing the shift from user-led searching to AI-led answering.
  • 00:06:19 · AI Overviews
    • Official branding for the new generative AI summary feature in Search.
  • 00:07:15 · Multi-step reasoning
    • Names the advanced AI capability that allows Search to handle complex, multi-part queries.
  • 00:12:28 · Ask with video
    • Brands the new multi-modal search feature that accepts video as input.

Stage Moments (5)

  • 00:00:00 · Sundar Pichai walks onto the large outdoor amphitheater stage to applause.
  • 00:04:50 · Sundar Pichai introduces Liz Reid, who walks onto the stage.
  • 00:12:32 · Liz Reid introduces Rose Yao, who enters from stage left pushing a small white cart with a record player on it for a live demo.
  • 00:13:50 · The audience applauds the successful live demo by Rose Yao.
  • 00:14:43 · Rose Yao exits the stage, and Liz Reid resumes the presentation.

Visual Demos (4)

  • 00:07:33 · Multi-step reasoning for a complex query
    • A phone UI shows the query ‘find the best yoga or pilates studios in boston and show details on their intro offers and walking time from beacon hill’. The result is a rich AI Overview with a map, studio cards showing ratings, intro offers, and walk times.
  • 00:09:41 · Planning in Search for meal creation
    • A phone UI shows a query to ‘create a 3-day meal plan for a group that is easy to prepare’. The result is a day-by-day plan with recipe cards for breakfast, lunch, and dinner, with options to ‘Replace’ dishes or ‘Export’ the plan.
  • 00:11:06 · AI-organized search results page for brainstorming
    • A phone UI for the query ‘anniversary celebration dinner places dallas’ shows results dynamically grouped into categories like ‘Anniversary-worthy restaurants’, ‘Romantic steakhouses’, and ‘Rooftop patios for dates’.
  • 00:12:41 · Live demo of ‘Ask with video’
    • Rose Yao physically demonstrates a record player’s tonearm drifting. She records this with her phone’s camera via Google Lens and asks a question. A split screen shows her on stage and the phone UI processing the video, then displaying an AI Overview with troubleshooting steps.

Production Signals (5)

  • 00:00:07 · Pre-recorded segment: Sundar Pichai is shown in a studio setting, not on the live I/O stage.
  • 00:04:50 · Transition from pre-recorded segment back to the live stage.
  • 00:05:02 · Pre-recorded segment: Liz Reid is shown in a studio setting.
  • 00:12:32 · Transition from pre-recorded segment to a live on-stage demo.
  • 00:15:37 · A highly-produced sizzle reel with music and fast cuts begins, showcasing various search examples.

Key Topics

Generative AI · Google Search · AI Infrastructure · Custom Silicon · TPU · Trillium · AI Overviews · Multi-modal Search · AI Agents · Multi-step Reasoning · Search as a Planner · Liquid Cooling · NVIDIA Blackwell · Axion CPU

Takeaways

  • Google is fundamentally reimagining Search, moving it from a list of links to a generative AI-powered ‘answer engine’ that does the complex work for the user.
  • The ‘Gemini Era’ of Search is defined by new agent-like capabilities: multi-step reasoning for complex queries, planning for tasks like meals and trips, and brainstorming via AI-organized results.
  • Multi-modality is becoming core to Search, with the introduction of ‘Ask with video’ allowing users to troubleshoot real-world problems visually.
  • Google is leveraging its deep, vertically-integrated infrastructure stack—from custom Trillium TPUs and Axion CPUs to massive-scale networking and liquid cooling—as its primary advantage in the AI race.
  • Key generative AI features, previously in labs, are now rolling out to the main Google Search product, with AI Overviews set to reach over a billion users by the end of the year.
  • Google’s strategy includes both building its own custom silicon (Trillium, Axion) and partnering with industry leaders (NVIDIA Blackwell) to meet the exponential growth in AI compute demand.