Independent reality-check — 2008 — 2025

Google I/O Reality Check

Every year Google walks on stage and promises the future. Some of it ships. Some of it ships smaller. Some of it ships under a different name. And some of it never ships at all.

I read every keynote, tracked every announcement, and went looking for what actually happened. 589 announcements across 17 years of I/O. Here’s the receipts.

Shipped: 248 (42%) Shipped late: 30 (5%) Scaled back: 108 (18%) Rebranded: 51 (9%) In progress: 5 (1%) Vapor: 20 (3%) Killed: 127 (22%) 56% Reality Score
589
announcements tracked
329
shipped
(on time, late, or rebranded)
20
pure vapor
never shipped, abandoned
127
shipped then killed
108
scaled back from the promise
5
still in progress / TBD

The trend

Reality Score by year % of resolved announcements that shipped substantially as promised. Higher is better. In-progress excluded.
0% 25% 50% 75% 100% 50% — coin flip 27% 41% 45% 65% 62% 57% 59% 41% 36% 49% 50% 45% 53% 66% 81% 78% 75% 2008 2009 2010 2011 2012 2013 2014 2015 2016 2017 2018 2019 2021 2022 2023 2024 2025

Year by year

Status mix by year Every tracked announcement, classified.
2008 Shipped: 4 (18%) Shipped late: 1 (5%) Scaled back: 6 (27%) Rebranded: 1 (5%) Vapor: 1 (5%) Killed: 9 (41%) 22 2009 Shipped: 9 (33%) Shipped late: 2 (7%) Scaled back: 3 (11%) Killed: 13 (48%) 27 2010 Shipped: 6 (27%) Shipped late: 2 (9%) Scaled back: 5 (23%) Rebranded: 2 (9%) Killed: 7 (32%) 22 2011 Shipped: 15 (58%) Shipped late: 2 (8%) Scaled back: 1 (4%) Vapor: 3 (12%) Killed: 5 (19%) 26 2012 Shipped: 16 (55%) Scaled back: 1 (3%) Rebranded: 2 (7%) Vapor: 2 (7%) Killed: 8 (28%) 29 2013 Shipped: 10 (33%) Scaled back: 2 (7%) Rebranded: 7 (23%) Killed: 11 (37%) 30 2014 Shipped: 12 (38%) Shipped late: 3 (9%) Scaled back: 7 (22%) Rebranded: 4 (13%) Killed: 6 (19%) 32 2015 Shipped: 8 (25%) Scaled back: 3 (9%) Rebranded: 5 (16%) Vapor: 1 (3%) Killed: 15 (47%) 32 2016 Shipped: 8 (24%) Shipped late: 2 (6%) Scaled back: 4 (12%) Rebranded: 2 (6%) Vapor: 2 (6%) Killed: 15 (45%) 33 2017 Shipped: 15 (32%) Shipped late: 2 (4%) Scaled back: 11 (23%) Rebranded: 6 (13%) Killed: 13 (28%) 47 2018 Shipped: 17 (39%) Shipped late: 1 (2%) Scaled back: 14 (32%) Rebranded: 4 (9%) Vapor: 1 (2%) Killed: 7 (16%) 44 2019 Shipped: 14 (34%) Shipped late: 4 (10%) Scaled back: 12 (29%) In progress: 1 (2%) Vapor: 1 (2%) Killed: 9 (22%) 41 2021 Shipped: 17 (46%) Shipped late: 2 (5%) Scaled back: 13 (35%) In progress: 1 (3%) Vapor: 2 (5%) Killed: 2 (5%) 37 2022 Shipped: 17 (49%) Shipped late: 4 (11%) Scaled back: 7 (20%) Rebranded: 2 (6%) Vapor: 2 (6%) Killed: 3 (9%) 35 2023 Shipped: 21 (49%) Shipped late: 2 (5%) Scaled back: 3 (7%) Rebranded: 12 (28%) Vapor: 1 (2%) Killed: 4 (9%) 43 2024 Shipped: 31 (67%) Shipped late: 2 (4%) Scaled back: 9 (20%) Rebranded: 3 (7%) Vapor: 1 (2%) 46 2025 Shipped: 28 (65%) Shipped late: 1 (2%) Scaled back: 7 (16%) Rebranded: 1 (2%) In progress: 3 (7%) Vapor: 3 (7%) 43
Shipped Shipped late Scaled back Rebranded In progress Vapor Killed

By category

By category Which corners of Google ship vs. ship vapor.
Android Android — Shipped: 62 Android — Shipped late: 9 Android — Scaled back: 17 Android — Rebranded: 2 Android — Vapor: 2 Android — Killed: 9 101 AI AI — Shipped: 28 AI — Shipped late: 1 AI — Scaled back: 15 AI — Rebranded: 9 AI — In progress: 2 AI — Vapor: 6 AI — Killed: 7 68 Developer Developer — Shipped: 31 Developer — Shipped late: 6 Developer — Scaled back: 9 Developer — Rebranded: 9 Developer — Killed: 10 65 Other Other — Shipped: 13 Other — Shipped late: 4 Other — Scaled back: 11 Other — Rebranded: 4 Other — Vapor: 1 Other — Killed: 16 49 Hardware Hardware — Shipped: 17 Hardware — Scaled back: 11 Hardware — Rebranded: 2 Hardware — In progress: 1 Hardware — Vapor: 5 Hardware — Killed: 13 49 Web Web — Shipped: 17 Web — Shipped late: 6 Web — Scaled back: 4 Web — Rebranded: 2 Web — Vapor: 2 Web — Killed: 17 48 Cloud Cloud — Shipped: 20 Cloud — Shipped late: 2 Cloud — Scaled back: 7 Cloud — Rebranded: 4 Cloud — Killed: 1 34 Search Search — Shipped: 13 Search — Shipped late: 1 Search — Scaled back: 6 Search — Rebranded: 1 Search — Vapor: 2 Search — Killed: 5 28 Assistant Assistant — Shipped: 4 Assistant — Scaled back: 6 Assistant — Killed: 13 23 Workspace Workspace — Shipped: 13 Workspace — Scaled back: 4 Workspace — Rebranded: 2 19 AR/VR AR/VR — Shipped: 1 AR/VR — Scaled back: 1 AR/VR — Rebranded: 2 AR/VR — In progress: 2 AR/VR — Vapor: 1 AR/VR — Killed: 11 18 Maps Maps — Shipped: 6 Maps — Scaled back: 6 Maps — Rebranded: 1 Maps — Killed: 2 15 Photos Photos — Shipped: 6 Photos — Shipped late: 1 Photos — Scaled back: 6 Photos — Rebranded: 1 14 Developer Platform Developer Platform — Shipped: 4 Developer Platform — Scaled back: 1 Developer Platform — Rebranded: 1 Developer Platform — Killed: 1 7 AI / Search AI / Search — Rebranded: 2 AI / Search — Killed: 2 4 Consumer apps Consumer apps — Shipped: 2 Consumer apps — Scaled back: 1 Consumer apps — Killed: 1 4 VR VR — Killed: 4 4 Social Social — Killed: 3 3 Payments Payments — Rebranded: 2 Payments — Killed: 1 3 Web Platform Web Platform — Shipped: 2 Web Platform — Rebranded: 1 3 Wearables Wearables — Shipped: 1 Wearables — Rebranded: 1 Wearables — Killed: 1 3 Mobile OS Mobile OS — Shipped: 3 3 ATAP / Hardware ATAP / Hardware — Scaled back: 1 ATAP / Hardware — Vapor: 1 ATAP / Hardware — Killed: 1 3 Developer tools Developer tools — Shipped: 1 Developer tools — Rebranded: 2 3 IoT IoT — Killed: 2 2 Communication Communication — Killed: 1 1 Media Media — Killed: 1 1 Consumer App Consumer App — Scaled back: 1 1 Education Education — Killed: 1 1 Operating System Operating System — Shipped: 1 1 Browser Browser — Shipped: 1 1 Hardware / Media Hardware / Media — Rebranded: 1 1 Mapping Mapping — Killed: 1 1 Education / Media Education / Media — Shipped: 1 1 Web / Developer Web / Developer — Killed: 1 1 VR / Education VR / Education — Killed: 1 1 Identity / Security Identity / Security — Rebranded: 1 1 VR / Content VR / Content — Killed: 1 1 Hardware / Platform Hardware / Platform — Scaled back: 1 1 Cars Cars — Shipped: 1 1 Strategy Strategy — Rebranded: 1 1
Shipped Shipped late Scaled back Rebranded In progress Vapor Killed

Hall of Shame

The most damning entries: pure vapor first, then post-launch shutdowns, then promises that were quietly shrunk after the keynote.

SignGemma sign-language model

Vapor
Promised

Open model translating American Sign Language to English text

Reality

Preview opened to LSPs, accessibility researchers, and Deaf community members via Google's AI Developer portal. Broader release was planned for Q4 2025 but never materialized — no public model card, no open weights, and no GA path 12 months on.

Announced as an 'open model' but never shipped one — still feedback-only access a year later.

Gemini Diffusion (text diffusion model)

Vapor
Promised

Experimental text-diffusion research model, 5x faster than 2.5 Pro for code; trusted testers, 'broader release in coming months'

Reality

Waitlist demo opened at I/O. Still labeled experimental / trusted-testers-only as of mid-2026, with no general API availability, no pricing, and no product surface — the 'coming months' broader release never happened.

Research preview pitched as a product line; 12 months later still no public access — calling this anything other than vapor flatters Google.

Sparkify (question → animated short video)

Vapor
Promised

Convert questions into animated 2-minute videos via Veo 3 and Gemini; waitlist at I/O; 'coming to Google products later this year'

Reality

12 months later still a waitlist-gated Google Labs experiment at sparkify.withgoogle.com with no public on-ramp. Capabilities were partly absorbed into NotebookLM Video Overviews and Flow, but the named Sparkify product never launched.

A year of waitlist with no public release and no roadmap update — meets the rubric's definition of vapor.

Illuminate (research papers to AI podcasts)

Vapor
Promised

Experimental tool turning research papers into AI-narrated audio conversations.

Reality

Available as a free Labs experiment with limited scope (primarily arXiv CS papers). Effectively cannibalised by NotebookLM's Audio Overviews. Still 'experimental' two years later with no visible roadmap or graduation from Labs.

Two years stuck in Labs with no meaningful progress — fails the 12-month public-progress bar.

Universal Translator (video dubbing with lip-sync)

Vapor
Promised

Research demo: AI that transcribes, translates, regenerates voice, and lip-syncs the speaker on video.

Reality

Explicitly limited to 'authorized partners' at announcement. Never released publicly. The capability resurfaced piecemeal in YouTube auto-dubbing (without lip-sync) in 2024.

Google literally flagged misuse risk on stage — never shipped to consumers.

AR/VR I/O 2022

AR Translation Glasses (Project Iris)

Vapor Killed 2023-06
Promised

Famous keynote-ending teaser of prototype AR glasses doing real-time speech translation captions.

Reality

Limited public field tests in the US (Aug 2022) and Canada (Oct 2022), then Project Iris was shelved in early 2023 amid layoffs. No consumer product ever shipped.

Google pivoted to building the AR software platform for partners like Samsung instead.

Search I/O 2022

Scene Exploration in Lens

Vapor
Promised

Pan camera across a scene to get overlaid info on every object — 'Ctrl+F for the world'.

Reality

Never shipped as the named 'Scene Exploration' feature. Camera-pan visual search ideas eventually surfaced via Circle to Search (2024) and Gemini Live video.

Spiritual successors exist but the demo as shown never landed.

Search I/O 2021

MUM (Multitask Unified Model)

Vapor
Promised

1000x more powerful than BERT; would understand text, images and 75 languages and power dramatic new Search experiences.

Reality

Google has explicitly stated MUM is 'not used for general ranking.' Used only narrowly for COVID-19 vaccine info, About This Result, and multisearch in Google Lens. The marquee 1000x-BERT product never materialized; the multilingual cross-modal search vision was effectively abandoned and overtaken by LLMs/Gemini and AI Overviews. The MUM brand has largely disappeared from Google communications.

A handful of MUM-adjacent launches (multisearch, About This Result) shipped, but the headline promise of MUM as a search ranking/understanding breakthrough never happened.

Hardware I/O 2021

AR translation glasses concept (in-keynote tease)

Vapor Killed 2023-06
Promised

I/O 2021 closing reel and demos suggested real-time translation/AR overlays as part of Google's near-future hardware ambitions (precursor to the Project Iris/AR-glasses pitch).

Reality

Real AR translation glasses prototype was shown at I/O 2022, but Project Iris was shut down in 2023 and Google pivoted to providing Android XR for partners (Samsung's Project Moohan, 2025). No Google-branded consumer translation AR glasses have shipped.

Closest live successor is Android XR on partner hardware — not the original first-party promise.

Live Relay

Vapor
Promised

Phone listens and speaks on behalf of deaf/hard-of-hearing users during regular phone calls; user types, phone speaks, all on-device.

Reality

Demoed at I/O 2019 as a research project. Never shipped as a standalone product. Some underlying tech surfaced years later in Pixel's Call Assist / Call Screen features, but Live Relay as announced was never released to users.

Always framed as research, but headlined as if shipping soon.

Android I/O 2018

Slices

Vapor Killed 2021-12
Promised

Interactive snippets of app UI that would appear inline inside Google Search and Assistant — e.g., a Lyft Slice showing ride prices right in Search.

Reality

The androidx.slice APIs technically shipped, but the marquee Google Search integration — the entire point of the announcement — was quietly paused around 2021 and never returned. By Android 13 the feature was effectively invisible to users; the App Actions integration was marked deprecated.

APIs exist as a developer ghost-town. The promised Search integration never reached users — textbook vapor at promised scope.

Hardware I/O 2016

Project Ara

Vapor Killed 2016-09
Promised

Modular smartphone with hot-swappable components. Google explicitly promised a developer edition shipping in Q4 2016 and a consumer device in 2017.

Reality

Project Ara was cancelled outright on September 2, 2016, less than four months after I/O. No developer kit was ever shipped to outside developers and no consumer device was ever produced.

Killed faster than almost any other I/O 2016 announcement.

Methodology

I went through every Google I/O keynote and developer keynote from 2008 to 2025 (no I/O in 2020 — cancelled for COVID) and pulled every notable announcement: features, products, models, dev-platform releases. Each one was classified into one of seven buckets:

  • Shipped — delivered substantially as promised, within ~12 months.
  • Shipped late — delivered, but materially later than the stated or implied timing.
  • Scaled back — shipped, but materially smaller than what was demoed.
  • Rebranded — shipped, but under a totally different product name (still a win for Google).
  • In progress — still actively being developed, not yet shipped at the promised scope, not abandoned.
  • Vapor — promised, never shipped at all, no longer being worked on.
  • Killed — shipped, later discontinued.

The Reality Score is the share of resolved announcements (so excluding the still-cooking ones) that count as a win: shipped on time, shipped late, or rebranded. Everything else is a miss.

Every entry has at least two sources — typically one Google announcement (to ground what was promised) and one independent report (to ground what actually happened). All data is in a JSON file if you want to verify or remix.

Where I could be wrong: judgment calls on "scaled back" vs "shipped", and the cutoff for "in progress" vs "vapor" on recent announcements. Open an issue or DM and I'll correct.