Four Gemini Models Built Fan Sites. Some of the Facts Were Wrong.

Jon's agents sorted Google's lineup and checked each site; Hydrogen, the cheapest Gemini 4, made no factual errors.

Google shipped Gemini 4 Neon on November 18, the fourth Gemini 4 model in five weeks. The family is now Hydrogen, Neon, Argon and Carbon, with Gemini 3.8 Flash still being served beside them. The element names are a theme, not a ranking: hydrogen is element 1 and argon is 18, and neither number tells you which model is stronger or cheaper. Jon builds with Claude and Codex every day, and a new model only earns a place in his system if it does a job better or cheaper. So his agents sorted the lineup, then gave four of the models the same kind of job in one message: build a whole fan website on a topic it was handed, research it with web search first, give it several sections, at least two interactive things and plenty of outside links, and finish without asking a single question. Nobody fixed anything after. The builds ran on Jon's Antigravity subscription through T3 Code, at high thinking.

The hosts are AI characters.

Listen to this story
2:52

All four sites loaded and almost every button worked. The trouble was in the details each model printed with full confidence.

The lineup, by job instead of element

Google's own model chooser says to default to Hydrogen. Prices below are Google's standard paid API rates from its pricing page, in dollars per million tokens, input then output. Hydrogen and 3.8 Flash also have a free tier. A token is a word-piece, roughly three quarters of a word.

ModelWhat it is forPrice
HydrogenThe everyday model for coding and agents. Google's default.$1.50 / $7.50
NeonNew. Harder coding, research and science, faster than Carbon.$3 / $15
ArgonCarbon's kind of work with fewer tokens per turn. Google's chooser leaves it out of its picks.$2 / $10, then $4 / $20 from Dec 1
CarbonThe strongest, for the longest and hardest jobs.$2 / $10, then $4 / $20 from Dec 1
3.8 FlashLast generation's workhorse. Still the only one with a cache you control.$0.75 / $3.75, doubling Jan 1

The odd row is Neon. Until November 30 it costs more per token than Carbon, Google's top model. Google says Neon spends fewer tokens to finish a task: at its default setting, the Neon announcement reports a 32% lower cost per task than Carbon on one benchmark index. That is one benchmark, not a promise about anyone else's workload.

What each model built

Hydrogen made the most trustworthy site. Its Formula 1 fan site, Lights Out // 2026, had a race countdown, a reaction-time starting-lights game that catches a jump start, and searchable standings. Of fifteen facts checked, fourteen were right and none were wrong. The driver standings matched the official table on the night it was built, the eve of practice in Las Vegas. It is also the cheapest Gemini 4 model.

Argon built a pinball machine you can play. Silverball Sanctuary has a working table: hold Space to launch, arrows to flip. In testing it scored 27,000, saved a drained ball, and the ball never escaped the cabinet. Then its Hall of Fame stamps exact "all-time rank" badges that are out of date, like Medieval Madness at number 2 on two ranking sites where it isn't, and three of its "watch this tutorial" links lead to a video or playlist YouTube says isn't there.

Neon built a magazine. Leonida Dispatch, its Grand Theft Auto 6 guide for launch eve, has a countdown with time zones, a checklist that survives a reload, a map and a quiz. The release date and the prices held up. But it printed the map's size, 175 square kilometers, as a launch fact. That number matches a fan site's measurement posted the same day; Rockstar hasn't published one. On a phone, its menu button hangs mostly off the right edge of the screen.

3.8 Flash built a theme park. Scorch & Savor, a hot sauce site, has a Scoville elevator, a sauce mixer and an emergency milk button. It looks finished on a phone. But it prints the world-record pepper as 2,692,990 heat units everywhere, when the official figure is 2,693,000. Its four featured videos open YouTube's "video unavailable" page, and its pepper quiz loads with no answers to pick.

The pattern across all four: the big pieces worked, and the worst misses were specific numbers and links stated as fact. Those are the details a reader is most likely to trust and least likely to check.

Same game prompt, and a bagel three times

Each model also got one identical prompt: a one-file browser game where a city pigeon flaps across a scrolling city delivering letters, with sound, lives, a best score and "one surprise of your own." Hydrogen, Argon and 3.8 Flash each finished in two to four minutes. All three games start, score and remember a best score. And all three, on their own, picked a bagel as the surprise: a bagel flock that gives an extra life, a golden everything bagel in "New Bagel City", and giant bagels to snag.

Neon never returned a game. It was tried five times over about six hours, four on launch night and once the next morning, four at high thinking and one at medium. Each time it went silent for fifteen minutes and was stopped, with no file written. On the last try it opened the prompt nine seconds in, then said nothing. T3 ends a turn after fifteen silent minutes, so a hang and a model quietly writing one huge file look the same from outside. Either way, the other three finished the same prompt in two to four minutes. The same model had built the GTA site in about twenty minutes, early on launch night. Google's Antigravity status page, which covers its business customers, showed no incident. Google's own Neon notes tell developers to set client timeouts of at least 15 minutes for hard prompts, which is worth doing before trusting it with a pipeline.

Why Carbon sat this one out

Carbon was not run. Inside Antigravity, Google offers it on the Ultra and enterprise plans and to scientists accepted into a research program, per its Carbon announcement. Jon's seat is none of those, and the other routes to it cost extra.

Before switching anything to Gemini 4

  • Start with Hydrogen. It was the cleanest builder in this test and it is the cheapest Gemini 4 model. Reach for Neon only when a job is too hard for Hydrogen.
  • Measure cost per finished task, not price per token. Neon costs more per token than Carbon until November 30 and still may cost less per task. Run both on real work at a set thinking level, then run it again after December 1, when Carbon and Argon double.
  • Keep 3.8 Flash if a pipeline depends on caching. Gemini 4 dropped the cache you control. One developer on Google's forum reported their cost per call going from 23 cents to 88 cents after the switch, and a reply in that thread suggests staying on 3.8 Flash for that.
  • Check every number, rank and link a model prints. In this test nearly every toy worked. The made-up details were the ones that looked most official.

Sources

Comments

No comments yet.

Sign in to comment. You'll come back to this story.