Blind test · 15 cartoons, two AIs
Can you tell which AI made it?
We gave the same 15 briefs to two AIs. One is Claude Sonnet (Anthropic). The other is GLM 5.3 Flash (Z.ai, open model), which cost about $0.016 a video against $0.107. Each wrote its own script; the same renderer drew both. Pick the one you think the cheaper AI made.
Tap a video for sound. The answer appears after you pick.
Pair 1 of 15
AdThe brief: “Make an ad for my cold brew coffee, Night Owl Cold Brew. It comes in a can, it's strong but smooth, and the tagline is "Stay up. Stay smooth."”
Which one did the cheaper AI make?
How we ran it
A small, honest test.
Not a lab benchmark: one informal run of 20 jobs, judged by one person. Here is all of it.
- Same briefs, same tool. Both AIs got the same briefs and the same Agent Blobs tool. Each wrote its own script and chose its own cast; the same renderer drew and voiced both.
- The two AIs. Claude Sonnet (Anthropic), version Claude Sonnet 5.5, run through Claude Code. GLM 5.3 Flash (Z.ai, open model), through OpenRouter.
- 20 jobs, 15 pairs here. The cheap model finished 19 of 20 and Claude 20 of 20. On the tea ad the cheap model ran out of steps before it made a video, so that pair is left out. Four of the 20 jobs were game levels, not videos.
- One judge. Our founder watched every pair without knowing which AI made which side; the sides were shuffled before he watched. His verdict is on your score screen.
- The costs are the writing. GLM 5.3 Flash’s is its bill for each video. Claude ran on a Claude subscription, which has no per-video bill, so we priced its recorded tokens at Anthropic’s list prices for Claude Sonnet 5.5 ($2 per million input tokens, $10 per million output, cache reads and cache writes at their own rates). Its cache writes were the one-hour kind; with five-minute writes it comes to $0.087 a video, still about 5.4× more. Rendering runs on the same computer for both and isn’t counted.
- Nothing here is an endorsement. We name the models so you know what you watched. Neither maker had any part in this test.