Gallery, prompt v1

Repair: a Venn diagram with a drink on a circle's edge

One frozen prompt and every model that has run it, newest first.

The prompt, v1, frozen

In this Venn diagram of three overlapping circles, the word "milkshake" sits on the outline of a circle. Move it clear of every line, still inside the region it belongs to. Change nothing else: the circles, the set names, the other seven drinks and the page stay as they are, and the file still has to compile with pdflatex as it does now.

Every model, its first three runs.

One square a check, in this order:

  1. Repaired
  2. Broke nothing else

passed, failed, undecided. A round mark is a check I judged by eye, and a diamond one a check a model judged.

DeepSeek 4.1 Flash
Kimi K3
GLM 5.3 FlashX

What a run cost, against checks passed.

One dot a model, over its three runs above. Further right costs more. The gap from $0.01 to $0.1 is as wide as the gap from $0.1 to $1, so the cheap models are not squeezed into a corner.

0%25%50%75%100%$0.03$0.1cost per runDeepSeek 4.1 Flash: $0.077 a run, 6 of 6 checks passedDeepSeek 4.1 FlashGLM 5.3 FlashX: $0.02 a run, 5 of 6 checks passedGLM 5.3 FlashXKimi K3: $0.19 a run, 5 of 6 checks passedKimi K3
Every dot answered this prompt with these checks, so they compare. A run that produced nothing still cost what it cost, and passed none of the checks.

How it is checked

Kimi K3 drew this Venn on 2026-10-19 and put `milkshake` on the outline of a circle. The word belongs in the region that names milk, and the fix is to move that one label until every letter sits clear of every drawn line without leaving its region. The other seven drinks, the seven regions and the set names were right on the file it was handed.

RepairedmeasuredThe `labels_clear_of_edges` check of the Venn grader, run on the file the model was handed and on the file it gave back, each letter tested against the drawn outline. Fixed means false became true.
Broke nothing elsemeasuredEverything that passed on the input still passes: the file compiles with pdflatex, the seven regions are there, the set names are right and the drinks are found in their regions.

When this saturates: Put two labels on edges in different regions, and name only one.

Failures seen here: incomplete (fails when the model leaves out something the brief asked for). The same kinds across every task.

The rules behind all of thisThis task's prompt, checks and any checker, on GitHub