Gallery, prompt v1

A knitting chart for a coffee-bean cup cosy

One frozen prompt and every model that has run it, newest first.

The prompt, v1, frozen

Make an SVG knitting chart for a cup cosy with a coffee-bean motif, drawn so the beans come out the right shape in the finished fabric.

Every model, its first three runs.

One square a check, in this order:

  1. A real chart
  2. Stitches wider than tall
  3. Bean knits true
  4. Has a key

passed, failed, undecided. A round mark is a check I judged by eye, and a diamond one a check a model judged.

Kimi K3.1 Pro
GPT-6.1 Sol
Opus 5.5
Claude Haiku 5.5
GLM 5.3 FlashX
GPT-6 Luna
DeepSeek 4.1 Flash

What a run cost, against checks passed.

One dot a model, over its three runs above. Further right costs more. The gap from $0.01 to $0.1 is as wide as the gap from $0.1 to $1, so the cheap models are not squeezed into a corner.

0%25%50%75%100%$0.01$0.03$0.1cost per runGPT-6.1 Sol: $0.063 a run, 12 of 12 checks passedGPT-6.1 SolClaude Haiku 5.5: $0.0073 a run, 11 of 12 checks passedClaude Haiku 5.5Kimi K3.1 Pro: $0.14 a run, 11 of 12 checks passedKimi K3.1 ProOpus 5.5: $0.14 a run, 11 of 12 checks passedOpus 5.5DeepSeek 4.1 Flash: $0.07 a run, 10 of 12 checks passedDeepSeek 4.1 FlashGPT-6 Luna: $0.0099 a run, 9 of 12 checks passedGPT-6 LunaGLM 5.3 FlashX: $0.013 a run, 8 of 11 checks passedGLM 5.3 FlashX
Every dot answered this prompt with these checks, so they compare. A run that produced nothing still cost what it cost, and passed none of the checks.

How it is checked

A knit stitch is wider than it is tall, about 5 stitches to 7 rows over the same distance, so a bean drawn on square cells knits up squashed. The chart is read from the SVG: its grid, which cells are coloured, and the gauge its cells are drawn at. Each bean is then measured as it would come out in the fabric, from its stitches and rows at that gauge, and a coffee bean is 1.3 to 1.8 times as long as it is wide.

A real chartmeasuredA grid of at least 10 stitches by 10 rows, with the beans made of whole cells of that grid.
Stitches wider than tallmeasuredThe cells are drawn at least as wide as they are tall, so the chart shows the fabric the right way round.
Bean knits truemeasuredThe beans as knitted are 1.3 to 1.8 times as long as they are wide.
Has a keymeasuredText on the page says what each colour or mark means.

When this saturates: A motif that is not symmetric, such as a cup with a handle, worked flat, so the chart also has to be read in both directions.

Failures seen here: false (fails when the model gets a fact wrong, such as a part in the wrong place or at the wrong size); malformed (fails when the model's file won't open: it doesn't compile, parse or render). The same kinds across every task.

The rules behind all of thisThis task's prompt, checks and any checker, on GitHub