Failure types

completeness

a required part missing

Seen in 25 results, across 11 models and 2 tasks, from 2026-09-20 to 2026-10-02. More than one model and more than one task, so it is more than a quirk of either.

Exploded French press, by Pareto 26.10 Preview
Pareto 26.10 PreviewExploded French press · 2026-10-02 · 3 of 5 checks
Exploded French press, by Pareto
ParetoExploded French press · 2026-10-01 · 3 of 5 checksAlso part-order
Exploded French press, by Claude Sonnet 5.5
Claude Sonnet 5.5Exploded French press · 2026-09-29 · 3 of 5 checks
A coffee shrub hedge-pruned flat on one side, by DeepSeek 4.1 Flash
DeepSeek 4.1 FlashA coffee shrub hedge-pruned flat on one side · 2026-09-29 · 2 of 3 checks
A coffee shrub hedge-pruned flat on one side, by Qwen3.8 Flash
Qwen3.8 FlashA coffee shrub hedge-pruned flat on one side · 2026-09-29 · 2 of 3 checks
A coffee shrub hedge-pruned flat on one side, by GPT-6 Luna
GPT-6 LunaA coffee shrub hedge-pruned flat on one side · 2026-09-29 · 2 of 3 checks
A coffee shrub hedge-pruned flat on one side, by GPT-6 Luna
GPT-6 LunaA coffee shrub hedge-pruned flat on one side · 2026-09-29 · 2 of 3 checks
A coffee shrub hedge-pruned flat on one side, by GPT-6 Luna
GPT-6 LunaA coffee shrub hedge-pruned flat on one side · 2026-09-29 · 2 of 3 checks
A coffee shrub hedge-pruned flat on one side, by Gemini 3.8 Flash
Gemini 3.8 FlashA coffee shrub hedge-pruned flat on one side · 2026-09-29 · 0 of 3 checksAlso topology
A coffee shrub hedge-pruned flat on one side, by Gemini 3.8 Flash
Gemini 3.8 FlashA coffee shrub hedge-pruned flat on one side · 2026-09-29 · 0 of 3 checksAlso topology
A coffee shrub hedge-pruned flat on one side, by DeepSeek 4.1 Flash
DeepSeek 4.1 FlashA coffee shrub hedge-pruned flat on one side · 2026-09-29 · 0 of 3 checksAlso topology
A coffee shrub hedge-pruned flat on one side, by Claude Sonnet 5.5
Claude Sonnet 5.5A coffee shrub hedge-pruned flat on one side · 2026-09-29 · 2 of 3 checks
A coffee shrub hedge-pruned flat on one side, by Claude Sonnet 5.5
Claude Sonnet 5.5A coffee shrub hedge-pruned flat on one side · 2026-09-29 · 1 of 3 checks
Exploded French press, by Perceptron Mk1.5
Perceptron Mk1.5Exploded French press · 2026-09-27 · 0 of 5 checksAlso part-order, physical-plausibilityTerrible
Exploded French press, by Perceptron Mk1.5
Perceptron Mk1.5Exploded French press · 2026-09-27 · 0 of 5 checksAlso physical-plausibility, labellingNot great and off axis
Exploded French press, by Perceptron Mk1.5
Perceptron Mk1.5Exploded French press · 2026-09-27 · 0 of 5 checksAlso physical-plausibility, labelling
Exploded French press, by Command A+
Command A+Exploded French press · 2026-09-27 · 0 of 5 checksAlso physical-plausibility, labelling
Exploded French press, by Command A+
Command A+Exploded French press · 2026-09-27 · 0 of 5 checksAlso physical-plausibility, labelling
Exploded French press, by Command A+
Command A+Exploded French press · 2026-09-27 · 0 of 5 checksAlso physical-plausibility, labellingTerrible
Exploded French press, by GLM 5.3 FlashX
GLM 5.3 FlashXExploded French press · 2026-09-22 · 2 of 5 checksAlso part-order, physical-plausibilityA plate missing, the cross-plate above the mesh, the lid below the filter, and plates wider than the carafe.
Exploded French press, by Qwen3.8 27B
Qwen3.8 27BExploded French press · 2026-09-22 · 3 of 5 checksAlso part-orderNo spiral plate and no separate knob, and the cross retainer sits above the mesh.
Exploded French press, by Qwen3.8 27B
Qwen3.8 27BExploded French press · 2026-09-22 · 2 of 5 checksAlso part-order, physical-plausibilityA coil spring and a mesh, no cross-plate, the lid under the filter, and a mesh wider than the carafe.
Exploded French press, by Qwen3.8 27B
Qwen3.8 27BExploded French press · 2026-09-22 · 3 of 4 checks (1 undecided)Mesh and a flange disc, no spiral plate or cross-plate. Cut off after round 2.
Exploded French press, by GLM 5.3 FlashX
GLM 5.3 FlashXExploded French press · 2026-09-20 · 3 of 5 checksAlso part-orderLeft the cross-plate out altogether, and still put the spiral plate under the mesh.
Exploded French press, by Qwen3.8 27B
Qwen3.8 27BExploded French press · 2026-09-20 · 3 of 4 checks (1 undecided)Also physical-plausibilityMesh drawn, spiral plate and cross-plate missing, and a frame smaller than the carafe it holds.

The other types: labelling · physical-plausibility · part-order · topology · geographic-grounding

All of them, with counts · How a check is decided