Qwen3.8 Flash
7 runs across 3 tasks, costing $0.29, and 2 posts. Each table shows the runs under the newest prompt this model was given.
| check · how it is decided | run 1clock stop | run 3clock stop |
|---|---|---|
| All five objectsby eye · Pass if all five can be pointed at in the render as separate objects. One missing, or hidden behind another, fails it. | ✓ pass | ✓ pass |
| Primitives onlymeasured · Every mesh comes from a primitive_*_add call, as the prompt requires. | ✓ pass | ✓ pass |
| Spoon reads as a spoonby eye · Pass if the spoon is one connected piece with a bowl at one end, wider than the handle, and the handle running from it in a line. Loose parts, or no handle, fail it. | ✓ pass | · n/d |
| Croissant reads as a croissantby eye · Pass if it is a crescent that is thickest in the middle and tapers to both tips, with segments or scoring across it. A smooth curved tube fails it, and so does a segmented one with no taper. | ✓ pass | ✓ pass |
| Consistent scalemeasured · Object dimensions in the script compared against each other and against life. | ✓ pass | ✓ pass |
A run marked as stopped was cut off before it finished, and is scored on its last rendered frame. Ground truth: The render, and the script that made it: the objects a person would name unprompted, at sizes a person would accept. A 5 cm spoon and an 11 cm croissant are checkable in the source. Every model on this task.
| check · how it is decided | run 1 | run 2 | run 3clock stop |
|---|---|---|---|
| Compilesmeasured · pdflatex builds the file offline. | ✓ pass | ✓ pass | ✓ pass |
| Seven regions, three namesmeasured · Three circles found in the PDF with every overlap present, and each set name placed by its circle. | ✓ pass | ✓ pass | ✓ pass |
| Every drink in its regionmeasured · Each of the eight words found in the PDF, and the centre of each one inside the region it belongs to. | ✓ pass | ✓ pass | ✓ pass |
| No label on an edgemeasured · No letter touches a circle's outline, with the line's width counted. | ✓ pass | ✓ pass | ✓ pass |
A run marked as stopped was cut off before it finished, and is scored on its last rendered frame. Ground truth: Short black is espresso only, flat white espresso and milk, iced long black espresso and cold, iced latte all three, babyccino milk only, milkshake milk and cold, cold brew cold only, and pour-over outside every circle. The circles and words are read back out of the compiled PDF, each word has to be centred in its own region, and no letter may touch a circle's outline, with the line's width counted. Every model on this task.
| check · how it is decided | run 2clock stop |
|---|---|
| Reads as a shrubby eye · Pass if it reads as one plant with branches coming off stems, without being told what it is. A tangle, a lattice or loops fail it. | ✓ pass |
| Flat side from the rulesby eye · Pass if one side ends on a straight line that the rules themselves put there. A box drawn around the plant to cut it fails it. | ✗ fail |
| Sensible sizeby eye · Pass if the branches can still be followed by eye. So many segments that they merge into a mass fails it. | ✓ pass |
A run marked as stopped was cut off before it finished, and is scored on its last rendered frame. Ground truth: The JSON expanded and drawn with turtle graphics offline, and the drawing judged by eye. There is no single right L-system, so nothing here is measured. Every model on this task.