Data
Every run on the bench, in one table.
| 2026-11-09 | Pump noise | Gemini 4 Argon | 2026-10-13 | 1 | v1 · c1 · h1 | medium | 2/5 | yes | $0.724 | 61,676 | 1403 | |
| 2026-11-09 | Pump noise | Gemini 4 Argon | 2026-10-13 | 2 | v1 · c1 · h1 | medium | 3/5 | yes | $0.639 | 58,816 | 1403 | |
| 2026-11-09 | Pump noise | Gemini 4 Argon | 2026-10-13 | 3 | v1 · c1 · h1 | medium | 2/5 | yes | $0.662 | 52,459 | 1403 | |
| 2026-11-09 | Pump noise | GPT-6.1 Sol | OpenAI | 2026-09-29 | 1 | v1 · c1 · h1 | medium | 2/5 | $0.063 | 2,799 | 151 | |
| 2026-11-09 | Pump noise | GPT-6.1 Sol | OpenAI | 2026-09-29 | 2 | v1 · c1 · h1 | medium | 2/5 | $0.048 | 2,519 | 114 | |
| 2026-11-09 | Pump noise | GPT-6.1 Terra | openai | 1 | v1 · c1 · h1 | medium | 4/5 | yes | $0.082 | 7,223 | 172 | |
| 2026-11-09 | Pump noise | GPT-6.1 Terra | openai | 2 | v1 · c1 · h1 | medium | 2/5 | yes | $0.071 | 6,005 | 153 | |
| 2026-11-09 | Pump noise | GPT-6.1 Terra | openai | 3 | v1 · c1 · h1 | medium | 2/5 | yes | $0.050 | 5,216 | 113 | |
| 2026-11-09 | Pump noise | Kimi K3.1 Pro | moonshotai | 1 | v1 · c1 · h1 | medium | 1/5 | yes | $0.216 | 9,151 | 195 | |
| 2026-11-09 | Pump noise | Kimi K3.1 Pro | moonshotai | 2 | v1 · c1 · h1 | medium | 1/5 | yes | $0.046 | 2,332 | 57 | |
| 2026-11-09 | Pump noise | Kimi K3.1 Pro | moonshotai | 3 | v1 · c1 · h1 | medium | 1/5 | yes | $0.101 | 5,471 | 99 | |
| 2026-11-09 | Pump noise | Opus 5.5 | Anthropic | 2026-09-22 | 1 | v1 · c1 · h1 | medium | 3/5 | $0.078 | 14,553 | 423 | |
| 2026-11-09 | Pump noise | Opus 5.5 | Anthropic | 2026-09-22 | 2 | v1 · c1 · h1 | medium | 3/5 | $0.039 | 8,544 | 174 | |
| 2026-11-08 | Serve the tray | Claude Haiku 5.5 | Anthropic | 2026-10-07 | 1 | v2 · c1 · h1 | medium | 1/1 | $0.017 | 5,954 | 52 | |
| 2026-11-08 | Serve the tray | Claude Haiku 5.5 | Anthropic | 2026-10-07 | 2 | v2 · c1 · h1 | medium | 1/1 | $0.019 | 6,771 | 48 | |
| 2026-11-08 | Serve the tray | Claude Haiku 5.5 | Anthropic | 2026-10-07 | 3 | v2 · c1 · h1 | medium | 1/1 | $0.018 | 6,137 | 32 | |
| 2026-11-08 | Serve the tray | Claude Sonnet 5.5 | Anthropic | 2026-09-28 | 1 | v2 · c1 · h1 | medium | 1/1 | $0.008 | 2,480 | 25 | |
| 2026-11-08 | Serve the tray | Claude Sonnet 5.5 | Anthropic | 2026-09-28 | 2 | v2 · c1 · h1 | medium | 1/1 | $0.018 | 5,096 | 49 | |
| 2026-11-08 | Serve the tray | Claude Sonnet 5.5 | Anthropic | 2026-09-28 | 3 | v2 · c1 · h1 | medium | 1/1 | $0.025 | 5,638 | 73 | |
| 2026-11-08 | Serve the tray | DeepSeek 4.1 Flash | DeepSeek | 2026-09-10 | 1 | v2 · c1 · h1 | medium | 1/1 | $0.081 | 18,941 | 71 | |
| 2026-11-08 | Serve the tray | DeepSeek 4.1 Flash | DeepSeek | 2026-09-10 | 2 | v2 · c1 · h1 | medium | 1/1 | $0.025 | 6,645 | 27 | |
| 2026-11-08 | Serve the tray | DeepSeek 4.1 Flash | DeepSeek | 2026-09-10 | 3 | v2 · c1 · h1 | medium | 1/1 | $0.041 | 9,034 | 31 | |
| 2026-11-08 | Serve the tray | GLM 5.3 FlashX | Z.ai | 2026-09-18 | 1 | v2 · c1 · h1 | medium | 1/1 | $0.020 | 4,174 | 54 | |
| 2026-11-08 | Serve the tray | GLM 5.3 FlashX | Z.ai | 2026-09-18 | 2 | v2 · c1 · h1 | medium | 1/1 | $0.034 | 5,121 | 88 | |
| 2026-11-08 | Serve the tray | GLM 5.3 FlashX | Z.ai | 2026-09-18 | 3 | v2 · c1 · h1 | medium | 1/1 | $0.019 | 4,126 | 44 | |
| 2026-11-08 | Serve the tray | GPT-6 Luna | OpenAI | 2026-09-22 | 2 | v2 · c1 · h1 | medium | 1/1 | $0.023 | 7,604 | 66 | |
| 2026-11-08 | Serve the tray | GPT-6 Luna | OpenAI | 2026-09-22 | 3 | v2 · c1 · h1 | medium | 1/1 | $0.034 | 8,163 | 93 | |
| 2026-11-08 | Serve the tray | GPT-6.1 Sol | OpenAI | 2026-09-29 | 2 | v2 · c1 · h1 | medium | 1/1 | $0.014 | 3,860 | 78 | |
| 2026-11-08 | Serve the tray | GPT-6.1 Sol | OpenAI | 2026-09-29 | 3 | v2 · c1 · h1 | medium | 1/1 | $0.018 | 4,449 | 80 | |
| 2026-11-08 | Serve the tray | Kimi K3.1 Pro | moonshotai | 2 | v2 · c1 · h1 | medium | 1/1 | $0.095 | 6,222 | 46 | ||
| 2026-11-08 | Serve the tray | Kimi K3.1 Pro | moonshotai | 3 | v2 · c1 · h1 | medium | 1/1 | $0.118 | 7,756 | 58 | ||
| 2026-11-08 | Serve the tray | Opus 5.5 | Anthropic | 2026-09-22 | 1 | v2 · c1 · h1 | medium | 1/1 | $0.010 | 3,232 | 34 | |
| 2026-11-08 | Serve the tray | Opus 5.5 | Anthropic | 2026-09-22 | 2 | v2 · c1 · h1 | medium | 1/1 | $0.009 | 2,675 | 31 | |
| 2026-11-08 | Serve the tray | Opus 5.5 | Anthropic | 2026-09-22 | 3 | v2 · c1 · h1 | medium | 1/1 | $0.014 | 3,686 | 45 | |
| 2026-11-08 | Two tables, black coffee | Claude Haiku 5.5 | Anthropic | 2026-10-07 | 1 | v2 · c1 · h1 | medium | 1/1 | $0.018 | 6,089 | 33 | |
| 2026-11-08 | Two tables, black coffee | Claude Haiku 5.5 | Anthropic | 2026-10-07 | 2 | v2 · c1 · h1 | medium | 1/1 | $0.016 | 5,779 | 50 | |
| 2026-11-08 | Two tables, black coffee | Claude Haiku 5.5 | Anthropic | 2026-10-07 | 3 | v2 · c1 · h1 | medium | 1/1 | $0.015 | 4,877 | 26 | |
| 2026-11-08 | Two tables, black coffee | Claude Sonnet 5.5 | Anthropic | 2026-09-28 | 1 | v2 · c1 · h1 | medium | 1/1 | $0.008 | 2,408 | 25 | |
| 2026-11-08 | Two tables, black coffee | Claude Sonnet 5.5 | Anthropic | 2026-09-28 | 2 | v2 · c1 · h1 | medium | 1/1 | $0.024 | 4,989 | 57 | |
| 2026-11-08 | Two tables, black coffee | Claude Sonnet 5.5 | Anthropic | 2026-09-28 | 3 | v2 · c1 · h1 | medium | 1/1 | $0.009 | 2,532 | 26 | |
| 2026-11-08 | Two tables, black coffee | DeepSeek 4.1 Flash | DeepSeek | 2026-09-10 | 1 | v2 · c1 · h1 | medium | 1/1 | $0.077 | 17,100 | 89 | |
| 2026-11-08 | Two tables, black coffee | DeepSeek 4.1 Flash | DeepSeek | 2026-09-10 | 2 | v2 · c1 · h1 | medium | 1/1 | $0.045 | 11,071 | 35 | |
| 2026-11-08 | Two tables, black coffee | DeepSeek 4.1 Flash | DeepSeek | 2026-09-10 | 3 | v2 · c1 · h1 | medium | 1/1 | $0.037 | 8,753 | 35 | |
| 2026-11-08 | Two tables, black coffee | GLM 5.3 FlashX | Z.ai | 2026-09-18 | 1 | v2 · c1 · h1 | medium | 1/1 | $0.012 | 2,546 | 31 | |
| 2026-11-08 | Two tables, black coffee | GLM 5.3 FlashX | Z.ai | 2026-09-18 | 2 | v2 · c1 · h1 | medium | 1/1 | $0.019 | 4,051 | 48 | |
| 2026-11-08 | Two tables, black coffee | GLM 5.3 FlashX | Z.ai | 2026-09-18 | 3 | v2 · c1 · h1 | medium | 1/1 | $0.011 | 2,481 | 36 | |
| 2026-11-08 | Two tables, black coffee | GPT-6 Luna | OpenAI | 2026-09-22 | 1 | v2 · c1 · h1 | medium | 1/1 | $0.016 | 5,196 | 45 | |
| 2026-11-08 | Two tables, black coffee | GPT-6 Luna | OpenAI | 2026-09-22 | 2 | v2 · c1 · h1 | medium | 1/1 | $0.022 | 6,607 | 58 | |
| 2026-11-08 | Two tables, black coffee | GPT-6 Luna | OpenAI | 2026-09-22 | 3 | v2 · c1 · h1 | medium | 1/1 | $0.034 | 8,558 | 87 | |
| 2026-11-08 | Two tables, black coffee | GPT-6.1 Sol | OpenAI | 2026-09-29 | 1 | v2 · c1 · h1 | medium | 1/1 | $0.011 | 3,336 | 58 | |
| 2026-11-08 | Two tables, black coffee | GPT-6.1 Sol | OpenAI | 2026-09-29 | 2 | v2 · c1 · h1 | medium | 1/1 | $0.017 | 4,687 | 86 | |
| 2026-11-08 | Two tables, black coffee | GPT-6.1 Sol | OpenAI | 2026-09-29 | 3 | v2 · c1 · h1 | medium | 1/1 | $0.015 | 4,027 | 77 | |
| 2026-11-08 | Two tables, black coffee | Kimi K3.1 Pro | moonshotai | 1 | v2 · c1 · h1 | medium | 1/1 | $0.093 | 6,649 | 40 | ||
| 2026-11-08 | Two tables, black coffee | Kimi K3.1 Pro | moonshotai | 2 | v2 · c1 · h1 | medium | 1/1 | $0.105 | 7,239 | 58 | ||
| 2026-11-08 | Two tables, black coffee | Kimi K3.1 Pro | moonshotai | 3 | v2 · c1 · h1 | medium | 1/1 | $0.130 | 7,069 | 62 | ||
| 2026-11-08 | Two tables, black coffee | Opus 5.5 | Anthropic | 2026-09-22 | 1 | v2 · c1 · h1 | medium | 1/1 | $0.010 | 3,049 | 36 | |
| 2026-11-08 | Two tables, black coffee | Opus 5.5 | Anthropic | 2026-09-22 | 2 | v2 · c1 · h1 | medium | 1/1 | $0.012 | 3,315 | 39 | |
| 2026-11-08 | Two tables, black coffee | Opus 5.5 | Anthropic | 2026-09-22 | 3 | v2 · c1 · h1 | medium | 1/1 | $0.010 | 3,025 | 32 | |
| 2026-11-08 | Four tables, three drinks | Claude Haiku 5.5 | Anthropic | 2026-10-07 | 1 | v2 · c1 · h1 | medium | 2/2 | $0.033 | 10,394 | 74 | |
| 2026-11-08 | Four tables, three drinks | Claude Haiku 5.5 | Anthropic | 2026-10-07 | 2 | v2 · c1 · h1 | medium | 1/1 | $0.004 | 1,654 | 24 | |
| 2026-11-08 | Four tables, three drinks | Claude Haiku 5.5 | Anthropic | 2026-10-07 | 3 | v2 · c1 · h1 | medium | 1/2 | $0.059 | 19,158 | 123 | |
| 2026-11-08 | Four tables, three drinks | Claude Sonnet 5.5 | Anthropic | 2026-09-28 | 1 | v2 · c1 · h1 | medium | 2/2 | $0.019 | 5,558 | 54 | |
| 2026-11-08 | Four tables, three drinks | Claude Sonnet 5.5 | Anthropic | 2026-09-28 | 2 | v2 · c1 · h1 | medium | 2/2 | $0.010 | 2,859 | 33 | |
| 2026-11-08 | Four tables, three drinks | Claude Sonnet 5.5 | Anthropic | 2026-09-28 | 3 | v2 · c1 · h1 | medium | 2/2 | $0.019 | 5,277 | 58 | |
| 2026-11-08 | Four tables, three drinks | DeepSeek 4.1 Flash | DeepSeek | 2026-09-10 | 1 | v2 · c1 · h1 | medium | 2/2 | $0.085 | 22,395 | 80 | |
| 2026-11-08 | Four tables, three drinks | DeepSeek 4.1 Flash | DeepSeek | 2026-09-10 | 2 | v2 · c1 · h1 | medium | 1/1 | $0.037 | 9,383 | 30 | |
| 2026-11-08 | Four tables, three drinks | DeepSeek 4.1 Flash | DeepSeek | 2026-09-10 | 3 | v2 · c1 · h1 | medium | 1/1 | $0.025 | 6,939 | 28 | |
| 2026-11-08 | Four tables, three drinks | GLM 5.3 FlashX | Z.ai | 2026-09-18 | 1 | v2 · c1 · h1 | medium | 2/2 | $0.027 | 5,733 | 71 | |
| 2026-11-08 | Four tables, three drinks | GLM 5.3 FlashX | Z.ai | 2026-09-18 | 2 | v2 · c1 · h1 | medium | 2/2 | $0.018 | 4,585 | 50 | |
| 2026-11-08 | Four tables, three drinks | GLM 5.3 FlashX | Z.ai | 2026-09-18 | 3 | v2 · c1 · h1 | medium | 2/2 | $0.022 | 4,902 | 60 | |
| 2026-11-08 | Four tables, three drinks | GPT-6 Luna | OpenAI | 2026-09-22 | 1 | v2 · c1 · h1 | medium | 1/1 | $0.003 | 1,179 | 12 | |
| 2026-11-08 | Four tables, three drinks | GPT-6 Luna | OpenAI | 2026-09-22 | 2 | v2 · c1 · h1 | medium | 1/1 | $0.012 | 4,225 | 43 | |
| 2026-11-08 | Four tables, three drinks | GPT-6 Luna | OpenAI | 2026-09-22 | 3 | v2 · c1 · h1 | medium | 1/1 | $0.016 | 5,504 | 46 | |
| 2026-11-08 | Four tables, three drinks | GPT-6.1 Sol | OpenAI | 2026-09-29 | 1 | v2 · c1 · h1 | medium | 1/1 | $0.001 | 235 | 8 | |
| 2026-11-08 | Four tables, three drinks | GPT-6.1 Sol | OpenAI | 2026-09-29 | 2 | v2 · c1 · h1 | medium | 1/1 | $0.001 | 318 | 10 | |
| 2026-11-08 | Four tables, three drinks | GPT-6.1 Sol | OpenAI | 2026-09-29 | 3 | v2 · c1 · h1 | medium | 1/1 | $0.001 | 287 | 9 | |
| 2026-11-08 | Four tables, three drinks | Kimi K3.1 Pro | moonshotai | 1 | v2 · c1 · h1 | medium | 1/1 | $0.017 | 1,356 | 15 | ||
| 2026-11-08 | Four tables, three drinks | Kimi K3.1 Pro | moonshotai | 2 | v2 · c1 · h1 | medium | 1/1 | $0.010 | 628 | 5 | ||
| 2026-11-08 | Four tables, three drinks | Kimi K3.1 Pro | moonshotai | 3 | v2 · c1 · h1 | medium | 2/2 | $0.107 | 6,285 | 42 | ||
| 2026-11-08 | Four tables, three drinks | Opus 5.5 | Anthropic | 2026-09-22 | 1 | v2 · c1 · h1 | medium | 2/2 | $0.012 | 3,689 | 41 | |
| 2026-11-08 | Four tables, three drinks | Opus 5.5 | Anthropic | 2026-09-22 | 2 | v2 · c1 · h1 | medium | 2/2 | $0.013 | 3,868 | 43 | |
| 2026-11-08 | Four tables, three drinks | Opus 5.5 | Anthropic | 2026-09-22 | 3 | v2 · c1 · h1 | medium | 2/2 | $0.015 | 3,983 | 50 | |
| 2026-10-26 | AeroPress | Kimi K3.1 Pro | moonshotai | 1 | v1 · c1 · h1 | medium | 4/5 | yes | $0.163 | 11,511 | 275 | |
| 2026-10-26 | AeroPress | Kimi K3.1 Pro | moonshotai | 2 | v1 · c1 · h1 | medium | 4/5 | yes | $0.202 | 13,632 | 338 | |
| 2026-10-26 | AeroPress | Kimi K3.1 Pro | moonshotai | 3 | v1 · c1 · h1 | medium | 4/5 | yes | $0.124 | 9,453 | 224 | |
| 2026-10-26 | Bean cosy | Kimi K3.1 Pro | moonshotai | 1 | v1 · c1 · h1 | medium | 3/4 | yes | $0.163 | 11,098 | 325 | |
| 2026-10-26 | Bean cosy | Kimi K3.1 Pro | moonshotai | 2 | v1 · c1 · h1 | medium | 4/4 | yes | $0.116 | 8,158 | 230 | |
| 2026-10-26 | Bean cosy | Kimi K3.1 Pro | moonshotai | 3 | v1 · c1 · h1 | medium | 4/4 | yes | $0.147 | 10,683 | 288 | |
| 2026-10-26 | Pruned shrub | Kimi K3.1 Pro | moonshotai | 1 | v1 · c2 · h1 | medium | 2/3 | yes | $0.223 | 13,895 | 512 | |
| 2026-10-26 | Pruned shrub | Kimi K3.1 Pro | moonshotai | 2 | v1 · c2 · h1 | medium | 1/3 | yes | $0.307 | 18,356 | 720 | |
| 2026-10-26 | Pruned shrub | Kimi K3.1 Pro | moonshotai | 3 | v1 · c2 · h1 | medium | 1/3 | yes | $0.261 | 14,909 | 720 | |
| 2026-10-26 | Hopper | Kimi K3.1 Pro | moonshotai | 1 | v1 · c1 · h1 | medium | 6/6 | $0.316 | 16,241 | 679 | ||
| 2026-10-26 | Hopper | Kimi K3.1 Pro | moonshotai | 2 | v1 · c1 · h1 | medium | 6/6 | $0.281 | 16,080 | 518 | ||
| 2026-10-26 | Hopper | Kimi K3.1 Pro | moonshotai | 3 | v1 · c1 · h1 | medium | 6/6 | $0.326 | 18,760 | 680 | ||
| 2026-10-26 | French press | Kimi K3.1 Pro | moonshotai | 1 | v2 · c1 · h1 | medium | 4/5 | yes | $0.177 | 12,921 | 347 | |
| 2026-10-26 | French press | Kimi K3.1 Pro | moonshotai | 2 | v2 · c1 · h1 | medium | 3/5 | yes | $0.176 | 11,615 | 340 | |
| 2026-10-26 | French press | Kimi K3.1 Pro | moonshotai | 3 | v2 · c1 · h1 | medium | 3/5 | yes | $0.171 | 11,761 | 354 | |
| 2026-10-21 | Portafilter | DeepSeek 4.1 Flash | DeepSeek | 2026-09-10 | 1 | v1 · c1 · h1 | medium | 3/4 | yes | $0.085 | 21,533 | 89 |
| 2026-10-21 | Portafilter | DeepSeek 4.1 Flash | DeepSeek | 2026-09-10 | 2 | v1 · c1 · h1 | medium | 4/5 | yes | $0.088 | 20,971 | 88 |
| 2026-10-21 | Portafilter | DeepSeek 4.1 Flash | DeepSeek | 2026-09-10 | 3 | v1 · c1 · h1 | medium | 5/5 | yes | $0.082 | 22,807 | 89 |
| 2026-10-21 | Portafilter | GLM 5.3 FlashX | Z.ai | 2026-09-18 | 1 | v1 · c1 · h1 | medium | 4/5 | yes | $0.015 | 3,766 | 40 |
| 2026-10-21 | Portafilter | GLM 5.3 FlashX | Z.ai | 2026-09-18 | 2 | v1 · c1 · h1 | medium | 3/5 | yes | $0.020 | 3,698 | 66 |
| 2026-10-21 | Portafilter | GLM 5.3 FlashX | Z.ai | 2026-09-18 | 3 | v1 · c1 · h1 | medium | 2/4 | yes | $0.028 | 5,848 | 73 |
| 2026-10-21 | Portafilter | Opus 5.5 | Anthropic | 2026-09-22 | 1 | v1 · c1 · h1 | medium | 5/5 | yes | $0.019 | 6,353 | 64 |
| 2026-10-21 | Portafilter | Opus 5.5 | Anthropic | 2026-09-22 | 2 | v1 · c1 · h1 | medium | 5/5 | yes | $0.015 | 4,693 | 49 |
| 2026-10-21 | Portafilter | Opus 5.5 | Anthropic | 2026-09-22 | 3 | v1 · c1 · h1 | medium | 4/5 | yes | $0.024 | 6,907 | 82 |
| 2026-10-19 | Verdict, good press | Opus 5.5 | Anthropic | 2026-09-22 | 1 | v1 · c1 · h1 | medium | 0/1 | yes | $0.007 | 1,938 | 33 |
| 2026-10-19 | Verdict, good press | Opus 5.5 | Anthropic | 2026-09-22 | 2 | v1 · c1 · h1 | medium | 1/1 | yes | $0.008 | 2,120 | 34 |
| 2026-10-19 | Verdict, good press | Opus 5.5 | Anthropic | 2026-09-22 | 3 | v1 · c1 · h1 | medium | 0/1 | yes | $0.015 | 4,355 | 66 |
| 2026-10-19 | Verdict, good press | Opus 5.5 | Anthropic | 2026-09-22 | 4 | v1 · c1 · h1 | medium | 1/1 | $0.010 | 2,728 | 41 | |
| 2026-10-19 | Verdict, good press | Opus 5.5 | Anthropic | 2026-09-22 | 5 | v1 · c1 · h1 | medium | 0/1 | $0.008 | 2,051 | 33 | |
| 2026-10-19 | Verdict, good press | Pareto 26.9 | unbiased | 2 | v1 · c1 · h1 | medium | 1/1 | $0.029 | 6,768 | 75 | ||
| 2026-10-19 | Verdict, good press | Pareto 26.9 | unbiased | 4 | v1 · c1 · h1 | medium | 1/1 | $0.037 | 9,302 | 83 | ||
| 2026-10-19 | Verdict, flipped | Opus 5.5 | Anthropic | 2026-09-22 | 1 | v1 · c1 · h1 | medium | 1/2 | yes | $0.009 | 2,498 | 46 |
| 2026-10-19 | Verdict, flipped | Opus 5.5 | Anthropic | 2026-09-22 | 2 | v1 · c1 · h1 | medium | 2/2 | yes | $0.007 | 1,724 | 34 |
| 2026-10-19 | Verdict, flipped | Opus 5.5 | Anthropic | 2026-09-22 | 3 | v1 · c1 · h1 | medium | 2/2 | yes | $0.026 | 7,229 | 105 |
| 2026-10-19 | Verdict, flipped | Opus 5.5 | Anthropic | 2026-09-22 | 4 | v1 · c1 · h1 | medium | 1/2 | $0.010 | 2,833 | 42 | |
| 2026-10-19 | Verdict, flipped | Opus 5.5 | Anthropic | 2026-09-22 | 5 | v1 · c1 · h1 | medium | 2/2 | $0.022 | 6,224 | 90 | |
| 2026-10-19 | Verdict, flipped | Pareto 26.9 | unbiased | 4 | v1 · c1 · h1 | medium | 2/2 | yes | $0.025 | 5,010 | 51 | |
| 2026-10-19 | Verdict, flipped | Pareto 26.9 | unbiased | 4 | v1 · c1 · h1 | medium | 2/2 | yes | $0.019 | 2,869 | 32 | |
| 2026-10-19 | Verdict, flipped | Pareto 26.9 | unbiased | 5 | v1 · c1 · h1 | medium | 2/2 | yes | $0.026 | 5,073 | 45 | |
| 2026-10-19 | Stirring spoon | Claude Sonnet 5.5 | Anthropic | 2026-09-28 | 1 | v1 · c1 · h1 | medium | 6/6 | yes | $0.010 | 2,634 | 50 |
| 2026-10-19 | Stirring spoon | Claude Sonnet 5.5 | Anthropic | 2026-09-28 | 2 | v1 · c1 · h1 | medium | 6/6 | yes | $0.007 | 2,045 | 43 |
| 2026-10-19 | Stirring spoon | Claude Sonnet 5.5 | Anthropic | 2026-09-28 | 3 | v1 · c1 · h1 | medium | 6/6 | yes | $0.010 | 2,522 | 51 |
| 2026-10-19 | Stirring spoon | DeepSeek 4.1 Flash | DeepSeek | 2026-09-10 | 1 | v1 · c1 · h1 | medium | 3/6 | yes | $0.282 | 50,112 | 720 |
| 2026-10-19 | Stirring spoon | DeepSeek 4.1 Flash | DeepSeek | 2026-09-10 | 2 | v1 · c1 · h1 | medium | 4/5 | yes | $0.270 | 45,324 | 720 |
| 2026-10-19 | Stirring spoon | DeepSeek 4.1 Flash | DeepSeek | 2026-09-10 | 3 | v1 · c1 · h1 | medium | 5/6 | yes | $0.200 | 31,965 | 526 |
| 2026-10-19 | Stirring spoon | GLM 5.3 FlashX | Z.ai | 2026-09-18 | 1 | v1 · c1 · h1 | medium | 5/6 | yes | $0.038 | 5,086 | 133 |
| 2026-10-19 | Stirring spoon | GLM 5.3 FlashX | Z.ai | 2026-09-18 | 2 | v1 · c1 · h1 | medium | 5/6 | yes | $0.054 | 8,831 | 221 |
| 2026-10-19 | Stirring spoon | GLM 5.3 FlashX | Z.ai | 2026-09-18 | 3 | v1 · c1 · h1 | medium | 5/6 | yes | $0.084 | 11,560 | 337 |
| 2026-10-19 | Spoon repair | Claude Sonnet 5.5 | Anthropic | 2026-09-28 | 1 | v1 · c1 · h1 | medium | 2/2 | yes | $0.022 | 4,543 | 85 |
| 2026-10-19 | Spoon repair | Claude Sonnet 5.5 | Anthropic | 2026-09-28 | 2 | v1 · c1 · h1 | medium | 1/2 | yes | $0.009 | 1,887 | 36 |
| 2026-10-19 | Spoon repair | Claude Sonnet 5.5 | Anthropic | 2026-09-28 | 3 | v1 · c1 · h1 | medium | 1/2 | yes | $0.010 | 2,118 | 39 |
| 2026-10-19 | Spoon repair | DeepSeek 4.1 Flash | DeepSeek | 2026-09-10 | 1 | v1 · c1 · h1 | medium | 2/2 | yes | $0.280 | 41,137 | 406 |
| 2026-10-19 | Spoon repair | DeepSeek 4.1 Flash | DeepSeek | 2026-09-10 | 2 | v1 · c1 · h1 | medium | 2/2 | yes | $0.208 | 29,090 | 311 |
| 2026-10-19 | Spoon repair | DeepSeek 4.1 Flash | DeepSeek | 2026-09-10 | 3 | v1 · c1 · h1 | medium | 2/2 | yes | $0.685 | 58,507 | 680 |
| 2026-10-19 | Spoon repair | GLM 5.3 FlashX | Z.ai | 2026-09-18 | 1 | v1 · c1 · h1 | medium | 1/2 | yes | $0.026 | 3,430 | 105 |
| 2026-10-19 | Spoon repair | GLM 5.3 FlashX | Z.ai | 2026-09-18 | 2 | v1 · c1 · h1 | medium | 1/2 | yes | $0.008 | 1,089 | 38 |
| 2026-10-19 | Spoon repair | GLM 5.3 FlashX | Z.ai | 2026-09-18 | 3 | v1 · c1 · h1 | medium | 1/2 | yes | $0.008 | 1,002 | 44 |
| 2026-10-19 | V60 repair | Claude Haiku 5.5 | Anthropic | 2026-10-07 | 1 | v1 · c1 · h1 | medium | 2/2 | $0.032 | 9,367 | 62 | |
| 2026-10-19 | V60 repair | Claude Haiku 5.5 | Anthropic | 2026-10-07 | 2 | v1 · c1 · h1 | medium | 2/2 | $0.015 | 4,637 | 27 | |
| 2026-10-19 | V60 repair | Claude Haiku 5.5 | Anthropic | 2026-10-07 | 3 | v1 · c1 · h1 | medium | 2/2 | $0.024 | 6,694 | 44 | |
| 2026-10-19 | V60 repair | DeepSeek 4.1 Flash | DeepSeek | 2026-09-10 | 1 | v1 · c1 · h1 | medium | 2/2 | $0.023 | 3,320 | 49 | |
| 2026-10-19 | V60 repair | DeepSeek 4.1 Flash | DeepSeek | 2026-09-10 | 2 | v1 · c1 · h1 | medium | 2/2 | $0.015 | 3,611 | 55 | |
| 2026-10-19 | V60 repair | DeepSeek 4.1 Flash | DeepSeek | 2026-09-10 | 3 | v1 · c1 · h1 | medium | 2/2 | $0.019 | 3,279 | 47 | |
| 2026-10-19 | V60 repair | GLM 5.3 FlashX | Z.ai | 2026-09-18 | 1 | v1 · c1 · h1 | medium | 2/2 | $0.012 | 1,514 | 38 | |
| 2026-10-19 | V60 repair | GLM 5.3 FlashX | Z.ai | 2026-09-18 | 2 | v1 · c1 · h1 | medium | 2/2 | $0.009 | 1,184 | 27 | |
| 2026-10-19 | V60 repair | GLM 5.3 FlashX | Z.ai | 2026-09-18 | 3 | v1 · c1 · h1 | medium | 2/2 | $0.008 | 1,498 | 24 | |
| 2026-10-19 | Knitting repair | Claude Haiku 5.5 | Anthropic | 2026-10-07 | 1 | v1 · c1 · h1 | medium | 2/2 | $0.087 | 21,883 | 135 | |
| 2026-10-19 | Knitting repair | Claude Haiku 5.5 | Anthropic | 2026-10-07 | 2 | v1 · c1 · h1 | medium | 1/2 | $0.047 | 14,269 | 82 | |
| 2026-10-19 | Knitting repair | Claude Haiku 5.5 | Anthropic | 2026-10-07 | 3 | v1 · c1 · h1 | medium | 1/2 | $0.043 | 11,425 | 68 | |
| 2026-10-19 | Knitting repair | DeepSeek 4.1 Flash | DeepSeek | 2026-09-10 | 1 | v1 · c1 · h1 | medium | 2/2 | $0.244 | 41,778 | 258 | |
| 2026-10-19 | Knitting repair | DeepSeek 4.1 Flash | DeepSeek | 2026-09-10 | 2 | v1 · c1 · h1 | medium | 2/2 | $0.177 | 34,767 | 203 | |
| 2026-10-19 | Knitting repair | DeepSeek 4.1 Flash | DeepSeek | 2026-09-10 | 3 | v1 · c1 · h1 | medium | 2/2 | $0.213 | 34,461 | 186 | |
| 2026-10-19 | Knitting repair | GLM 5.3 FlashX | Z.ai | 2026-09-18 | 1 | v1 · c1 · h1 | medium | 2/2 | $0.061 | 7,001 | 99 | |
| 2026-10-19 | Knitting repair | GLM 5.3 FlashX | Z.ai | 2026-09-18 | 2 | v1 · c1 · h1 | medium | 2/2 | $0.052 | 8,074 | 139 | |
| 2026-10-19 | Knitting repair | GLM 5.3 FlashX | Z.ai | 2026-09-18 | 3 | v1 · c1 · h1 | medium | 2/2 | $0.053 | 9,447 | 132 | |
| 2026-10-19 | Venn repair | DeepSeek 4.1 Flash | DeepSeek | 2026-09-10 | 1 | v1 · c1 · h1 | medium | 2/2 | yes | $0.066 | 12,615 | 196 |
| 2026-10-19 | Venn repair | DeepSeek 4.1 Flash | DeepSeek | 2026-09-10 | 2 | v1 · c1 · h1 | medium | 2/2 | yes | $0.107 | 19,856 | 151 |
| 2026-10-19 | Venn repair | DeepSeek 4.1 Flash | DeepSeek | 2026-09-10 | 3 | v1 · c1 · h1 | medium | 2/2 | yes | $0.060 | 12,065 | 236 |
| 2026-10-19 | Venn repair | GLM 5.3 FlashX | Z.ai | 2026-09-18 | 1 | v1 · c1 · h1 | medium | 1/2 | yes | $0.014 | 1,990 | 53 |
| 2026-10-19 | Venn repair | GLM 5.3 FlashX | Z.ai | 2026-09-18 | 2 | v1 · c1 · h1 | medium | 2/2 | yes | $0.028 | 4,320 | 78 |
| 2026-10-19 | Venn repair | GLM 5.3 FlashX | Z.ai | 2026-09-18 | 3 | v1 · c1 · h1 | medium | 2/2 | yes | $0.018 | 2,565 | 59 |
| 2026-10-19 | Venn repair | Kimi K3 | MoonshotAI | 2026-07-16 | 1 | v1 · c1 · h1 | medium | 2/2 | yes | $0.395 | 15,878 | 165 |
| 2026-10-19 | Venn repair | Kimi K3 | MoonshotAI | 2026-07-16 | 2 | v1 · c1 · h1 | medium | 1/2 | yes | $0.091 | 2,270 | 30 |
| 2026-10-19 | Venn repair | Kimi K3 | MoonshotAI | 2026-07-16 | 3 | v1 · c1 · h1 | medium | 2/2 | yes | $0.073 | 2,438 | 25 |
| 2026-10-16 | Pruned shrub | Gemini 4 Argon | 2026-10-13 | 1 | v1 · c2 · h1 | medium | 3/3 | yes | $0.464 | 34,919 | 511 | |
| 2026-10-16 | Pruned shrub | Gemini 4 Argon | 2026-10-13 | 2 | v1 · c2 · h1 | medium | 3/3 | yes | $0.664 | 48,112 | 720 | |
| 2026-10-16 | Pruned shrub | Gemini 4 Argon | 2026-10-13 | 3 | v1 · c2 · h1 | medium | 3/3 | yes | $0.366 | 28,755 | 417 | |
| 2026-10-16 | Pruned shrub | Muse Spark Open | meta | 1 | v1 · c2 · h1 | medium | 0/3 | yes | $0.114 | 8,634 | 156 | |
| 2026-10-16 | Pruned shrub | Muse Spark Open | meta | 2 | v1 · c2 · h1 | medium | 1/3 | yes | $0.117 | 8,628 | 152 | |
| 2026-10-16 | Pruned shrub | Muse Spark Open | meta | 3 | v1 · c2 · h1 | medium | 0/3 | yes | $0.099 | 7,905 | 140 | |
| 2026-10-16 | Pruned shrub | Nemotron 3.5 Super VL | nvidia | 1 | v1 · c2 · h1 | medium | 1/3 | yes | $0.014 | 7,467 | 32 | |
| 2026-10-16 | Pruned shrub | Nemotron 3.5 Super VL | nvidia | 2 | v1 · c2 · h1 | medium | 1/3 | yes | $0.010 | 5,795 | 23 | |
| 2026-10-16 | Pruned shrub | Nemotron 3.5 Super VL | nvidia | 3 | v1 · c2 · h1 | medium | 1/3 | yes | $0.005 | 3,244 | 50 | |
| 2026-10-16 | French press | Muse Spark Open | meta | 1 | v2 · c1 · h1 | medium | 3/5 | $0.341 | 13,429 | 184 | ||
| 2026-10-16 | French press | Muse Spark Open | meta | 2 | v2 · c1 · h1 | medium | 4/5 | $0.121 | 9,199 | 123 | ||
| 2026-10-16 | French press | Nemotron 3.5 Super VL | nvidia | 1 | v2 · c1 · h1 | medium | 2/5 | yes | $0.020 | 19,815 | 83 | |
| 2026-10-16 | French press | Nemotron 3.5 Super VL | nvidia | 2 | v2 · c1 · h1 | medium | 1/5 | yes | $0.024 | 18,378 | 70 | |
| 2026-10-16 | French press | Nemotron 3.5 Super VL | nvidia | 3 | v2 · c1 · h1 | medium | 0/5 | yes | $0.015 | 9,835 | 38 | |
| 2026-10-15 | Hopper | DeepSeek 4.1 Flash | DeepSeek | 2026-09-10 | 2 | v1 · c1 · h1 | medium | 5/6 | $0.069 | 66,767 | 720 | |
| 2026-10-15 | Hopper | GPT-6 Luna | OpenAI | 2026-09-22 | 1 | v1 · c1 · h1 | medium | 5/6 | $0.028 | 28,625 | 468 | |
| 2026-10-15 | Hopper | GPT-6 Luna | OpenAI | 2026-09-22 | 2 | v1 · c1 · h1 | medium | 4/6 | $0.035 | 32,641 | 491 | |
| 2026-10-15 | Hopper | GPT-6 Luna | OpenAI | 2026-09-22 | 3 | v1 · c1 · h1 | medium | 1/6 | $0.023 | 26,580 | 346 | |
| 2026-10-15 | Hopper | Haiku 5.5 | Anthropic | 2026-10-07 | 1 | v1 · c1 · h1 | medium | 5/6 | $0.026 | 41,143 | 720 | |
| 2026-10-15 | Hopper | Haiku 5.5 | Anthropic | 2026-10-07 | 2 | v1 · c1 · h1 | medium | 6/6 | $0.031 | 51,936 | 493 | |
| 2026-10-15 | Hopper | Haiku 5.5 | Anthropic | 2026-10-07 | 3 | v1 · c1 · h1 | medium | 6/6 | $0.018 | 28,279 | 270 | |
| 2026-10-15 | Hopper | Pareto 26.9 | unbiased | 1 | v1 · c1 · h1 | medium | 6/6 | $0.187 | 9,626 | 355 | ||
| 2026-10-15 | Hopper | Pareto 26.9 | unbiased | 2 | v1 · c1 · h1 | medium | 6/6 | $0.470 | 41,667 | 530 | ||
| 2026-10-15 | Hopper | Pareto 26.9 | unbiased | 3 | v1 · c1 · h1 | medium | 6/6 | $0.262 | 10,534 | 720 | ||
| 2026-10-14 | Coffee tree | Claude Haiku 5.5 | Anthropic | 2026-10-07 | 1 | v1 · c1 · h1 | medium | 4/4 | $0.005 | 7,977 | 49 | |
| 2026-10-14 | Coffee tree | Claude Haiku 5.5 | Anthropic | 2026-10-07 | 2 | v1 · c1 · h1 | medium | 4/4 | $0.003 | 4,771 | 34 | |
| 2026-10-14 | Coffee tree | Claude Haiku 5.5 | Anthropic | 2026-10-07 | 3 | v1 · c1 · h1 | medium | 4/4 | $0.009 | 17,040 | 116 | |
| 2026-10-14 | Coffee tree | DeepSeek 4.1 Flash | DeepSeek | 2026-09-10 | 1 | v1 · c1 · h1 | medium | 4/4 | $0.007 | 7,225 | 40 | |
| 2026-10-14 | Coffee tree | DeepSeek 4.1 Flash | DeepSeek | 2026-09-10 | 2 | v1 · c1 · h1 | medium | 4/4 | $0.009 | 9,013 | 38 | |
| 2026-10-14 | Coffee tree | DeepSeek 4.1 Flash | DeepSeek | 2026-09-10 | 3 | v1 · c1 · h1 | medium | 4/4 | $0.006 | 5,474 | 40 | |
| 2026-10-14 | Coffee tree | Gemini 4 Argon | 2026-10-13 | 1 | v1 · c1 · h1 | medium | 4/4 | $0.055 | 3,324 | 53 | ||
| 2026-10-14 | Coffee tree | Gemini 4 Argon | 2026-10-13 | 2 | v1 · c1 · h1 | medium | 4/4 | $0.086 | 4,591 | 63 | ||
| 2026-10-14 | Coffee tree | Gemini 4 Argon | 2026-10-13 | 3 | v1 · c1 · h1 | medium | 4/4 | $0.090 | 4,533 | 79 | ||
| 2026-10-14 | Coffee tree | GPT-6 Luna | OpenAI | 2026-09-22 | 1 | v1 · c1 · h1 | medium | 4/4 | $0.002 | 2,428 | 43 | |
| 2026-10-14 | Coffee tree | GPT-6 Luna | OpenAI | 2026-09-22 | 2 | v1 · c1 · h1 | medium | 4/4 | $0.001 | 1,717 | 35 | |
| 2026-10-14 | Coffee tree | GPT-6 Luna | OpenAI | 2026-09-22 | 3 | v1 · c1 · h1 | medium | 4/4 | $0.001 | 1,147 | 20 | |
| 2026-10-14 | Coffee tree | Opus 5.5 | Anthropic | 2026-09-22 | 1 | v1 · c1 · h1 | medium | 4/4 | $0.045 | 1,376 | 30 | |
| 2026-10-14 | Coffee tree | Opus 5.5 | Anthropic | 2026-09-22 | 2 | v1 · c1 · h1 | medium | 4/4 | $0.062 | 2,294 | 44 | |
| 2026-10-14 | Coffee tree | Opus 5.5 | Anthropic | 2026-09-22 | 3 | v1 · c1 · h1 | medium | 4/4 | $0.048 | 2,007 | 32 | |
| 2026-10-13 | French press | Muse Wonder | Meta | 2026-10-12 | 1 | v2 · c1 · h1 | medium | 4/5 | yes | $0.555 | 14,135 | 166 |
| 2026-10-13 | French press | Muse Wonder | Meta | 2026-10-12 | 2 | v2 · c1 · h1 | medium | 4/5 | yes | $0.368 | 11,836 | 91 |
| 2026-10-13 | French press | Muse Wonder | Meta | 2026-10-12 | 3 | v2 · c1 · h1 | medium | 4/5 | yes | $0.365 | 12,817 | 85 |
| 2026-10-13 | Venn | Muse Wonder | Meta | 2026-10-12 | 1 | v1 · c2 · h1 | medium | 4/4 | $0.126 | 3,450 | 39 | |
| 2026-10-13 | Venn | Muse Wonder | Meta | 2026-10-12 | 2 | v1 · c2 · h1 | medium | 4/4 | $0.403 | 10,125 | 127 | |
| 2026-10-13 | Venn | Muse Wonder | Meta | 2026-10-12 | 3 | v1 · c2 · h1 | medium | 4/4 | $0.143 | 4,757 | 49 | |
| 2026-10-11 | Bean cosy | Claude Haiku 5.5 | Anthropic | 2026-10-07 | 1 | v1 · c1 · h1 | medium | 4/4 | yes | $0.007 | 9,579 | 66 |
| 2026-10-11 | Bean cosy | Claude Haiku 5.5 | Anthropic | 2026-10-07 | 2 | v1 · c1 · h1 | medium | 4/4 | yes | $0.005 | 7,741 | 51 |
| 2026-10-11 | Bean cosy | Claude Haiku 5.5 | Anthropic | 2026-10-07 | 3 | v1 · c1 · h1 | medium | 3/4 | yes | $0.010 | 14,901 | 96 |
| 2026-10-11 | Bean cosy | DeepSeek 4.1 Flash | DeepSeek | 2026-09-10 | 1 | v1 · c1 · h1 | medium | 4/4 | yes | $0.063 | 43,275 | 308 |
| 2026-10-11 | Bean cosy | DeepSeek 4.1 Flash | DeepSeek | 2026-09-10 | 2 | v1 · c1 · h1 | medium | 3/4 | yes | $0.051 | 37,552 | 254 |
| 2026-10-11 | Bean cosy | DeepSeek 4.1 Flash | DeepSeek | 2026-09-10 | 3 | v1 · c1 · h1 | medium | 3/4 | yes | $0.096 | 46,470 | 300 |
| 2026-10-11 | Bean cosy | GLM 5.3 FlashX | Z.ai | 2026-09-18 | 1 | v1 · c1 · h1 | medium | 3/4 | yes | $0.013 | 5,175 | 65 |
| 2026-10-11 | Bean cosy | GLM 5.3 FlashX | Z.ai | 2026-09-18 | 2 | v1 · c1 · h1 | medium | 3/4 | yes | $0.015 | 3,559 | 66 |
| 2026-10-11 | Bean cosy | GLM 5.3 FlashX | Z.ai | 2026-09-18 | 3 | v1 · c1 · h1 | medium | 2/3 | yes | $0.012 | 4,171 | 62 |
| 2026-10-11 | Bean cosy | GPT-6 Luna | OpenAI | 2026-09-22 | 1 | v1 · c1 · h1 | medium | 2/4 | yes | $0.009 | 13,202 | 152 |
| 2026-10-11 | Bean cosy | GPT-6 Luna | OpenAI | 2026-09-22 | 2 | v1 · c1 · h1 | medium | 4/4 | yes | $0.014 | 20,007 | 202 |
| 2026-10-11 | Bean cosy | GPT-6 Luna | OpenAI | 2026-09-22 | 3 | v1 · c1 · h1 | medium | 3/4 | yes | $0.007 | 11,036 | 113 |
| 2026-10-11 | Bean cosy | GPT-6.1 Sol | OpenAI | 2026-09-29 | 1 | v1 · c1 · h1 | medium | 4/4 | yes | $0.060 | 4,775 | 102 |
| 2026-10-11 | Bean cosy | GPT-6.1 Sol | OpenAI | 2026-09-29 | 2 | v1 · c1 · h1 | medium | 4/4 | yes | $0.063 | 4,170 | 92 |
| 2026-10-11 | Bean cosy | GPT-6.1 Sol | OpenAI | 2026-09-29 | 3 | v1 · c1 · h1 | medium | 4/4 | yes | $0.067 | 5,336 | 114 |
| 2026-10-11 | Bean cosy | Opus 5.5 | Anthropic | 2026-09-22 | 1 | v1 · c1 · h1 | medium | 3/4 | yes | $0.177 | 6,442 | 84 |
| 2026-10-11 | Bean cosy | Opus 5.5 | Anthropic | 2026-09-22 | 2 | v1 · c1 · h1 | medium | 4/4 | yes | $0.111 | 4,871 | 58 |
| 2026-10-11 | Bean cosy | Opus 5.5 | Anthropic | 2026-09-22 | 3 | v1 · c1 · h1 | medium | 4/4 | yes | $0.144 | 5,139 | 68 |
| 2026-10-09 | Five circles | Claude Sonnet 5.5 | Anthropic | 2026-09-28 | 1 | v1 · c1 · h1 | medium | 3/3 | $0.025 | 1,250 | 18 | |
| 2026-10-09 | Five circles | Claude Sonnet 5.5 | Anthropic | 2026-09-28 | 2 | v1 · c1 · h1 | medium | 3/3 | $0.059 | 4,555 | 120 | |
| 2026-10-09 | Five circles | Claude Sonnet 5.5 | Anthropic | 2026-09-28 | 3 | v1 · c1 · h1 | medium | 3/3 | $0.138 | 6,903 | 188 | |
| 2026-10-09 | Five circles | DeepSeek 4.1 Flash | DeepSeek | 2026-09-10 | 1 | v1 · c1 · h1 | medium | 3/3 | $0.183 | 47,750 | 275 | |
| 2026-10-09 | Five circles | DeepSeek 4.1 Flash | DeepSeek | 2026-09-10 | 2 | v1 · c1 · h1 | medium | 3/3 | $0.088 | 26,036 | 145 | |
| 2026-10-09 | Five circles | DeepSeek 4.1 Flash | DeepSeek | 2026-09-10 | 3 | v1 · c1 · h1 | medium | 3/3 | $0.055 | 19,638 | 120 | |
| 2026-10-09 | Five circles | GPT-6 Luna | OpenAI | 2026-09-22 | 1 | v1 · c1 · h1 | medium | 2/3 | $0.005 | 6,586 | 98 | |
| 2026-10-09 | Five circles | GPT-6 Luna | OpenAI | 2026-09-22 | 2 | v1 · c1 · h1 | medium | 2/3 | $0.002 | 3,429 | 45 | |
| 2026-10-09 | Five circles | GPT-6 Luna | OpenAI | 2026-09-22 | 3 | v1 · c1 · h1 | medium | 2/3 | $0.002 | 3,567 | 46 | |
| 2026-10-09 | Five circles | GPT-6.1 Sol | OpenAI | 2026-09-29 | 1 | v1 · c1 · h1 | medium | 2/3 | $0.031 | 1,705 | 72 | |
| 2026-10-09 | Five circles | GPT-6.1 Sol | OpenAI | 2026-09-29 | 2 | v1 · c1 · h1 | medium | 2/3 | $0.027 | 1,668 | 68 | |
| 2026-10-09 | Five circles | GPT-6.1 Sol | OpenAI | 2026-09-29 | 3 | v1 · c1 · h1 | medium | 2/3 | $0.033 | 1,634 | 88 | |
| 2026-10-09 | Five circles | Pareto 26.10 Preview | unbiased | 2026-10-01 | 1 | v1 · c1 · h1 | medium | 3/3 | $0.047 | 8,713 | 74 | |
| 2026-10-09 | Five circles | Pareto 26.10 Preview | unbiased | 2026-10-01 | 2 | v1 · c1 · h1 | medium | 3/3 | $0.098 | 25,726 | 136 | |
| 2026-10-09 | Five circles | Pareto 26.10 Preview | unbiased | 2026-10-01 | 3 | v1 · c1 · h1 | medium | 2/3 | $0.116 | 29,599 | 175 | |
| 2026-10-09 | Five circles | Qwen3.8 Max Prime | Qwen | 2026-09-23 | 1 | v1 · c1 · h1 | medium | 3/3 | $0.233 | 9,877 | 147 | |
| 2026-10-09 | French press | Step 5 Preview | StepFun | 2026-10-08 | 1 | v2 · c1 · h1 | medium | 3/5 | yes | $0.053 | 15,392 | 187 |
| 2026-10-09 | French press | Step 5 Preview | StepFun | 2026-10-08 | 2 | v2 · c1 · h1 | medium | 4/5 | yes | $0.167 | 31,349 | 345 |
| 2026-10-09 | French press | Step 5 Preview | StepFun | 2026-10-08 | 3 | v2 · c1 · h1 | medium | 3/5 | yes | $0.214 | 66,185 | 720 |
| 2026-10-09 | Venn | Step 5 Preview | StepFun | 2026-10-08 | 1 | v1 · c2 · h1 | medium | 2/4 | $0.117 | 21,044 | 274 | |
| 2026-10-09 | Venn | Step 5 Preview | StepFun | 2026-10-08 | 2 | v1 · c2 · h1 | medium | 3/4 | $0.018 | 4,475 | 73 | |
| 2026-10-09 | Venn | Step 5 Preview | StepFun | 2026-10-08 | 3 | v1 · c2 · h1 | medium | 2/4 | $0.104 | 19,072 | 267 | |
| 2026-10-08 | AeroPress | Claude Haiku 5.5 | Anthropic | 2026-10-07 | 1 | v1 · c1 · h1 | medium | 5/5 | yes | $0.009 | 11,568 | 70 |
| 2026-10-08 | AeroPress | Claude Haiku 5.5 | Anthropic | 2026-10-07 | 2 | v1 · c1 · h1 | medium | 2/4 | yes | $0.006 | 8,858 | 54 |
| 2026-10-08 | AeroPress | Claude Haiku 5.5 | Anthropic | 2026-10-07 | 3 | v1 · c1 · h1 | medium | 3/5 | yes | $0.006 | 8,071 | 51 |
| 2026-10-08 | Grinder | Claude Haiku 5.5 | Anthropic | 2026-10-07 | 1 | v1 · c1 · h1 | medium | 3/5 | yes | $0.005 | 7,065 | 43 |
| 2026-10-08 | Grinder | Claude Haiku 5.5 | Anthropic | 2026-10-07 | 2 | v1 · c1 · h1 | medium | 2/5 | yes | $0.006 | 9,891 | 63 |
| 2026-10-08 | Grinder | Claude Haiku 5.5 | Anthropic | 2026-10-07 | 3 | v1 · c1 · h1 | medium | 2/5 | yes | $0.004 | 7,579 | 39 |
| 2026-10-08 | Portafilter | Claude Haiku 5.5 | Anthropic | 2026-10-07 | 1 | v1 · c1 · h1 | medium | 2/4 | yes | $0.007 | 10,794 | 55 |
| 2026-10-08 | Portafilter | Claude Haiku 5.5 | Anthropic | 2026-10-07 | 2 | v1 · c1 · h1 | medium | 2/5 | yes | $0.005 | 8,493 | 47 |
| 2026-10-08 | Portafilter | Claude Haiku 5.5 | Anthropic | 2026-10-07 | 3 | v1 · c1 · h1 | medium | 2/5 | yes | $0.005 | 7,069 | 42 |
| 2026-10-08 | V60 | Claude Haiku 5.5 | Anthropic | 2026-10-07 | 1 | v1 · c1 · h1 | medium | 4/5 | yes | $0.005 | 7,394 | 46 |
| 2026-10-08 | V60 | Claude Haiku 5.5 | Anthropic | 2026-10-07 | 2 | v1 · c1 · h1 | medium | 4/5 | yes | $0.007 | 9,735 | 55 |
| 2026-10-08 | V60 | Claude Haiku 5.5 | Anthropic | 2026-10-07 | 3 | v1 · c1 · h1 | medium | 4/5 | yes | $0.005 | 6,171 | 40 |
| 2026-10-08 | Espresso Rag | Claude Haiku 5.5 | Anthropic | 2026-10-07 | 1 | v1 · c1 · h1 | medium | 4/6 | yes | $0.012 | 22,270 | 115 |
| 2026-10-08 | Espresso Rag | Claude Haiku 5.5 | Anthropic | 2026-10-07 | 2 | v1 · c1 · h1 | medium | 5/6 | yes | $0.012 | 20,876 | 119 |
| 2026-10-08 | Espresso Rag | Claude Haiku 5.5 | Anthropic | 2026-10-07 | 3 | v1 · c1 · h1 | medium | 5/6 | yes | $0.009 | 14,936 | 89 |
| 2026-10-08 | Pruned shrub | Claude Haiku 5.5 | Anthropic | 2026-10-07 | 1 | v1 · c2 · h1 | medium | 2/3 | yes | $0.009 | 10,677 | 134 |
| 2026-10-08 | Pruned shrub | Claude Haiku 5.5 | Anthropic | 2026-10-07 | 2 | v1 · c2 · h1 | medium | 1/3 | yes | $0.012 | 15,588 | 156 |
| 2026-10-08 | Pruned shrub | Claude Haiku 5.5 | Anthropic | 2026-10-07 | 3 | v1 · c2 · h1 | medium | 1/3 | yes | $0.009 | 9,699 | 117 |
| 2026-10-08 | French press | Claude Haiku 5.5 | Anthropic | 2026-10-07 | 1 | v2 · c1 · h1 | medium | 0/5 | yes | $0.008 | 11,797 | 65 |
| 2026-10-08 | French press | Claude Haiku 5.5 | Anthropic | 2026-10-07 | 2 | v2 · c1 · h1 | medium | 3/5 | yes | $0.004 | 5,340 | 33 |
| 2026-10-08 | French press | Claude Haiku 5.5 | Anthropic | 2026-10-07 | 3 | v2 · c1 · h1 | medium | 1/5 | yes | $0.008 | 9,833 | 63 |
| 2026-10-08 | French press | GPT-6.1 Sol | OpenAI | 2026-09-29 | 1 | v2 · c1 · h1 | medium | 5/5 | yes | $0.085 | 6,154 | 116 |
| 2026-10-08 | French press | GPT-6.1 Sol | OpenAI | 2026-09-29 | 2 | v2 · c1 · h1 | medium | 5/5 | yes | $0.094 | 6,633 | 118 |
| 2026-10-08 | French press | GPT-6.1 Sol | OpenAI | 2026-09-29 | 3 | v2 · c1 · h1 | medium | 5/5 | yes | $0.091 | 6,723 | 121 |
| 2026-10-08 | Venn | Claude Haiku 5.5 | Anthropic | 2026-10-07 | 1 | v1 · c2 · h1 | medium | 4/4 | $0.003 | 4,660 | 34 | |
| 2026-10-08 | Venn | Claude Haiku 5.5 | Anthropic | 2026-10-07 | 2 | v1 · c2 · h1 | medium | 2/4 | $0.005 | 7,147 | 57 | |
| 2026-10-08 | Venn | Claude Haiku 5.5 | Anthropic | 2026-10-07 | 3 | v1 · c2 · h1 | medium | 4/4 | $0.003 | 4,244 | 34 | |
| 2026-10-07 | AeroPress | GPT-6.1 Sol | OpenAI | 2026-09-29 | 1 | v1 · c1 · h1 | medium | 5/5 | yes | $0.105 | 7,157 | 150 |
| 2026-10-07 | AeroPress | GPT-6.1 Sol | OpenAI | 2026-09-29 | 2 | v1 · c1 · h1 | medium | 5/5 | yes | $0.089 | 6,248 | 126 |
| 2026-10-07 | AeroPress | GPT-6.1 Sol | OpenAI | 2026-09-29 | 3 | v1 · c1 · h1 | medium | 5/5 | yes | $0.089 | 6,434 | 132 |
| 2026-10-07 | AeroPress | Pareto 26.10 Preview | unbiased | 2026-10-01 | 1 | v1 · c1 · h1 | medium | 2/5 | yes | $0.110 | 30,511 | 140 |
| 2026-10-07 | AeroPress | Pareto 26.10 Preview | unbiased | 2026-10-01 | 2 | v1 · c1 · h1 | medium | 3/5 | yes | $0.100 | 26,300 | 140 |
| 2026-10-07 | AeroPress | Pareto 26.10 Preview | unbiased | 2026-10-01 | 3 | v1 · c1 · h1 | medium | 1/5 | yes | $0.095 | 26,000 | 133 |
| 2026-10-07 | Grinder | GPT-6.1 Sol | OpenAI | 2026-09-29 | 1 | v1 · c1 · h1 | medium | 4/5 | yes | $0.098 | 7,210 | 136 |
| 2026-10-07 | Grinder | GPT-6.1 Sol | OpenAI | 2026-09-29 | 2 | v1 · c1 · h1 | medium | 5/5 | yes | $0.096 | 7,042 | 149 |
| 2026-10-07 | Grinder | GPT-6.1 Sol | OpenAI | 2026-09-29 | 3 | v1 · c1 · h1 | medium | 5/5 | yes | $0.091 | 6,640 | 135 |
| 2026-10-07 | Grinder | Pareto 26.10 Preview | unbiased | 2026-10-01 | 1 | v1 · c1 · h1 | medium | 5/5 | yes | $0.402 | 119,747 | 720 |
| 2026-10-07 | Grinder | Pareto 26.10 Preview | unbiased | 2026-10-01 | 2 | v1 · c1 · h1 | medium | 4/5 | yes | $0.137 | 38,025 | 192 |
| 2026-10-07 | Grinder | Pareto 26.10 Preview | unbiased | 2026-10-01 | 3 | v1 · c1 · h1 | medium | 4/5 | yes | $0.256 | 66,266 | 379 |
| 2026-10-07 | Portafilter | GPT-6.1 Sol | OpenAI | 2026-09-29 | 1 | v1 · c1 · h1 | medium | 5/5 | yes | $0.064 | 4,820 | 92 |
| 2026-10-07 | Portafilter | GPT-6.1 Sol | OpenAI | 2026-09-29 | 2 | v1 · c1 · h1 | medium | 5/5 | yes | $0.093 | 5,912 | 128 |
| 2026-10-07 | Portafilter | GPT-6.1 Sol | OpenAI | 2026-09-29 | 3 | v1 · c1 · h1 | medium | 5/5 | yes | $0.082 | 5,742 | 124 |
| 2026-10-07 | Portafilter | Mistral Large 4 | Mistral | 2026-10-06 | 2 | v1 · c1 · h1 | medium | 3/5 | $0.046 | 12,554 | 258 | |
| 2026-10-07 | Portafilter | Pareto 26.10 Preview | unbiased | 2026-10-01 | 1 | v1 · c1 · h1 | medium | 5/5 | yes | $0.235 | 58,264 | 409 |
| 2026-10-07 | Portafilter | Pareto 26.10 Preview | unbiased | 2026-10-01 | 2 | v1 · c1 · h1 | medium | 5/5 | yes | $0.152 | 37,175 | 327 |
| 2026-10-07 | Portafilter | Pareto 26.10 Preview | unbiased | 2026-10-01 | 3 | v1 · c1 · h1 | medium | 2/5 | yes | $0.139 | 36,466 | 205 |
| 2026-10-07 | V60 | GPT-6.1 Sol | OpenAI | 2026-09-29 | 1 | v1 · c1 · h1 | medium | 5/5 | yes | $0.073 | 4,944 | 103 |
| 2026-10-07 | V60 | GPT-6.1 Sol | OpenAI | 2026-09-29 | 2 | v1 · c1 · h1 | medium | 5/5 | yes | $0.070 | 4,835 | 101 |
| 2026-10-07 | V60 | GPT-6.1 Sol | OpenAI | 2026-09-29 | 3 | v1 · c1 · h1 | medium | 5/5 | yes | $0.072 | 5,068 | 101 |
| 2026-10-07 | V60 | Pareto 26.10 Preview | unbiased | 2026-10-01 | 1 | v1 · c1 · h1 | medium | 5/5 | yes | $0.257 | 60,788 | 375 |
| 2026-10-07 | V60 | Pareto 26.10 Preview | unbiased | 2026-10-01 | 2 | v1 · c1 · h1 | medium | 4/5 | yes | $0.126 | 34,179 | 192 |
| 2026-10-07 | V60 | Pareto 26.10 Preview | unbiased | 2026-10-01 | 3 | v1 · c1 · h1 | medium | 4/5 | yes | $0.173 | 42,385 | 255 |
| 2026-10-07 | French press | Mistral Large 4 | Mistral | 2026-10-06 | 2 | v2 · c1 · h1 | medium | 4/5 | $0.072 | 20,016 | 720 | |
| 2026-10-07 | French press | Mistral Large 4 | Mistral | 2026-10-06 | 3 | v2 · c1 · h1 | medium | 4/5 | $0.140 | 20,335 | 588 | |
| 2026-10-05 | AeroPress | GPT-6 Luna | OpenAI | 2026-09-22 | 1 | v1 · c1 · h1 | medium | 3/5 | yes | $0.004 | 6,030 | 79 |
| 2026-10-05 | AeroPress | GPT-6 Luna | OpenAI | 2026-09-22 | 2 | v1 · c1 · h1 | medium | 3/5 | yes | $0.003 | 4,334 | 52 |
| 2026-10-05 | AeroPress | GPT-6 Luna | OpenAI | 2026-09-22 | 3 | v1 · c1 · h1 | medium | 4/5 | yes | $0.004 | 5,244 | 58 |
| 2026-10-05 | Grinder | GPT-6 Luna | OpenAI | 2026-09-22 | 1 | v1 · c1 · h1 | medium | 2/5 | yes | $0.006 | 8,712 | 112 |
| 2026-10-05 | Grinder | GPT-6 Luna | OpenAI | 2026-09-22 | 2 | v1 · c1 · h1 | medium | 3/5 | yes | $0.005 | 6,978 | 78 |
| 2026-10-05 | Grinder | GPT-6 Luna | OpenAI | 2026-09-22 | 3 | v1 · c1 · h1 | medium | 3/5 | yes | $0.004 | 5,688 | 66 |
| 2026-10-05 | Portafilter | GPT-6 Luna | OpenAI | 2026-09-22 | 1 | v1 · c1 · h1 | medium | 3/4 | yes | $0.004 | 5,239 | 70 |
| 2026-10-05 | Portafilter | GPT-6 Luna | OpenAI | 2026-09-22 | 2 | v1 · c1 · h1 | medium | 3/4 | yes | $0.013 | 13,376 | 226 |
| 2026-10-05 | Portafilter | GPT-6 Luna | OpenAI | 2026-09-22 | 3 | v1 · c1 · h1 | medium | 5/5 | yes | $0.004 | 5,543 | 71 |
| 2026-10-05 | V60 | GPT-6 Luna | OpenAI | 2026-09-22 | 1 | v1 · c1 · h1 | medium | 5/5 | yes | $0.004 | 5,503 | 75 |
| 2026-10-05 | V60 | GPT-6 Luna | OpenAI | 2026-09-22 | 2 | v1 · c1 · h1 | medium | 4/5 | yes | $0.004 | 5,157 | 73 |
| 2026-10-05 | V60 | GPT-6 Luna | OpenAI | 2026-09-22 | 3 | v1 · c1 · h1 | medium | 5/5 | yes | $0.003 | 4,972 | 65 |
| 2026-10-05 | Espresso Rag | GPT-6 Luna | OpenAI | 2026-09-22 | 1 | v1 · c1 · h1 | medium | 4/6 | yes | $0.003 | 4,357 | 61 |
| 2026-10-05 | Espresso Rag | GPT-6 Luna | OpenAI | 2026-09-22 | 2 | v1 · c1 · h1 | medium | 4/6 | yes | $0.011 | 13,550 | 196 |
| 2026-10-05 | Espresso Rag | GPT-6 Luna | OpenAI | 2026-09-22 | 3 | v1 · c1 · h1 | medium | 4/6 | yes | $0.003 | 4,898 | 65 |
| 2026-10-05 | Espresso Rag | Pareto 26.10 Preview | unbiased | 2026-10-01 | 1 | v1 · c1 · h1 | medium | 6/6 | yes | $0.138 | 37,476 | 402 |
| 2026-10-05 | Espresso Rag | Pareto 26.10 Preview | unbiased | 2026-10-01 | 2 | v1 · c1 · h1 | medium | 4/6 | yes | $0.163 | 46,907 | 267 |
| 2026-10-05 | Espresso Rag | Pareto 26.10 Preview | unbiased | 2026-10-01 | 3 | v1 · c1 · h1 | medium | 6/6 | yes | $0.114 | 29,909 | 272 |
| 2026-10-04 | Espresso Rag | GPT-6.1 Sol | OpenAI | 2026-09-29 | 1 | v1 · c1 · h1 | medium | 6/6 | yes | $0.038 | 2,340 | 69 |
| 2026-10-04 | Espresso Rag | GPT-6.1 Sol | OpenAI | 2026-09-29 | 2 | v1 · c1 · h1 | medium | 6/6 | yes | $0.028 | 1,961 | 58 |
| 2026-10-04 | Espresso Rag | GPT-6.1 Sol | OpenAI | 2026-09-29 | 3 | v1 · c1 · h1 | medium | 6/6 | yes | $0.048 | 2,611 | 85 |
| 2026-10-04 | French press | Ember 1 | Fireworks | 2026-09-24 | 1 | v2 · c1 · h1 | medium | 2/5 | $0.105 | 2,516 | 35 | |
| 2026-10-04 | French press | Ember 1 | Fireworks | 2026-09-24 | 2 | v2 · c1 · h1 | medium | 3/4 | $0.108 | 2,820 | 40 | |
| 2026-10-04 | French press | Gemini 3.8 Flash | 2026-09-02 | 2 | v2 · c1 · h1 | medium | 5/5 | $0.791 | 88,063 | 665 | ||
| 2026-10-04 | French press | GPT-6 Sol | OpenAI | 2026-09-22 | 1 | v2 · c1 · h1 | medium | 5/5 | $0.101 | 7,199 | 80 | |
| 2026-10-04 | French press | Grok 4.7 | SpaceXAI | 2026-09-21 | 1 | v2 · c1 · h1 | medium | 2/5 | $0.781 | 37,039 | 511 | |
| 2026-10-04 | French press | Kimi K3 | MoonshotAI | 2026-07-16 | 1 | v2 · c1 · h1 | medium | 2/4 | $0.087 | 3,398 | 31 | |
| 2026-10-03 | Pruned shrub | Command A+ | Cohere | 2026-09-22 | 1 | v1 · c2 · h1 | medium | 0/3 | yes | $0.173 | 77,060 | 491 |
| 2026-10-03 | Pruned shrub | Command A+ | Cohere | 2026-09-22 | 2 | v1 · c2 · h1 | medium | 2/3 | yes | $0.024 | 6,623 | 60 |
| 2026-10-03 | Pruned shrub | Command A+ | Cohere | 2026-09-22 | 3 | v1 · c2 · h1 | medium | 2/3 | yes | $0.091 | 13,048 | 156 |
| 2026-10-03 | Pruned shrub | GLM 5.3 FlashX | Z.ai | 2026-09-18 | 1 | v1 · c2 · h1 | medium | 1/3 | yes | $0.028 | 5,769 | 170 |
| 2026-10-03 | Pruned shrub | GLM 5.3 FlashX | Z.ai | 2026-09-18 | 2 | v1 · c2 · h1 | medium | 2/3 | yes | $0.029 | 5,878 | 168 |
| 2026-10-03 | Pruned shrub | GLM 5.3 FlashX | Z.ai | 2026-09-18 | 3 | v1 · c2 · h1 | medium | 0/3 | yes | $0.037 | 8,956 | 191 |
| 2026-10-03 | Pruned shrub | GPT-5.6 Sol | OpenAI | 2026-07-09 | 1 | v1 · c2 · h1 | medium | 2/3 | $0.249 | 5,640 | 126 | |
| 2026-10-03 | Pruned shrub | GPT-5.6 Sol | OpenAI | 2026-07-09 | 2 | v1 · c2 · h1 | medium | 0/3 | $0.336 | 6,148 | 207 | |
| 2026-10-03 | Pruned shrub | GPT-6.1 Sol | OpenAI | 2026-09-29 | 1 | v1 · c2 · h1 | medium | 3/3 | $0.068 | 4,141 | 127 | |
| 2026-10-03 | Pruned shrub | GPT-6.1 Sol | OpenAI | 2026-09-29 | 2 | v1 · c2 · h1 | medium | 2/3 | $0.054 | 3,603 | 116 | |
| 2026-10-03 | Pruned shrub | Pareto | unbiased | 1 | v1 · c2 · h1 | medium | 3/3 | $0.194 | 15,483 | 212 | ||
| 2026-10-03 | Pruned shrub | Pareto 26.10 Preview | unbiased | 2026-10-01 | 1 | v1 · c2 · h1 | medium | 3/3 | $0.081 | 18,474 | 214 | |
| 2026-10-03 | Pruned shrub | Perceptron Mk1.5 | Perceptron | 2026-09-25 | 1 | v1 · c2 · h1 | medium | 0/3 | yes | $0.023 | 10,081 | 73 |
| 2026-10-03 | Pruned shrub | Perceptron Mk1.5 | Perceptron | 2026-09-25 | 2 | v1 · c2 · h1 | medium | 0/3 | yes | $0.023 | 10,081 | 65 |
| 2026-10-03 | Pruned shrub | Perceptron Mk1.5 | Perceptron | 2026-09-25 | 3 | v1 · c2 · h1 | medium | 0/3 | yes | $0.023 | 10,081 | 66 |
| 2026-10-03 | Pruned shrub | Qwen3.8 27B | Qwen | 2026-08-14 | 1 | v1 · c2 · h1 | medium | 3/3 | $0.113 | 29,237 | 360 | |
| 2026-10-03 | Pruned shrub | Qwen3.8 27B | Qwen | 2026-08-14 | 2 | v1 · c2 · h1 | medium | 2/3 | $0.076 | 22,606 | 267 | |
| 2026-10-03 | Pruned shrub | Qwen3.8 Max | Qwen | 2026-09-03 | 1 | v1 · c2 · h1 | medium | 2/3 | $0.303 | 26,560 | 720 | |
| 2026-10-03 | Pruned shrub | Qwen3.8 Max Prime | Qwen | 2026-09-23 | 1 | v1 · c2 · h1 | medium | 0/3 | $0.364 | 16,085 | 247 | |
| 2026-10-03 | Pruned shrub | Qwen3.8 Max Prime | Qwen | 2026-09-23 | 2 | v1 · c2 · h1 | medium | 0/3 | $0.133 | 5,913 | 143 | |
| 2026-10-03 | French press | DeepSeek 4.1 Flash | DeepSeek | 2026-09-10 | 1 | v2 · c1 · h1 | medium | 3/5 | $0.072 | 32,213 | 462 | |
| 2026-10-03 | French press | GPT-6 Luna | OpenAI | 2026-09-22 | 1 | v2 · c1 · h1 | medium | 4/5 | yes | $0.005 | 6,695 | 87 |
| 2026-10-03 | French press | GPT-6 Luna | OpenAI | 2026-09-22 | 2 | v2 · c1 · h1 | medium | 5/5 | yes | $0.004 | 4,831 | 58 |
| 2026-10-03 | French press | GPT-6 Luna | OpenAI | 2026-09-22 | 3 | v2 · c1 · h1 | medium | 2/5 | yes | $0.003 | 5,065 | 56 |
| 2026-10-03 | Venn | Gemini 3.8 Flash | 2026-09-02 | 1 | v1 · c2 · h1 | medium | 4/4 | $0.307 | 48,047 | 371 | ||
| 2026-10-03 | Venn | MiMo v2.6 Pro | Xiaomi | 2026-09-21 | 1 | v1 · c2 · h1 | medium | 2/4 | $0.102 | 35,818 | 720 | |
| 2026-10-02 | Café order | Pareto 26.10 Preview | unbiased | 2026-10-01 | 1 | v1 · c1 · h1 | medium | 5/5 | $0.043 | 11,713 | 72 | |
| 2026-10-02 | Café order | Pareto 26.10 Preview | unbiased | 2026-10-01 | 2 | v1 · c1 · h1 | medium | 5/5 | $0.037 | 8,726 | 59 | |
| 2026-10-02 | Café order | Pareto 26.10 Preview | unbiased | 2026-10-01 | 3 | v1 · c1 · h1 | medium | 5/5 | $0.024 | 6,165 | 45 | |
| 2026-10-02 | Fluorocaffeine | Claude Sonnet 5.5 | Anthropic | 2026-09-28 | 1 | v1 · c1 · h1 | medium | 4/4 | $0.013 | 407 | 9 | |
| 2026-10-02 | Fluorocaffeine | Claude Sonnet 5.5 | Anthropic | 2026-09-28 | 2 | v1 · c1 · h1 | medium | 4/4 | $0.013 | 382 | 9 | |
| 2026-10-02 | Fluorocaffeine | Claude Sonnet 5.5 | Anthropic | 2026-09-28 | 3 | v1 · c1 · h1 | medium | 4/4 | $0.013 | 399 | 9 | |
| 2026-10-02 | Triangle wave | GPT-6.1 Sol | OpenAI | 2026-09-29 | 1 | v1 · c1 · h1 | medium | 4/4 | $0.029 | 1,749 | 64 | |
| 2026-10-02 | Triangle wave | GPT-6.1 Sol | OpenAI | 2026-09-29 | 2 | v1 · c1 · h1 | medium | 4/4 | $0.031 | 1,703 | 67 | |
| 2026-10-02 | Triangle wave | GPT-6.1 Sol | OpenAI | 2026-09-29 | 3 | v1 · c1 · h1 | medium | 4/4 | $0.029 | 1,881 | 66 | |
| 2026-10-02 | French press | Pareto 26.10 Preview | unbiased | 2026-10-01 | 1 | v2 · c1 · h1 | 5/5 | yes | $0.114 | |||
| 2026-10-02 | French press | Pareto 26.10 Preview | unbiased | 2026-10-01 | 2 | v2 · c1 · h1 | 3/5 | yes | $0.086 | |||
| 2026-10-02 | French press | Pareto 26.10 Preview | unbiased | 2026-10-01 | 3 | v2 · c1 · h1 | 5/5 | yes | $0.130 | |||
| 2026-10-02 | Penrose floor | GPT-6.1 Sol | OpenAI | 2026-09-29 | 1 | v1 · c1 · h1 | medium | 3/3 | $0.096 | 7,186 | 159 | |
| 2026-10-02 | Penrose floor | GPT-6.1 Sol | OpenAI | 2026-09-29 | 2 | v1 · c1 · h1 | medium | 3/3 | $0.088 | 6,406 | 139 | |
| 2026-10-02 | Penrose floor | GPT-6.1 Sol | OpenAI | 2026-09-29 | 3 | v1 · c1 · h1 | medium | 3/3 | $0.080 | 6,183 | 127 | |
| 2026-10-02 | Penrose floor | Pareto 26.10 Preview | unbiased | 2026-10-01 | 1 | v1 · c1 · h1 | medium | 3/3 | $0.367 | 104,241 | 590 | |
| 2026-10-02 | Penrose floor | Pareto 26.10 Preview | unbiased | 2026-10-01 | 2 | v1 · c1 · h1 | medium | 3/3 | $0.297 | 85,890 | 462 | |
| 2026-10-02 | Penrose floor | Pareto 26.10 Preview | unbiased | 2026-10-01 | 3 | v1 · c1 · h1 | medium | 3/3 | $0.166 | 44,480 | 295 | |
| 2026-10-01 | French press | Opus 5.5 | Anthropic | 2026-09-22 | 1 | v2 · c1 · h1 | 4/5 | $0.231 | ||||
| 2026-10-01 | French press | Opus 5.5 | Anthropic | 2026-09-22 | 2 | v2 · c1 · h1 | 5/5 | $0.163 | ||||
| 2026-10-01 | French press | Pareto | unbiased | 1 | v2 · c1 · h1 | 5/5 | $0.467 | |||||
| 2026-10-01 | French press | Pareto | unbiased | 2 | v2 · c1 · h1 | 3/5 | $0.217 | |||||
| 2026-09-29 | Pruned shrub | Claude Sonnet 5.5 | Anthropic | 2026-09-28 | 1 | v1 · c2 · h1 | medium | 2/3 | yes | $0.088 | 4,080 | 74 |
| 2026-09-29 | Pruned shrub | Claude Sonnet 5.5 | Anthropic | 2026-09-28 | 2 | v1 · c2 · h1 | medium | 1/3 | yes | $0.124 | 5,686 | 91 |
| 2026-09-29 | Pruned shrub | Claude Sonnet 5.5 | Anthropic | 2026-09-28 | 3 | v1 · c2 · h1 | medium | 3/3 | yes | $0.049 | 2,809 | 47 |
| 2026-09-29 | Pruned shrub | DeepSeek 4.1 Flash | DeepSeek | 2026-09-10 | 1 | v1 · c2 · h1 | medium | 3/3 | yes | $0.266 | 62,494 | 718 |
| 2026-09-29 | Pruned shrub | DeepSeek 4.1 Flash | DeepSeek | 2026-09-10 | 2 | v1 · c2 · h1 | medium | 2/3 | yes | $0.315 | 60,118 | 720 |
| 2026-09-29 | Pruned shrub | DeepSeek 4.1 Flash | DeepSeek | 2026-09-10 | 3 | v1 · c2 · h1 | medium | 0/3 | yes | $0.177 | 60,079 | 613 |
| 2026-09-29 | Pruned shrub | Gemini 3.8 Flash | 2026-09-02 | 1 | v1 · c2 · h1 | medium | 0/3 | $0.451 | 46,823 | 471 | ||
| 2026-09-29 | Pruned shrub | Gemini 3.8 Flash | 2026-09-02 | 2 | v1 · c2 · h1 | medium | 0/3 | $0.679 | 64,282 | 637 | ||
| 2026-09-29 | Pruned shrub | GPT-6 Luna | OpenAI | 2026-09-22 | 1 | v1 · c2 · h1 | medium | 2/3 | yes | $0.010 | 13,249 | 185 |
| 2026-09-29 | Pruned shrub | GPT-6 Luna | OpenAI | 2026-09-22 | 2 | v1 · c2 · h1 | medium | 2/3 | yes | $0.009 | 11,626 | 174 |
| 2026-09-29 | Pruned shrub | GPT-6 Luna | OpenAI | 2026-09-22 | 3 | v1 · c2 · h1 | medium | 2/3 | yes | $0.008 | 9,937 | 245 |
| 2026-09-29 | Pruned shrub | Opus 5.5 | Anthropic | 2026-09-22 | 1 | v1 · c2 · h1 | medium | 2/3 | yes | $0.092 | 3,593 | 66 |
| 2026-09-29 | Pruned shrub | Opus 5.5 | Anthropic | 2026-09-22 | 2 | v1 · c2 · h1 | medium | 2/3 | yes | $0.093 | 3,287 | 68 |
| 2026-09-29 | Pruned shrub | Opus 5.5 | Anthropic | 2026-09-22 | 3 | v1 · c2 · h1 | medium | 1/3 | yes | $0.134 | 4,724 | 97 |
| 2026-09-29 | Pruned shrub | Qwen3.8 Flash | Qwen | 2026-08-26 | 2 | v1 · c2 · h1 | medium | 2/3 | $0.043 | 37,532 | 720 | |
| 2026-09-29 | French press | Claude Sonnet 5.5 | Anthropic | 2026-09-28 | 1 | v2 · c1 · h1 | medium | 5/5 | yes | $0.064 | 3,884 | 36 |
| 2026-09-29 | French press | Claude Sonnet 5.5 | Anthropic | 2026-09-28 | 2 | v2 · c1 · h1 | medium | 5/5 | yes | $0.045 | 3,081 | 28 |
| 2026-09-29 | French press | Claude Sonnet 5.5 | Anthropic | 2026-09-28 | 3 | v2 · c1 · h1 | medium | 3/5 | yes | $0.037 | 2,419 | 24 |
| 2026-09-29 | Venn | Claude Sonnet 5.5 | Anthropic | 2026-09-28 | 1 | v1 · c2 · h1 | medium | 4/4 | $0.062 | 3,132 | 34 | |
| 2026-09-29 | Venn | Claude Sonnet 5.5 | Anthropic | 2026-09-28 | 2 | v1 · c2 · h1 | medium | 4/4 | $0.072 | 2,684 | 35 | |
| 2026-09-29 | Venn | Claude Sonnet 5.5 | Anthropic | 2026-09-28 | 3 | v1 · c2 · h1 | medium | 1/4 | $0.045 | 2,103 | 27 | |
| 2026-09-29 | Venn | Opus 5.5 | Anthropic | 2026-09-22 | 1 | v1 · c2 · h1 | medium | 4/4 | $0.093 | 1,838 | 50 | |
| 2026-09-29 | Venn | Opus 5.5 | Anthropic | 2026-09-22 | 2 | v1 · c2 · h1 | medium | 4/4 | $0.095 | 2,090 | 54 | |
| 2026-09-29 | Venn | Opus 5.5 | Anthropic | 2026-09-22 | 3 | v1 · c2 · h1 | medium | 4/4 | $0.054 | 1,277 | 33 | |
| 2026-09-27 | French press | Command A+ | Cohere | 2026-09-22 | 1 | v2 · c1 · h1 | medium | 0/5 | yes | $0.025 | 13,061 | 62 |
| 2026-09-27 | French press | Command A+ | Cohere | 2026-09-22 | 2 | v2 · c1 · h1 | medium | 0/5 | yes | $0.040 | 7,431 | 48 |
| 2026-09-27 | French press | Command A+ | Cohere | 2026-09-22 | 3 | v2 · c1 · h1 | medium | 0/5 | yes | $0.021 | 12,526 | 63 |
| 2026-09-27 | French press | Perceptron Mk1.5 | Perceptron | 2026-09-25 | 1 | v2 · c1 · h1 | medium | 0/5 | yes | $0.059 | 12,466 | 114 |
| 2026-09-27 | French press | Perceptron Mk1.5 | Perceptron | 2026-09-25 | 2 | v2 · c1 · h1 | medium | 0/5 | yes | $0.098 | 28,675 | 181 |
| 2026-09-27 | French press | Perceptron Mk1.5 | Perceptron | 2026-09-25 | 3 | v2 · c1 · h1 | medium | 0/5 | yes | $0.059 | 13,123 | 103 |
| 2026-09-27 | Venn | Command A+ | Cohere | 2026-09-22 | 1 | v1 · c2 · h1 | medium | 2/4 | $0.075 | 18,330 | 135 | |
| 2026-09-27 | Venn | Command A+ | Cohere | 2026-09-22 | 2 | v1 · c2 · h1 | medium | 3/4 | $0.057 | 20,972 | 111 | |
| 2026-09-27 | Venn | Command A+ | Cohere | 2026-09-22 | 3 | v1 · c2 · h1 | medium | 2/4 | $0.034 | 11,801 | 79 | |
| 2026-09-27 | Venn | GPT-6 Sol | OpenAI | 2026-09-22 | 1 | v1 · c2 · h1 | medium | 4/4 | $0.056 | 3,173 | 54 | |
| 2026-09-27 | Venn | GPT-6 Sol | OpenAI | 2026-09-22 | 2 | v1 · c2 · h1 | medium | 4/4 | $0.067 | 3,738 | 62 | |
| 2026-09-27 | Venn | GPT-6 Sol | OpenAI | 2026-09-22 | 3 | v1 · c2 · h1 | medium | 4/4 | $0.042 | 2,711 | 50 | |
| 2026-09-27 | Venn | GPT-6 Sol | OpenAI | 2026-09-22 | 4 | v1 · c2 · h1 | medium | 3/4 | $0.113 | 6,259 | 112 | |
| 2026-09-27 | Venn | GPT-6 Sol | OpenAI | 2026-09-22 | 5 | v1 · c2 · h1 | medium | 4/4 | $0.059 | 3,617 | 66 | |
| 2026-09-27 | Venn | GPT-6 Sol | OpenAI | 2026-09-22 | 6 | v1 · c2 · h1 | medium | 4/4 | $0.046 | 2,727 | 46 | |
| 2026-09-27 | Venn | GPT-6 Sol | OpenAI | 2026-09-22 | 7 | v1 · c2 · h1 | medium | 4/4 | $0.049 | 3,064 | 54 | |
| 2026-09-27 | Venn | GPT-6 Sol | OpenAI | 2026-09-22 | 8 | v1 · c2 · h1 | medium | 4/4 | $0.050 | 2,953 | 53 | |
| 2026-09-27 | Venn | GPT-6 Sol | OpenAI | 2026-09-22 | 9 | v1 · c2 · h1 | medium | 4/4 | $0.090 | 4,837 | 88 | |
| 2026-09-27 | Venn | GPT-6 Sol | OpenAI | 2026-09-22 | 10 | v1 · c2 · h1 | medium | 4/4 | $0.063 | 4,023 | 68 | |
| 2026-09-27 | Venn | Perceptron Mk1.5 | Perceptron | 2026-09-25 | 1 | v1 · c2 · h1 | medium | 2/4 | $0.106 | 23,839 | 210 | |
| 2026-09-27 | Venn | Perceptron Mk1.5 | Perceptron | 2026-09-25 | 2 | v1 · c2 · h1 | medium | 2/4 | $0.048 | 6,784 | 85 | |
| 2026-09-27 | Venn | Perceptron Mk1.5 | Perceptron | 2026-09-25 | 3 | v1 · c2 · h1 | medium | 2/4 | $0.169 | 26,547 | 241 | |
| 2026-09-25 | Pruned shrub | Qwen3.8 Max Prime | Qwen | 2026-09-23 | 1 | v1 · c1 · h1 | medium | 1/3 | $0.711 | 23,671 | 365 | |
| 2026-09-25 | Pruned shrub | Qwen3.8 Max Prime | Qwen | 2026-09-23 | 2 | v1 · c1 · h1 | medium | 1/3 | $0.644 | 28,354 | 388 | |
| 2026-09-25 | Pruned shrub | Qwen3.8 Max Prime | Qwen | 2026-09-23 | 3 | v1 · c1 · h1 | medium | 3/3 | $0.685 | 25,434 | 388 | |
| 2026-09-25 | Venn | Ember 1 | Fireworks | 2026-09-24 | 1 | v1 · c2 · h1 | medium | 3/4 | $0.042 | 1,321 | 22 | |
| 2026-09-25 | Venn | Ember 1 | Fireworks | 2026-09-24 | 2 | v1 · c2 · h1 | medium | 3/4 | $0.044 | 1,282 | 20 | |
| 2026-09-25 | Venn | Ember 1 | Fireworks | 2026-09-24 | 3 | v1 · c2 · h1 | medium | 3/4 | $0.036 | 1,026 | 17 | |
| 2026-09-25 | Venn | Gemini 3.8 Flash | 2026-09-02 | 1 | v1 · c2 · h1 | medium | 4/4 | $0.205 | 34,370 | 239 | ||
| 2026-09-25 | Venn | Gemini 3.8 Flash | 2026-09-02 | 2 | v1 · c2 · h1 | medium | 4/4 | $0.263 | 36,490 | 295 | ||
| 2026-09-25 | Venn | GLM 5.3 FlashX | Z.ai | 2026-09-18 | 1 | v1 · c2 · h1 | medium | 3/4 | $0.013 | 2,773 | 72 | |
| 2026-09-25 | Venn | GLM 5.3 FlashX | Z.ai | 2026-09-18 | 2 | v1 · c2 · h1 | medium | 3/4 | $0.011 | 2,200 | 58 | |
| 2026-09-25 | Venn | GLM 5.3 FlashX | Z.ai | 2026-09-18 | 3 | v1 · c2 · h1 | medium | 4/4 | $0.007 | 1,810 | 39 | |
| 2026-09-25 | Venn | GPT-6 Luna | OpenAI | 2026-09-22 | 1 | v1 · c2 · h1 | medium | 3/4 | $0.005 | 7,354 | 91 | |
| 2026-09-25 | Venn | GPT-6 Luna | OpenAI | 2026-09-22 | 2 | v1 · c2 · h1 | medium | 3/4 | $0.005 | 7,577 | 90 | |
| 2026-09-25 | Venn | GPT-6 Luna | OpenAI | 2026-09-22 | 3 | v1 · c2 · h1 | medium | 3/4 | $0.008 | 9,776 | 112 | |
| 2026-09-25 | Venn | GPT-6 Sol | OpenAI | 2026-09-22 | 1 | v1 · c2 · h1 | medium | 4/4 | $0.063 | 3,000 | 78 | |
| 2026-09-25 | Venn | GPT-6 Sol | OpenAI | 2026-09-22 | 2 | v1 · c2 · h1 | medium | 3/4 | $0.066 | 4,489 | 93 | |
| 2026-09-25 | Venn | GPT-6 Sol | OpenAI | 2026-09-22 | 3 | v1 · c2 · h1 | medium | 4/4 | $0.056 | 3,273 | 82 | |
| 2026-09-25 | Venn | Grok 4.7 | SpaceXAI | 2026-09-21 | 1 | v1 · c2 · h1 | medium | 3/4 | $0.146 | 14,510 | 209 | |
| 2026-09-25 | Venn | Grok 4.7 | SpaceXAI | 2026-09-21 | 2 | v1 · c2 · h1 | medium | 2/4 | $0.498 | 28,175 | 426 | |
| 2026-09-25 | Venn | Grok 4.7 | SpaceXAI | 2026-09-21 | 3 | v1 · c2 · h1 | medium | 3/4 | $0.131 | 9,109 | 159 | |
| 2026-09-25 | Venn | Kimi K3 | MoonshotAI | 2026-07-16 | 1 | v1 · c2 · h1 | medium | 3/4 | $0.077 | 2,121 | 35 | |
| 2026-09-25 | Venn | Kimi K3 | MoonshotAI | 2026-07-16 | 2 | v1 · c2 · h1 | medium | 3/4 | $0.037 | 913 | 21 | |
| 2026-09-25 | Venn | Kimi K3 | MoonshotAI | 2026-07-16 | 3 | v1 · c2 · h1 | medium | 3/4 | $0.058 | 2,455 | 63 | |
| 2026-09-25 | Venn | MiMo v2.6 Pro | Xiaomi | 2026-09-21 | 1 | v1 · c2 · h1 | medium | 3/4 | $0.007 | 3,936 | 720 | |
| 2026-09-25 | Venn | MiMo v2.6 Pro | Xiaomi | 2026-09-21 | 2 | v1 · c2 · h1 | medium | 3/4 | $0.006 | 4,073 | 720 | |
| 2026-09-23 | French press | Opus 5.5 | Anthropic | 2026-09-22 | 1 | v2 · c1 · h1 | medium | 4/5 | yes | $0.211 | 7,230 | 85 |
| 2026-09-23 | French press | Opus 5.5 | Anthropic | 2026-09-22 | 2 | v2 · c1 · h1 | medium | 4/5 | yes | $0.208 | 7,514 | 83 |
| 2026-09-23 | French press | Opus 5.5 | Anthropic | 2026-09-22 | 3 | v2 · c1 · h1 | medium | 3/5 | yes | $0.221 | 8,012 | 88 |
| 2026-09-23 | Venn | Qwen3.8 Flash | Qwen | 2026-08-26 | 1 | v1 · c2 · h1 | medium | 4/4 | $0.037 | 37,456 | 578 | |
| 2026-09-23 | Venn | Qwen3.8 Flash | Qwen | 2026-08-26 | 2 | v1 · c2 · h1 | medium | 4/4 | $0.029 | 25,413 | 496 | |
| 2026-09-23 | Venn | Qwen3.8 Flash | Qwen | 2026-08-26 | 3 | v1 · c2 · h1 | medium | 4/4 | $0.044 | 41,553 | 720 | |
| 2026-09-22 | Café order | DeepSeek 4.1 Flash | DeepSeek | 2026-09-10 | 1 | v1 · c1 · h1 | medium | 5/5 | $0.011 | 5,406 | 98 | |
| 2026-09-22 | Café order | DeepSeek 4.1 Flash | DeepSeek | 2026-09-10 | 2 | v1 · c1 · h1 | medium | 5/5 | $0.011 | 4,690 | 89 | |
| 2026-09-22 | Café order | DeepSeek 4.1 Flash | DeepSeek | 2026-09-10 | 3 | v1 · c1 · h1 | medium | 5/5 | $0.010 | 4,411 | 79 | |
| 2026-09-22 | Caffeine | DeepSeek 4.1 Flash | DeepSeek | 2026-09-10 | 1 | v1 · c1 · h1 | medium | 5/5 | $0.070 | 35,386 | 429 | |
| 2026-09-22 | Caffeine | DeepSeek 4.1 Flash | DeepSeek | 2026-09-10 | 2 | v1 · c1 · h1 | medium | 5/5 | $0.043 | 20,822 | 217 | |
| 2026-09-22 | Caffeine | DeepSeek 4.1 Flash | DeepSeek | 2026-09-10 | 3 | v1 · c1 · h1 | medium | 5/5 | $0.032 | 14,458 | 146 | |
| 2026-09-22 | Fluorocaffeine | DeepSeek 4.1 Flash | DeepSeek | 2026-09-10 | 1 | v1 · c1 · h1 | medium | 4/4 | $0.017 | 9,084 | 104 | |
| 2026-09-22 | Fluorocaffeine | DeepSeek 4.1 Flash | DeepSeek | 2026-09-10 | 2 | v1 · c1 · h1 | medium | 4/4 | $0.013 | 6,113 | 69 | |
| 2026-09-22 | Fluorocaffeine | DeepSeek 4.1 Flash | DeepSeek | 2026-09-10 | 3 | v1 · c1 · h1 | medium | 4/4 | $0.022 | 11,637 | 191 | |
| 2026-09-22 | Triangle wave | DeepSeek 4.1 Flash | DeepSeek | 2026-09-10 | 1 | v1 · c1 · h1 | medium | 4/4 | $0.051 | 28,702 | 405 | |
| 2026-09-22 | Triangle wave | DeepSeek 4.1 Flash | DeepSeek | 2026-09-10 | 2 | v1 · c1 · h1 | medium | 4/4 | $0.036 | 18,853 | 375 | |
| 2026-09-22 | Triangle wave | DeepSeek 4.1 Flash | DeepSeek | 2026-09-10 | 3 | v1 · c1 · h1 | medium | 4/4 | $0.054 | 26,345 | 483 | |
| 2026-09-22 | French press | DeepSeek 4.1 Flash | DeepSeek | 2026-09-10 | 1 | v2 · c1 · h1 | medium | 4/4 | yes | $0.042 | 23,281 | 432 |
| 2026-09-22 | French press | DeepSeek 4.1 Flash | DeepSeek | 2026-09-10 | 2 | v2 · c1 · h1 | medium | 5/5 | yes | $0.032 | 17,841 | 567 |
| 2026-09-22 | French press | GLM 5.3 FlashX | Z.ai | 2026-09-18 | 1 | v2 · c1 · h1 | medium | 3/4 | yes | $0.020 | 6,255 | 104 |
| 2026-09-22 | French press | GLM 5.3 FlashX | Z.ai | 2026-09-18 | 2 | v2 · c1 · h1 | medium | 3/5 | yes | $0.011 | 3,660 | 64 |
| 2026-09-22 | French press | GLM 5.3 FlashX | Z.ai | 2026-09-18 | 3 | v2 · c1 · h1 | medium | 2/5 | yes | $0.019 | 6,443 | 314 |
| 2026-09-22 | French press | GPT-5.6 Sol | OpenAI | 2026-07-09 | 1 | v2 · c1 · h1 | medium | 4/5 | yes | $0.274 | 6,397 | 98 |
| 2026-09-22 | French press | GPT-5.6 Sol | OpenAI | 2026-07-09 | 2 | v2 · c1 · h1 | medium | 4/5 | yes | $0.176 | 4,488 | 62 |
| 2026-09-22 | French press | GPT-5.6 Sol | OpenAI | 2026-07-09 | 3 | v2 · c1 · h1 | medium | 4/5 | yes | $0.209 | 5,375 | 85 |
| 2026-09-22 | French press | Pareto | unbiased | 1 | v2 · c1 · h1 | medium | 5/5 | yes | $0.356 | 32,364 | 294 | |
| 2026-09-22 | French press | Pareto | unbiased | 2 | v2 · c1 · h1 | medium | 5/5 | yes | $0.372 | 34,385 | 200 | |
| 2026-09-22 | French press | Pareto | unbiased | 3 | v2 · c1 · h1 | medium | 3/5 | yes | $0.453 | 52,976 | 841 | |
| 2026-09-22 | French press | Qwen3.8 27B | Qwen | 2026-08-14 | 1 | v2 · c1 · h1 | medium | 3/5 | yes | $0.041 | 10,660 | 194 |
| 2026-09-22 | French press | Qwen3.8 27B | Qwen | 2026-08-14 | 2 | v2 · c1 · h1 | medium | 2/5 | yes | $0.025 | 6,671 | 104 |
| 2026-09-22 | French press | Qwen3.8 27B | Qwen | 2026-08-14 | 3 | v2 · c1 · h1 | medium | 3/4 | yes | $0.030 | 8,195 | 673 |
| 2026-09-22 | Venn | DeepSeek 4.1 Flash | DeepSeek | 2026-09-10 | 1 | v1 · c2 · h1 | medium | 3/4 | $0.019 | 9,232 | 112 | |
| 2026-09-22 | Venn | DeepSeek 4.1 Flash | DeepSeek | 2026-09-10 | 2 | v1 · c2 · h1 | medium | 3/4 | $0.025 | 14,931 | 180 | |
| 2026-09-22 | Venn | DeepSeek 4.1 Flash | DeepSeek | 2026-09-10 | 3 | v1 · c2 · h1 | medium | 4/4 | $0.023 | 12,810 | 169 | |
| 2026-09-21 | Café table | DeepSeek 4.1 Flash | DeepSeek | 2026-09-10 | 1 | v2 · c1 · h1 | medium | 3/5 | yes | $0.016 | 20,858 | 720 |
| 2026-09-21 | Café table | DeepSeek 4.1 Flash | DeepSeek | 2026-09-10 | 2 | v2 · c1 · h1 | medium | 4/5 | yes | $0.022 | 24,709 | 720 |
| 2026-09-21 | Café table | DeepSeek 4.1 Flash | DeepSeek | 2026-09-10 | 3 | v2 · c1 · h1 | medium | 4/5 | yes | $0.019 | 20,483 | 669 |
| 2026-09-21 | Café table | Qwen3.8 Flash | Qwen | 2026-08-26 | 1 | v2 · c1 · h1 | medium | 5/5 | yes | $0.040 | 43,349 | 720 |
| 2026-09-21 | Café table | Qwen3.8 Flash | Qwen | 2026-08-26 | 3 | v2 · c1 · h1 | medium | 4/4 | yes | $0.029 | 33,565 | 720 |
| 2026-09-21 | COFFEE route | GLM 5.3 FlashX | Z.ai | 2026-09-18 | 1 | v2 · c1 · h1 | medium | 3/5 | yes | $0.247 | 49,499 | 685 |
| 2026-09-21 | COFFEE route | GLM 5.3 FlashX | Z.ai | 2026-09-18 | 2 | v2 · c1 · h1 | medium | 4/5 | yes | $0.189 | 30,773 | 419 |
| 2026-09-21 | COFFEE route | GLM 5.3 FlashX | Z.ai | 2026-09-18 | 3 | v2 · c1 · h1 | medium | 3/5 | yes | $0.106 | 24,769 | 343 |
| 2026-09-21 | Caffeine | DeepSeek 4.1 Flash | DeepSeek | 2026-09-10 | 3 | v1 · c1 · h1 | medium | 5/5 | $0.063 | 37,832 | 720 | |
| 2026-09-21 | Caffeine | Qwen3.8 Max | Qwen | 2026-09-03 | 1 | v1 · c1 · h1 | medium | 5/5 | $0.473 | 28,157 | 680 | |
| 2026-09-21 | Caffeine | Qwen3.8 Max | Qwen | 2026-09-03 | 2 | v1 · c1 · h1 | medium | 5/5 | $0.594 | 29,072 | 720 | |
| 2026-09-21 | Caffeine | Qwen3.8 Max | Qwen | 2026-09-03 | 3 | v1 · c1 · h1 | medium | 5/5 | $0.361 | 19,288 | 487 | |
| 2026-09-21 | Boiler | Astra | OpenAI | 2026-09-04 | 1 | v2 · c2 · h1 | medium | 5/5 | $0.171 | 1,839 | 63 | |
| 2026-09-21 | Boiler | Astra | OpenAI | 2026-09-04 | 2 | v2 · c2 · h1 | medium | 5/5 | $0.144 | 1,762 | 58 | |
| 2026-09-21 | Boiler | Astra | OpenAI | 2026-09-04 | 3 | v2 · c2 · h1 | medium | 5/5 | $0.119 | 1,352 | 44 | |
| 2026-09-21 | Boiler | DeepSeek 4.1 Flash | DeepSeek | 2026-09-10 | 1 | v2 · c2 · h1 | medium | 5/5 | $0.011 | 11,104 | 322 | |
| 2026-09-21 | Boiler | DeepSeek 4.1 Flash | DeepSeek | 2026-09-10 | 3 | v2 · c2 · h1 | medium | 5/5 | $0.008 | 8,703 | 94 | |
| 2026-09-20 | Café table | Qwen3.8 Flash | Qwen | 2026-08-26 | 2 | v1 · c1 · h1 | medium | 4/5 | $0.067 | 74,682 | 1680 | |
| 2026-09-20 | COFFEE route | DeepSeek 4.1 Flash | DeepSeek | 2026-09-10 | 1 | v2 · c1 · h1 | medium | 5/5 | $0.108 | 58,340 | 720 | |
| 2026-09-20 | COFFEE route | GLM 5.3 FlashX | Z.ai | 2026-09-18 | 1 | v2 · c1 · h1 | medium | 0/5 | $0.014 | 3,596 | 54 | |
| 2026-09-20 | Caffeine | DeepSeek 4.1 Flash | DeepSeek | 2026-09-10 | 1 | v1 · c1 · h1 | medium | 5/5 | $0.042 | 20,214 | 346 | |
| 2026-09-20 | French press | DeepSeek 4.1 Flash | DeepSeek | 2026-09-10 | 1 | v1 · c1 · h1 | medium | 4/5 | $0.040 | 22,277 | 664 | |
| 2026-09-20 | French press | GLM 5.3 FlashX | Z.ai | 2026-09-18 | 1 | v1 · c1 · h1 | medium | 3/5 | $0.021 | 3,937 | 67 | |
| 2026-09-20 | French press | Qwen3.8 27B | Qwen | 2026-08-14 | 1 | v1 · c1 · h1 | medium | 3/4 | $0.102 | 19,049 | 346 | |
| 2026-09-18 | French press | GPT-5.6 Sol | OpenAI | 2026-07-09 | 1 | v1 · c1 · h1 | medium | 4/5 | $0.241 | 5,483 | 92 | |
| 2026-09-18 | French press | Pareto | unbiased | 1 | v1 · c1 · h1 | medium | 4/5 | $0.259 | 26,164 | 171 | ||
| 2026-09-17 | COFFEE route | Union Alpha | stealth | 1 | v2 · c1 · h1 | high | 5/5 | $0.000 | 7,480 | 585 | ||
| 2026-09-16 | Boiler | Astra | OpenAI | 2026-09-04 | 1 | v1 · c2 · h1 | medium | 5/5 | $0.164 | 1,833 | 63 | |
| 2026-09-16 | Boiler | DeepSeek 4.1 Flash | DeepSeek | 2026-09-10 | 1 | v1 · c2 · h1 | medium | 5/5 | $0.028 | 27,747 | 207 | |
| 2026-09-14 | Café table | DeepSeek 4.1 Flash | DeepSeek | 2026-09-10 | 1 | v1 · c1 · h1 | medium | 4/5 | $0.077 | 32,809 | 720 | |
| 2026-09-14 | Caffeine | Qwen3.8 Max | Qwen | 2026-09-03 | 1 | v1 · c1 · h1 | medium | 5/5 | $0.629 | 30,828 | 719 |
Columns
- date
- The day the run was made.
- task
- The bench task. Its gallery page has the prompt and every run.
- model
- As I name it. The full OpenRouter id is in the downloads.
- maker
- Who makes the model, as OpenRouter lists it.
- on OpenRouter
- The day the model was added to OpenRouter. That is close to its release and not the same thing. Blank when OpenRouter no longer lists it.
- run
- Which of a model’s runs on the task this is. Runs differ only by chance.
- prompt · checks · harness
- The versions of the prompt the run was given, of the checks it was scored by, and of the harness around it: the instructions, the render tool and the sandbox. Compare runs only when all three match.
- thinking
- The reasoning setting the run used. Medium unless it says otherwise.
- checks
- One square per check: filled passed, light failed, outlined undecided. A round one I judged by eye, a diamond one a model judged. The number is passed of decided.
- board
- Yes when the run is one of the three that make the model’s cell on the board, which counts only the current prompt, checks and harness.
- cost
- What OpenRouter billed for the run, in US dollars.
- tokens out
- What the model wrote, its thinking included.
- time
- How long the run took, in seconds.