Does Gemini 4 Argon know the coffee family tree?

In short

Gemini 4 Argon got the Bourbon family right in all three runs.

Finding

The structure is right most of the time, but the grouping of cultivars is often wrong.

Biologists write family trees as Newick, a line of brackets and numbers. I asked five models for a family tree with twelve coffee cultivars. And that every tip be the same distance from the root, and exactly one point where four branches split at once.

All 15 runs passed every check in the end, but the checker only reads the brackets, so we also have to check which cultivars sit together.

Caturra, Pacas and Villa Sarchi are all mutations of Bourbon, so the four of them are a good split. Gemini 4 Argon used them in all three runs, each on the first try, and put Kona and Blue Mountain beside Typica, which they come from. Opus 5.5 found the Bourbon split once.

A tree of twelve coffee cultivars. Bourbon, Caturra, Pacas and Villa Sarchi branch from one point.
Gemini 4 Argon, run 3. Bourbon and its three mutants make the split of four.$0.09

Most other runs put a cultivar level with its own offspring which is not great.

A tree of twelve coffee cultivars. Bourbon is in the top group and Bourbon Vermelho is at the bottom, paired with Java.
GPT-6 Luna, run 1. Bourbon at the top, Bourbon Vermelho at the bottom.$0.00

Verdict

On this task Gemini seems to handle the cultivar better.

n = 3 runs a model. No test.

The 15 runs cost $0.43, and Gemini's three were $0.23 of it.

By email

Older, 13 Oct

Are models as bad as humans in the spatial orientation test?

Newer, 15 Oct

How do models fail when simulating a coffee hopper?