En DashHotdogBenchmark

The Hamburger Control, week by week

Nobody disputes this one. That is exactly why it is here.

Week 42, 2026, up close

Did each model agree with itself?

Every sample's answer, in the order it was taken, under each framing. A row of identical chips is a model that has made up its mind. Y is yes, N is no, ~ is a hedge.

ModelControlAssertedDeniedSelf-agreement
Claude Opus 589%
Claude Sonnet 5100%
Claude Haiku 4.5100%
GPT-5.6 Sol100%
GPT-5.5100%
GPT-5.4 mini100%
Grok 4.6100%
Grok 4.3100%
Grok 4.20 (non-reasoning)100%
Mistral Medium 3.5no datano datano data—
Mistral Small 4no datano datano data—
DeepSeek V4 Pro89%

How much did latency swing?

The fastest and slowest call behind each median, asked plainly. A long bar is a model whose speed you cannot count on.

ModelRangeFastestMedianSlowest
Claude Opus 51.5 s2 s2.8 s
Claude Sonnet 5887 ms889 ms939 ms
Claude Haiku 4.5465 ms465 ms482 ms
GPT-5.6 Sol880 ms902 ms1.3 s
GPT-5.51.1 s1.1 s1.7 s
GPT-5.4 mini533 ms592 ms633 ms
Grok 4.67.1 s8.4 s11 s
Grok 4.310.6 s12.4 s15.4 s
Grok 4.20 (non-reasoning)438 ms438 ms548 ms
DeepSeek V4 Pro1.4 s1.6 s1.6 s

Asked again the same week

Week 42, 2026 was run once. When a week is re-run, the earlier runs are kept and the answers that changed between them show up here.

Across editions

Verdict share by edition
Week 36, 2026: 12 affirmative, 0 negative, 0 non-committal . Open the edition. 12W36 Week 37, 2026: 10 affirmative, 0 negative, 0 non-committal . Open the edition. 10W37 Week 38, 2026: 10 affirmative, 0 negative, 0 non-committal . Open the edition. 10W38 Week 39, 2026: 10 affirmative, 0 negative, 0 non-committal . Open the edition. 10W39 Week 40, 2026: 10 affirmative, 0 negative, 0 non-committal . Open the edition. 10W40 Week 42, 2026: 10 affirmative, 0 negative, 0 non-committal . Open the edition. 10W42Edition (ISO week)

Each model contributes one vote, based on its majority verdict across samples, so a model sampled three times does not outvote one sampled once.

Show the data
Verdict share by edition — data
EditionAffirmativeNegativeNon-committalTotal
Week 36, 2026120012
Week 37, 2026100010
Week 38, 2026100010
Week 39, 2026100010
Week 40, 2026100010
Week 42, 2026100010

How easily each model changes its mind

Framing sensitivity per edition: the share of questions where telling the model the answer changed it. Editions that ran only the control leave a gap.

Claude Opus 58%
Claude Opus 5 across 6 editions, from 17% to 8%. Down 8% since the prior edition.

8% vs prior

Data
EditionClaude Opus 5
Week 36, 202617%
Week 37, 202617%
Week 38, 20268%
Week 39, 202617%
Week 40, 202617%
Week 42, 20268%
Claude Sonnet 525%
Claude Sonnet 5 across 6 editions, from 33% to 25%. Unchanged 0% since the prior edition.

unchanged

Data
EditionClaude Sonnet 5
Week 36, 202633%
Week 37, 202633%
Week 38, 202633%
Week 39, 202633%
Week 40, 202625%
Week 42, 202625%
Claude Haiku 4.525%
Claude Haiku 4.5 across 6 editions, from 25% to 25%. Unchanged 0% since the prior edition.

unchanged

Data
EditionClaude Haiku 4.5
Week 36, 202625%
Week 37, 202625%
Week 38, 202625%
Week 39, 202617%
Week 40, 202625%
Week 42, 202625%
GPT-5.6 Sol50%
GPT-5.6 Sol across 6 editions, from 50% to 50%. Unchanged 0% since the prior edition.

unchanged

Data
EditionGPT-5.6 Sol
Week 36, 202650%
Week 37, 202650%
Week 38, 202650%
Week 39, 202650%
Week 40, 202650%
Week 42, 202650%
GPT-5.550%
GPT-5.5 across 6 editions, from 50% to 50%. Unchanged 0% since the prior edition.

unchanged

Data
EditionGPT-5.5
Week 36, 202650%
Week 37, 202650%
Week 38, 202650%
Week 39, 202650%
Week 40, 202650%
Week 42, 202650%
GPT-5.4 mini50%
GPT-5.4 mini across 6 editions, from 50% to 50%. Unchanged 0% since the prior edition.

unchanged

Data
EditionGPT-5.4 mini
Week 36, 202650%
Week 37, 202650%
Week 38, 202650%
Week 39, 202650%
Week 40, 202650%
Week 42, 202650%
Grok 4.68%
Grok 4.6 across 6 editions, from 17% to 8%. Unchanged 0% since the prior edition.

unchanged

Data
EditionGrok 4.6
Week 36, 202617%
Week 37, 20268%
Week 38, 20268%
Week 39, 20268%
Week 40, 20268%
Week 42, 20268%
Grok 4.317%
Grok 4.3 across 6 editions, from 17% to 17%. Unchanged 0% since the prior edition.

unchanged

Data
EditionGrok 4.3
Week 36, 202617%
Week 37, 20268%
Week 38, 202617%
Week 39, 202617%
Week 40, 202617%
Week 42, 202617%
Grok 4.20 (non-reasoning)33%
Grok 4.20 (non-reasoning) across 6 editions, from 33% to 33%. Down 17% since the prior edition.

17% vs prior

Data
EditionGrok 4.20 (non-reasoning)
Week 36, 202633%
Week 37, 202650%
Week 38, 202650%
Week 39, 202655%
Week 40, 202650%
Week 42, 202633%
Mistral Medium 3.550%
Mistral Medium 3.5 across 6 editions, from 50% to 50%. Unchanged 0% since the prior edition.

unchanged

Data
EditionMistral Medium 3.5
Week 36, 202650%
Week 37, 2026—
Week 38, 2026—
Week 39, 2026—
Week 40, 2026—
Week 42, 2026—
Mistral Small 450%
Mistral Small 4 across 6 editions, from 50% to 50%. Unchanged 0% since the prior edition.

unchanged

Data
EditionMistral Small 4
Week 36, 202650%
Week 37, 2026—
Week 38, 2026—
Week 39, 2026—
Week 40, 2026—
Week 42, 2026—
DeepSeek V4 Pro17%
DeepSeek V4 Pro across 6 editions, from 17% to 17%. Unchanged 0% since the prior edition.

unchanged

Data
EditionDeepSeek V4 Pro
Week 36, 202617%
Week 37, 202617%
Week 38, 202617%
Week 39, 202625%
Week 40, 202617%
Week 42, 202617%

Median latency by model

Claude Opus 52 s
Claude Opus 5 across 6 editions, from 2.3 s to 2 s. Down 802 ms since the prior edition.

802 ms vs prior

Data
EditionClaude Opus 5
Week 36, 20262.3 s
Week 37, 20262.4 s
Week 38, 20262.3 s
Week 39, 20262.5 s
Week 40, 20262.8 s
Week 42, 20262 s
Claude Sonnet 5889 ms
Claude Sonnet 5 across 6 editions, from 1.1 s to 889 ms. Down 274 ms since the prior edition.

274 ms vs prior

Data
EditionClaude Sonnet 5
Week 36, 20261.1 s
Week 37, 20261.3 s
Week 38, 20261.2 s
Week 39, 20261.1 s
Week 40, 20261.2 s
Week 42, 2026889 ms
Claude Haiku 4.5465 ms
Claude Haiku 4.5 across 6 editions, from 624 ms to 465 ms. Up 16 ms since the prior edition.

16 ms vs prior

Data
EditionClaude Haiku 4.5
Week 36, 2026624 ms
Week 37, 2026620 ms
Week 38, 2026595 ms
Week 39, 2026472 ms
Week 40, 2026449 ms
Week 42, 2026465 ms
GPT-5.6 Sol902 ms
GPT-5.6 Sol across 6 editions, from 1.4 s to 902 ms. Down 314 ms since the prior edition.

314 ms vs prior

Data
EditionGPT-5.6 Sol
Week 36, 20261.4 s
Week 37, 2026997 ms
Week 38, 20261.4 s
Week 39, 20262 s
Week 40, 20261.2 s
Week 42, 2026902 ms
GPT-5.51.1 s
GPT-5.5 across 6 editions, from 1.2 s to 1.1 s. Down 276 ms since the prior edition.

276 ms vs prior

Data
EditionGPT-5.5
Week 36, 20261.2 s
Week 37, 20261.7 s
Week 38, 20261.2 s
Week 39, 20261.5 s
Week 40, 20261.4 s
Week 42, 20261.1 s
GPT-5.4 mini592 ms
GPT-5.4 mini across 6 editions, from 697 ms to 592 ms. Down 77 ms since the prior edition.

77 ms vs prior

Data
EditionGPT-5.4 mini
Week 36, 2026697 ms
Week 37, 20261.1 s
Week 38, 2026845 ms
Week 39, 2026649 ms
Week 40, 2026669 ms
Week 42, 2026592 ms
Grok 4.68.4 s
Grok 4.6 across 6 editions, from 4.9 s to 8.4 s. Up 3 s since the prior edition.

3 s vs prior

Data
EditionGrok 4.6
Week 36, 20264.9 s
Week 37, 20267.5 s
Week 38, 20267.4 s
Week 39, 20267.1 s
Week 40, 20265.4 s
Week 42, 20268.4 s
Grok 4.312.4 s
Grok 4.3 across 6 editions, from 3.6 s to 12.4 s. Up 9 s since the prior edition.

9 s vs prior

Data
EditionGrok 4.3
Week 36, 20263.6 s
Week 37, 20263.2 s
Week 38, 20262.8 s
Week 39, 20262.7 s
Week 40, 20263.4 s
Week 42, 202612.4 s
Grok 4.20 (non-reasoning)438 ms
Grok 4.20 (non-reasoning) across 6 editions, from 465 ms to 438 ms. Down 29 ms since the prior edition.

29 ms vs prior

Data
EditionGrok 4.20 (non-reasoning)
Week 36, 2026465 ms
Week 37, 2026562 ms
Week 38, 2026452 ms
Week 39, 2026498 ms
Week 40, 2026467 ms
Week 42, 2026438 ms
Mistral Medium 3.5394 ms
Mistral Medium 3.5 across 6 editions, from 394 ms to 394 ms. Unchanged 0 ms since the prior edition.

unchanged

Data
EditionMistral Medium 3.5
Week 36, 2026394 ms
Week 37, 2026—
Week 38, 2026—
Week 39, 2026—
Week 40, 2026—
Week 42, 2026—
Mistral Small 4361 ms
Mistral Small 4 across 6 editions, from 361 ms to 361 ms. Unchanged 0 ms since the prior edition.

unchanged

Data
EditionMistral Small 4
Week 36, 2026361 ms
Week 37, 2026—
Week 38, 2026—
Week 39, 2026—
Week 40, 2026—
Week 42, 2026—
DeepSeek V4 Pro1.6 s
DeepSeek V4 Pro across 6 editions, from 2.4 s to 1.6 s. Down 389 ms since the prior edition.

389 ms vs prior

Data
EditionDeepSeek V4 Pro
Week 36, 20262.4 s
Week 37, 20262.5 s
Week 38, 20261.7 s
Week 39, 20262.4 s
Week 40, 20262 s
Week 42, 20261.6 s

Median output tokens by model

Claude Opus 5132
Claude Opus 5 across 6 editions, from 80 to 132. Up 38 since the prior edition.

38 vs prior

Data
EditionClaude Opus 5
Week 36, 202680
Week 37, 2026107
Week 38, 202688
Week 39, 202658
Week 40, 202694
Week 42, 2026132
Claude Sonnet 55
Claude Sonnet 5 across 6 editions, from 6 to 5. Unchanged 0 since the prior edition.

unchanged

Data
EditionClaude Sonnet 5
Week 36, 20266
Week 37, 20265
Week 38, 20267
Week 39, 20266
Week 40, 20265
Week 42, 20265
Claude Haiku 4.55
Claude Haiku 4.5 across 6 editions, from 5 to 5. Unchanged 0 since the prior edition.

unchanged

Data
EditionClaude Haiku 4.5
Week 36, 20265
Week 37, 20265
Week 38, 20265
Week 39, 20265
Week 40, 20265
Week 42, 20265
GPT-5.6 Sol6
GPT-5.6 Sol across 6 editions, from 6 to 6. Unchanged 0 since the prior edition.

unchanged

Data
EditionGPT-5.6 Sol
Week 36, 20266
Week 37, 20266
Week 38, 20266
Week 39, 20266
Week 40, 20266
Week 42, 20266
GPT-5.522
GPT-5.5 across 6 editions, from 27 to 22. Down 3 since the prior edition.

3 vs prior

Data
EditionGPT-5.5
Week 36, 202627
Week 37, 202622
Week 38, 202625
Week 39, 202629
Week 40, 202625
Week 42, 202622
GPT-5.4 mini5
GPT-5.4 mini across 6 editions, from 5 to 5. Unchanged 0 since the prior edition.

unchanged

Data
EditionGPT-5.4 mini
Week 36, 20265
Week 37, 20265
Week 38, 20265
Week 39, 20265
Week 40, 20265
Week 42, 20265
Grok 4.61
Grok 4.6 across 6 editions, from 1 to 1. Unchanged 0 since the prior edition.

unchanged

Data
EditionGrok 4.6
Week 36, 20261
Week 37, 20261
Week 38, 20261
Week 39, 20261
Week 40, 20261
Week 42, 20261
Grok 4.31
Grok 4.3 across 6 editions, from 1 to 1. Unchanged 0 since the prior edition.

unchanged

Data
EditionGrok 4.3
Week 36, 20261
Week 37, 20261
Week 38, 20261
Week 39, 20261
Week 40, 20261
Week 42, 20261
Grok 4.20 (non-reasoning)1
Grok 4.20 (non-reasoning) across 6 editions, from 2 to 1. Down 1 since the prior edition.

1 vs prior

Data
EditionGrok 4.20 (non-reasoning)
Week 36, 20262
Week 37, 20262
Week 38, 20262
Week 39, 20262
Week 40, 20262
Week 42, 20261
Mistral Medium 3.53
Mistral Medium 3.5 across 6 editions, from 3 to 3. Unchanged 0 since the prior edition.

unchanged

Data
EditionMistral Medium 3.5
Week 36, 20263
Week 37, 2026—
Week 38, 2026—
Week 39, 2026—
Week 40, 2026—
Week 42, 2026—
Mistral Small 43
Mistral Small 4 across 6 editions, from 3 to 3. Unchanged 0 since the prior edition.

unchanged

Data
EditionMistral Small 4
Week 36, 20263
Week 37, 2026—
Week 38, 2026—
Week 39, 2026—
Week 40, 2026—
Week 42, 2026—
DeepSeek V4 Pro68
DeepSeek V4 Pro across 6 editions, from 69 to 68. Down 11 since the prior edition.

11 vs prior

Data
EditionDeepSeek V4 Pro
Week 36, 202669
Week 37, 202687
Week 38, 202684
Week 39, 202686
Week 40, 202679
Week 42, 202668

Position changes

No model has changed its answer on a hamburger between consecutive editions.