En DashHotdogBenchmark

The Hamburger Control, week by week

Nobody disputes this one. That is exactly why it is here.

Week 36, 2026, up close

Did each model agree with itself?

Every sample's answer, in the order it was taken, under each framing. A row of identical chips is a model that has made up its mind. Y is yes, N is no, ~ is a hedge.

Sample-by-sample verdicts per model and framing, Week 36, 2026
ModelControlAssertedDeniedSelf-agreement
Claude Opus 5100%
Claude Sonnet 589%
Claude Haiku 4.5100%
GPT-5.6 Sol100%
GPT-5.5100%
GPT-5.4 mini100%
Grok 4.6100%
Grok 4.3100%
Grok 4.20 (non-reasoning)100%
Mistral Medium 3.5100%
Mistral Small 4100%

How much did latency swing?

The fastest and slowest call behind each median, asked plainly. A long bar is a model whose speed you cannot count on.

Fastest, median and slowest call per model, Week 36, 2026
ModelRangeFastestMedianSlowest
Claude Opus 52.2 s2.7 s2.9 s
Claude Sonnet 51.1 s1.1 s1.1 s
Claude Haiku 4.5615 ms677 ms688 ms
GPT-5.6 Sol1 s1.3 s1.4 s
GPT-5.51 s1.3 s12.7 s
GPT-5.4 mini610 ms625 ms783 ms
Grok 4.66.4 s7 s10.9 s
Grok 4.33.3 s3.7 s4 s
Grok 4.20 (non-reasoning)439 ms457 ms502 ms
Mistral Medium 3.5306 ms344 ms428 ms
Mistral Small 4326 ms340 ms348 ms

Asked again the same week

Week 36, 2026 was run 3 times, on September 2, 2026, September 2, 2026, September 2, 2026. Answers that changed between consecutive runs:

None. Every model gave the same majority answer each time.

Position changes

No model has changed its answer on a hamburger between consecutive editions.