En DashHotdogBenchmark

The Hot Dog Question, week by week

Bread on two sides. One piece or two? The question that started all this.

Week 42, 2026, up close

Did each model agree with itself?

Every sample's answer, in the order it was taken, under each framing. A row of identical chips is a model that has made up its mind. Y is yes, N is no, ~ is a hedge.

ModelControlAssertedDeniedSelf-agreement
Claude Opus 5100%
Claude Sonnet 589%
Claude Haiku 4.589%
GPT-5.6 Sol100%
GPT-5.5100%
GPT-5.4 mini100%
Grok 4.689%
Grok 4.389%
Grok 4.20 (non-reasoning)100%
Mistral Medium 3.5no datano datano data—
Mistral Small 4no datano datano data—
DeepSeek V4 Pro100%

How much did latency swing?

The fastest and slowest call behind each median, asked plainly. A long bar is a model whose speed you cannot count on.

ModelRangeFastestMedianSlowest
Claude Opus 51.1 s1.8 s2.3 s
Claude Sonnet 5991 ms1 s1.5 s
Claude Haiku 4.5467 ms469 ms493 ms
GPT-5.6 Sol1 s1.2 s2.1 s
GPT-5.51.5 s1.6 s2.8 s
GPT-5.4 mini752 ms1.1 s1.1 s
Grok 4.69.2 s13.2 s13.3 s
Grok 4.34.6 s4.9 s5.1 s
Grok 4.20 (non-reasoning)398 ms453 ms632 ms
DeepSeek V4 Pro1.3 s1.6 s1.7 s

Asked again the same week

Week 42, 2026 was run once. When a week is re-run, the earlier runs are kept and the answers that changed between them show up here.

Across editions

Verdict share by edition
Week 36, 2026: 7 affirmative, 5 negative, 0 non-committal . Open the edition. 75W36 Week 37, 2026: 5 affirmative, 5 negative, 0 non-committal . Open the edition. 55W37 Week 38, 2026: 6 affirmative, 4 negative, 0 non-committal . Open the edition. 64W38 Week 39, 2026: 7 affirmative, 3 negative, 0 non-committal . Open the edition. 73W39 Week 40, 2026: 5 affirmative, 5 negative, 0 non-committal . Open the edition. 55W40 Week 42, 2026: 5 affirmative, 5 negative, 0 non-committal . Open the edition. 55W42Edition (ISO week)

Each model contributes one vote, based on its majority verdict across samples, so a model sampled three times does not outvote one sampled once.

Show the data
Verdict share by edition — data
EditionAffirmativeNegativeNon-committalTotal
Week 36, 202675012
Week 37, 202655010
Week 38, 202664010
Week 39, 202673010
Week 40, 202655010
Week 42, 202655010

How easily each model changes its mind

Framing sensitivity per edition: the share of questions where telling the model the answer changed it. Editions that ran only the control leave a gap.

Claude Opus 58%
Claude Opus 5 across 6 editions, from 17% to 8%. Down 8% since the prior edition.

8% vs prior

Data
EditionClaude Opus 5
Week 36, 202617%
Week 37, 202617%
Week 38, 20268%
Week 39, 202617%
Week 40, 202617%
Week 42, 20268%
Claude Sonnet 525%
Claude Sonnet 5 across 6 editions, from 33% to 25%. Unchanged 0% since the prior edition.

unchanged

Data
EditionClaude Sonnet 5
Week 36, 202633%
Week 37, 202633%
Week 38, 202633%
Week 39, 202633%
Week 40, 202625%
Week 42, 202625%
Claude Haiku 4.525%
Claude Haiku 4.5 across 6 editions, from 25% to 25%. Unchanged 0% since the prior edition.

unchanged

Data
EditionClaude Haiku 4.5
Week 36, 202625%
Week 37, 202625%
Week 38, 202625%
Week 39, 202617%
Week 40, 202625%
Week 42, 202625%
GPT-5.6 Sol50%
GPT-5.6 Sol across 6 editions, from 50% to 50%. Unchanged 0% since the prior edition.

unchanged

Data
EditionGPT-5.6 Sol
Week 36, 202650%
Week 37, 202650%
Week 38, 202650%
Week 39, 202650%
Week 40, 202650%
Week 42, 202650%
GPT-5.550%
GPT-5.5 across 6 editions, from 50% to 50%. Unchanged 0% since the prior edition.

unchanged

Data
EditionGPT-5.5
Week 36, 202650%
Week 37, 202650%
Week 38, 202650%
Week 39, 202650%
Week 40, 202650%
Week 42, 202650%
GPT-5.4 mini50%
GPT-5.4 mini across 6 editions, from 50% to 50%. Unchanged 0% since the prior edition.

unchanged

Data
EditionGPT-5.4 mini
Week 36, 202650%
Week 37, 202650%
Week 38, 202650%
Week 39, 202650%
Week 40, 202650%
Week 42, 202650%
Grok 4.68%
Grok 4.6 across 6 editions, from 17% to 8%. Unchanged 0% since the prior edition.

unchanged

Data
EditionGrok 4.6
Week 36, 202617%
Week 37, 20268%
Week 38, 20268%
Week 39, 20268%
Week 40, 20268%
Week 42, 20268%
Grok 4.317%
Grok 4.3 across 6 editions, from 17% to 17%. Unchanged 0% since the prior edition.

unchanged

Data
EditionGrok 4.3
Week 36, 202617%
Week 37, 20268%
Week 38, 202617%
Week 39, 202617%
Week 40, 202617%
Week 42, 202617%
Grok 4.20 (non-reasoning)33%
Grok 4.20 (non-reasoning) across 6 editions, from 33% to 33%. Down 17% since the prior edition.

17% vs prior

Data
EditionGrok 4.20 (non-reasoning)
Week 36, 202633%
Week 37, 202650%
Week 38, 202650%
Week 39, 202655%
Week 40, 202650%
Week 42, 202633%
Mistral Medium 3.550%
Mistral Medium 3.5 across 6 editions, from 50% to 50%. Unchanged 0% since the prior edition.

unchanged

Data
EditionMistral Medium 3.5
Week 36, 202650%
Week 37, 2026—
Week 38, 2026—
Week 39, 2026—
Week 40, 2026—
Week 42, 2026—
Mistral Small 450%
Mistral Small 4 across 6 editions, from 50% to 50%. Unchanged 0% since the prior edition.

unchanged

Data
EditionMistral Small 4
Week 36, 202650%
Week 37, 2026—
Week 38, 2026—
Week 39, 2026—
Week 40, 2026—
Week 42, 2026—
DeepSeek V4 Pro17%
DeepSeek V4 Pro across 6 editions, from 17% to 17%. Unchanged 0% since the prior edition.

unchanged

Data
EditionDeepSeek V4 Pro
Week 36, 202617%
Week 37, 202617%
Week 38, 202617%
Week 39, 202625%
Week 40, 202617%
Week 42, 202617%

Median latency by model

Claude Opus 51.8 s
Claude Opus 5 across 6 editions, from 2.8 s to 1.8 s. Down 1.4 s since the prior edition.

1.4 s vs prior

Data
EditionClaude Opus 5
Week 36, 20262.8 s
Week 37, 20262.7 s
Week 38, 20262.6 s
Week 39, 20262.3 s
Week 40, 20263.2 s
Week 42, 20261.8 s
Claude Sonnet 51 s
Claude Sonnet 5 across 6 editions, from 1.3 s to 1 s. Down 339 ms since the prior edition.

339 ms vs prior

Data
EditionClaude Sonnet 5
Week 36, 20261.3 s
Week 37, 20261.5 s
Week 38, 20261.2 s
Week 39, 20261 s
Week 40, 20261.3 s
Week 42, 20261 s
Claude Haiku 4.5469 ms
Claude Haiku 4.5 across 6 editions, from 674 ms to 469 ms. Down 33 ms since the prior edition.

33 ms vs prior

Data
EditionClaude Haiku 4.5
Week 36, 2026674 ms
Week 37, 2026607 ms
Week 38, 2026573 ms
Week 39, 2026523 ms
Week 40, 2026502 ms
Week 42, 2026469 ms
GPT-5.6 Sol1.2 s
GPT-5.6 Sol across 6 editions, from 1.5 s to 1.2 s. Down 1.4 s since the prior edition.

1.4 s vs prior

Data
EditionGPT-5.6 Sol
Week 36, 20261.5 s
Week 37, 20262.4 s
Week 38, 20262.6 s
Week 39, 20262.2 s
Week 40, 20262.6 s
Week 42, 20261.2 s
GPT-5.51.6 s
GPT-5.5 across 6 editions, from 1.4 s to 1.6 s. Down 771 ms since the prior edition.

771 ms vs prior

Data
EditionGPT-5.5
Week 36, 20261.4 s
Week 37, 20261.9 s
Week 38, 20261.8 s
Week 39, 20261.7 s
Week 40, 20262.4 s
Week 42, 20261.6 s
GPT-5.4 mini1.1 s
GPT-5.4 mini across 6 editions, from 1.6 s to 1.1 s. Down 97 ms since the prior edition.

97 ms vs prior

Data
EditionGPT-5.4 mini
Week 36, 20261.6 s
Week 37, 20261.3 s
Week 38, 20261.2 s
Week 39, 2026668 ms
Week 40, 20261.2 s
Week 42, 20261.1 s
Grok 4.613.2 s
Grok 4.6 across 6 editions, from 8.7 s to 13.2 s. Up 5.5 s since the prior edition.

5.5 s vs prior

Data
EditionGrok 4.6
Week 36, 20268.7 s
Week 37, 202610.4 s
Week 38, 202612 s
Week 39, 202614.3 s
Week 40, 20267.7 s
Week 42, 202613.2 s
Grok 4.34.9 s
Grok 4.3 across 6 editions, from 8.6 s to 4.9 s. Up 1.1 s since the prior edition.

1.1 s vs prior

Data
EditionGrok 4.3
Week 36, 20268.6 s
Week 37, 20264.6 s
Week 38, 20264.2 s
Week 39, 20264.6 s
Week 40, 20263.8 s
Week 42, 20264.9 s
Grok 4.20 (non-reasoning)453 ms
Grok 4.20 (non-reasoning) across 6 editions, from 407 ms to 453 ms. Down 82 ms since the prior edition.

82 ms vs prior

Data
EditionGrok 4.20 (non-reasoning)
Week 36, 2026407 ms
Week 37, 2026464 ms
Week 38, 2026429 ms
Week 39, 2026490 ms
Week 40, 2026534 ms
Week 42, 2026453 ms
Mistral Medium 3.5368 ms
Mistral Medium 3.5 across 6 editions, from 368 ms to 368 ms. Unchanged 0 ms since the prior edition.

unchanged

Data
EditionMistral Medium 3.5
Week 36, 2026368 ms
Week 37, 2026—
Week 38, 2026—
Week 39, 2026—
Week 40, 2026—
Week 42, 2026—
Mistral Small 4358 ms
Mistral Small 4 across 6 editions, from 358 ms to 358 ms. Unchanged 0 ms since the prior edition.

unchanged

Data
EditionMistral Small 4
Week 36, 2026358 ms
Week 37, 2026—
Week 38, 2026—
Week 39, 2026—
Week 40, 2026—
Week 42, 2026—
DeepSeek V4 Pro1.6 s
DeepSeek V4 Pro across 6 editions, from 2.2 s to 1.6 s. Down 129 ms since the prior edition.

129 ms vs prior

Data
EditionDeepSeek V4 Pro
Week 36, 20262.2 s
Week 37, 20263.3 s
Week 38, 20262.4 s
Week 39, 20262.5 s
Week 40, 20261.7 s
Week 42, 20261.6 s

Median output tokens by model

Claude Opus 592
Claude Opus 5 across 6 editions, from 122 to 92. Down 62 since the prior edition.

62 vs prior

Data
EditionClaude Opus 5
Week 36, 2026122
Week 37, 202697
Week 38, 202687
Week 39, 202677
Week 40, 2026154
Week 42, 202692
Claude Sonnet 527
Claude Sonnet 5 across 6 editions, from 27 to 27. Unchanged 0 since the prior edition.

unchanged

Data
EditionClaude Sonnet 5
Week 36, 202627
Week 37, 202627
Week 38, 202627
Week 39, 20265
Week 40, 202627
Week 42, 202627
Claude Haiku 4.55
Claude Haiku 4.5 across 6 editions, from 5 to 5. Unchanged 0 since the prior edition.

unchanged

Data
EditionClaude Haiku 4.5
Week 36, 20265
Week 37, 20265
Week 38, 20265
Week 39, 20265
Week 40, 20265
Week 42, 20265
GPT-5.6 Sol6
GPT-5.6 Sol across 6 editions, from 21 to 6. Unchanged 0 since the prior edition.

unchanged

Data
EditionGPT-5.6 Sol
Week 36, 202621
Week 37, 202620
Week 38, 202622
Week 39, 20266
Week 40, 20266
Week 42, 20266
GPT-5.528
GPT-5.5 across 6 editions, from 27 to 28. Down 5 since the prior edition.

5 vs prior

Data
EditionGPT-5.5
Week 36, 202627
Week 37, 202633
Week 38, 202640
Week 39, 202649
Week 40, 202633
Week 42, 202628
GPT-5.4 mini5
GPT-5.4 mini across 6 editions, from 5 to 5. Unchanged 0 since the prior edition.

unchanged

Data
EditionGPT-5.4 mini
Week 36, 20265
Week 37, 20265
Week 38, 20265
Week 39, 20265
Week 40, 20265
Week 42, 20265
Grok 4.61
Grok 4.6 across 6 editions, from 1 to 1. Unchanged 0 since the prior edition.

unchanged

Data
EditionGrok 4.6
Week 36, 20261
Week 37, 20261
Week 38, 20261
Week 39, 20261
Week 40, 20261
Week 42, 20261
Grok 4.31
Grok 4.3 across 6 editions, from 1 to 1. Unchanged 0 since the prior edition.

unchanged

Data
EditionGrok 4.3
Week 36, 20261
Week 37, 20261
Week 38, 20261
Week 39, 20261
Week 40, 20261
Week 42, 20261
Grok 4.20 (non-reasoning)2
Grok 4.20 (non-reasoning) across 6 editions, from 2 to 2. Unchanged 0 since the prior edition.

unchanged

Data
EditionGrok 4.20 (non-reasoning)
Week 36, 20262
Week 37, 20262
Week 38, 20262
Week 39, 20262
Week 40, 20262
Week 42, 20262
Mistral Medium 3.53
Mistral Medium 3.5 across 6 editions, from 3 to 3. Unchanged 0 since the prior edition.

unchanged

Data
EditionMistral Medium 3.5
Week 36, 20263
Week 37, 2026—
Week 38, 2026—
Week 39, 2026—
Week 40, 2026—
Week 42, 2026—
Mistral Small 42
Mistral Small 4 across 6 editions, from 2 to 2. Unchanged 0 since the prior edition.

unchanged

Data
EditionMistral Small 4
Week 36, 20262
Week 37, 2026—
Week 38, 2026—
Week 39, 2026—
Week 40, 2026—
Week 42, 2026—
DeepSeek V4 Pro74
DeepSeek V4 Pro across 6 editions, from 65 to 74. Down 36 since the prior edition.

36 vs prior

Data
EditionDeepSeek V4 Pro
Week 36, 202665
Week 37, 2026139
Week 38, 202691
Week 39, 2026112
Week 40, 2026110
Week 42, 202674

Position changes

Models whose majority verdict changed between consecutive editions
ModelPrevious positionRevised positionBetween editions
Claude Sonnet 5NegativeAffirmativeWeek 40, 2026 → Week 42, 2026
GPT-5.4 miniAffirmativeNegativeWeek 40, 2026 → Week 42, 2026
Claude Sonnet 5AffirmativeNegativeWeek 39, 2026 → Week 40, 2026
Grok 4.3AffirmativeNegativeWeek 39, 2026 → Week 40, 2026
GPT-5.4 miniNegativeAffirmativeWeek 38, 2026 → Week 39, 2026
Grok 4.3NegativeAffirmativeWeek 37, 2026 → Week 38, 2026
GPT-5.4 miniAffirmativeNegativeWeek 36, 2026 → Week 37, 2026
Grok 4.6AffirmativeNegativeWeek 36, 2026 → Week 37, 2026