En DashHotdogBenchmark

The Grilled Cheese Case, week by week

Two slices, one filling, a pan. If this is not a sandwich nothing is.

Week 42, 2026, up close

Did each model agree with itself?

Every sample's answer, in the order it was taken, under each framing. A row of identical chips is a model that has made up its mind. Y is yes, N is no, ~ is a hedge.

ModelControlAssertedDeniedSelf-agreement
Claude Opus 5100%
Claude Sonnet 589%
Claude Haiku 4.5100%
GPT-5.6 Sol100%
GPT-5.5100%
GPT-5.4 mini100%
Grok 4.6100%
Grok 4.3100%
Grok 4.20 (non-reasoning)89%
Mistral Medium 3.5no datano datano data—
Mistral Small 4no datano datano data—
DeepSeek V4 Pro100%

How much did latency swing?

The fastest and slowest call behind each median, asked plainly. A long bar is a model whose speed you cannot count on.

ModelRangeFastestMedianSlowest
Claude Opus 5770 ms865 ms958 ms
Claude Sonnet 5935 ms974 ms974 ms
Claude Haiku 4.5561 ms592 ms597 ms
GPT-5.6 Sol920 ms950 ms959 ms
GPT-5.5971 ms1.1 s1.1 s
GPT-5.4 mini756 ms1 s2 s
Grok 4.64.1 s4.5 s5.1 s
Grok 4.38.9 s10.1 s11.3 s
Grok 4.20 (non-reasoning)420 ms433 ms437 ms
DeepSeek V4 Pro1.1 s1.5 s1.6 s

Asked again the same week

Week 42, 2026 was run once. When a week is re-run, the earlier runs are kept and the answers that changed between them show up here.

Across editions

Verdict share by edition
Week 36, 2026: 12 affirmative, 0 negative, 0 non-committal . Open the edition. 12W36 Week 37, 2026: 10 affirmative, 0 negative, 0 non-committal . Open the edition. 10W37 Week 38, 2026: 10 affirmative, 0 negative, 0 non-committal . Open the edition. 10W38 Week 39, 2026: 10 affirmative, 0 negative, 0 non-committal . Open the edition. 10W39 Week 40, 2026: 10 affirmative, 0 negative, 0 non-committal . Open the edition. 10W40 Week 42, 2026: 10 affirmative, 0 negative, 0 non-committal . Open the edition. 10W42Edition (ISO week)

Each model contributes one vote, based on its majority verdict across samples, so a model sampled three times does not outvote one sampled once.

Show the data
Verdict share by edition — data
EditionAffirmativeNegativeNon-committalTotal
Week 36, 2026120012
Week 37, 2026100010
Week 38, 2026100010
Week 39, 2026100010
Week 40, 2026100010
Week 42, 2026100010

How easily each model changes its mind

Framing sensitivity per edition: the share of questions where telling the model the answer changed it. Editions that ran only the control leave a gap.

Claude Opus 58%
Claude Opus 5 across 6 editions, from 17% to 8%. Down 8% since the prior edition.

8% vs prior

Data
EditionClaude Opus 5
Week 36, 202617%
Week 37, 202617%
Week 38, 20268%
Week 39, 202617%
Week 40, 202617%
Week 42, 20268%
Claude Sonnet 525%
Claude Sonnet 5 across 6 editions, from 33% to 25%. Unchanged 0% since the prior edition.

unchanged

Data
EditionClaude Sonnet 5
Week 36, 202633%
Week 37, 202633%
Week 38, 202633%
Week 39, 202633%
Week 40, 202625%
Week 42, 202625%
Claude Haiku 4.525%
Claude Haiku 4.5 across 6 editions, from 25% to 25%. Unchanged 0% since the prior edition.

unchanged

Data
EditionClaude Haiku 4.5
Week 36, 202625%
Week 37, 202625%
Week 38, 202625%
Week 39, 202617%
Week 40, 202625%
Week 42, 202625%
GPT-5.6 Sol50%
GPT-5.6 Sol across 6 editions, from 50% to 50%. Unchanged 0% since the prior edition.

unchanged

Data
EditionGPT-5.6 Sol
Week 36, 202650%
Week 37, 202650%
Week 38, 202650%
Week 39, 202650%
Week 40, 202650%
Week 42, 202650%
GPT-5.550%
GPT-5.5 across 6 editions, from 50% to 50%. Unchanged 0% since the prior edition.

unchanged

Data
EditionGPT-5.5
Week 36, 202650%
Week 37, 202650%
Week 38, 202650%
Week 39, 202650%
Week 40, 202650%
Week 42, 202650%
GPT-5.4 mini50%
GPT-5.4 mini across 6 editions, from 50% to 50%. Unchanged 0% since the prior edition.

unchanged

Data
EditionGPT-5.4 mini
Week 36, 202650%
Week 37, 202650%
Week 38, 202650%
Week 39, 202650%
Week 40, 202650%
Week 42, 202650%
Grok 4.68%
Grok 4.6 across 6 editions, from 17% to 8%. Unchanged 0% since the prior edition.

unchanged

Data
EditionGrok 4.6
Week 36, 202617%
Week 37, 20268%
Week 38, 20268%
Week 39, 20268%
Week 40, 20268%
Week 42, 20268%
Grok 4.317%
Grok 4.3 across 6 editions, from 17% to 17%. Unchanged 0% since the prior edition.

unchanged

Data
EditionGrok 4.3
Week 36, 202617%
Week 37, 20268%
Week 38, 202617%
Week 39, 202617%
Week 40, 202617%
Week 42, 202617%
Grok 4.20 (non-reasoning)33%
Grok 4.20 (non-reasoning) across 6 editions, from 33% to 33%. Down 17% since the prior edition.

17% vs prior

Data
EditionGrok 4.20 (non-reasoning)
Week 36, 202633%
Week 37, 202650%
Week 38, 202650%
Week 39, 202655%
Week 40, 202650%
Week 42, 202633%
Mistral Medium 3.550%
Mistral Medium 3.5 across 6 editions, from 50% to 50%. Unchanged 0% since the prior edition.

unchanged

Data
EditionMistral Medium 3.5
Week 36, 202650%
Week 37, 2026—
Week 38, 2026—
Week 39, 2026—
Week 40, 2026—
Week 42, 2026—
Mistral Small 450%
Mistral Small 4 across 6 editions, from 50% to 50%. Unchanged 0% since the prior edition.

unchanged

Data
EditionMistral Small 4
Week 36, 202650%
Week 37, 2026—
Week 38, 2026—
Week 39, 2026—
Week 40, 2026—
Week 42, 2026—
DeepSeek V4 Pro17%
DeepSeek V4 Pro across 6 editions, from 17% to 17%. Unchanged 0% since the prior edition.

unchanged

Data
EditionDeepSeek V4 Pro
Week 36, 202617%
Week 37, 202617%
Week 38, 202617%
Week 39, 202625%
Week 40, 202617%
Week 42, 202617%

Median latency by model

Claude Opus 5865 ms
Claude Opus 5 across 6 editions, from 1.5 s to 865 ms. Down 1 s since the prior edition.

1 s vs prior

Data
EditionClaude Opus 5
Week 36, 20261.5 s
Week 37, 20262.1 s
Week 38, 20262 s
Week 39, 20261.6 s
Week 40, 20261.9 s
Week 42, 2026865 ms
Claude Sonnet 5974 ms
Claude Sonnet 5 across 6 editions, from 1.1 s to 974 ms. Down 374 ms since the prior edition.

374 ms vs prior

Data
EditionClaude Sonnet 5
Week 36, 20261.1 s
Week 37, 20261.4 s
Week 38, 20261.1 s
Week 39, 20261.6 s
Week 40, 20261.3 s
Week 42, 2026974 ms
Claude Haiku 4.5592 ms
Claude Haiku 4.5 across 6 editions, from 633 ms to 592 ms. Up 58 ms since the prior edition.

58 ms vs prior

Data
EditionClaude Haiku 4.5
Week 36, 2026633 ms
Week 37, 2026634 ms
Week 38, 2026564 ms
Week 39, 2026542 ms
Week 40, 2026533 ms
Week 42, 2026592 ms
GPT-5.6 Sol950 ms
GPT-5.6 Sol across 6 editions, from 988 ms to 950 ms. Down 637 ms since the prior edition.

637 ms vs prior

Data
EditionGPT-5.6 Sol
Week 36, 2026988 ms
Week 37, 20261 s
Week 38, 20261.2 s
Week 39, 20261.7 s
Week 40, 20261.6 s
Week 42, 2026950 ms
GPT-5.51.1 s
GPT-5.5 across 6 editions, from 1.4 s to 1.1 s. Down 43 ms since the prior edition.

43 ms vs prior

Data
EditionGPT-5.5
Week 36, 20261.4 s
Week 37, 20261.2 s
Week 38, 20261.4 s
Week 39, 20261.8 s
Week 40, 20261.1 s
Week 42, 20261.1 s
GPT-5.4 mini1 s
GPT-5.4 mini across 6 editions, from 1.3 s to 1 s. Down 131 ms since the prior edition.

131 ms vs prior

Data
EditionGPT-5.4 mini
Week 36, 20261.3 s
Week 37, 2026814 ms
Week 38, 2026933 ms
Week 39, 2026886 ms
Week 40, 20261.1 s
Week 42, 20261 s
Grok 4.64.5 s
Grok 4.6 across 6 editions, from 3.2 s to 4.5 s. Up 619 ms since the prior edition.

619 ms vs prior

Data
EditionGrok 4.6
Week 36, 20263.2 s
Week 37, 20264.4 s
Week 38, 20265 s
Week 39, 20265.3 s
Week 40, 20263.9 s
Week 42, 20264.5 s
Grok 4.310.1 s
Grok 4.3 across 6 editions, from 2.9 s to 10.1 s. Up 7.6 s since the prior edition.

7.6 s vs prior

Data
EditionGrok 4.3
Week 36, 20262.9 s
Week 37, 20262.4 s
Week 38, 20262.2 s
Week 39, 20262.2 s
Week 40, 20262.5 s
Week 42, 202610.1 s
Grok 4.20 (non-reasoning)433 ms
Grok 4.20 (non-reasoning) across 6 editions, from 395 ms to 433 ms. Down 40 ms since the prior edition.

40 ms vs prior

Data
EditionGrok 4.20 (non-reasoning)
Week 36, 2026395 ms
Week 37, 2026446 ms
Week 38, 2026455 ms
Week 39, 2026461 ms
Week 40, 2026473 ms
Week 42, 2026433 ms
Mistral Medium 3.52.4 s
Mistral Medium 3.5 across 6 editions, from 2.4 s to 2.4 s. Unchanged 0 ms since the prior edition.

unchanged

Data
EditionMistral Medium 3.5
Week 36, 20262.4 s
Week 37, 2026—
Week 38, 2026—
Week 39, 2026—
Week 40, 2026—
Week 42, 2026—
Mistral Small 4359 ms
Mistral Small 4 across 6 editions, from 359 ms to 359 ms. Unchanged 0 ms since the prior edition.

unchanged

Data
EditionMistral Small 4
Week 36, 2026359 ms
Week 37, 2026—
Week 38, 2026—
Week 39, 2026—
Week 40, 2026—
Week 42, 2026—
DeepSeek V4 Pro1.5 s
DeepSeek V4 Pro across 6 editions, from 1.5 s to 1.5 s. Up 219 ms since the prior edition.

219 ms vs prior

Data
EditionDeepSeek V4 Pro
Week 36, 20261.5 s
Week 37, 20261.8 s
Week 38, 20261.5 s
Week 39, 20261.4 s
Week 40, 20261.3 s
Week 42, 20261.5 s

Median output tokens by model

Claude Opus 523
Claude Opus 5 across 6 editions, from 19 to 23. Unchanged 0 since the prior edition.

unchanged

Data
EditionClaude Opus 5
Week 36, 202619
Week 37, 202628
Week 38, 202634
Week 39, 202625
Week 40, 202623
Week 42, 202623
Claude Sonnet 56
Claude Sonnet 5 across 6 editions, from 5 to 6. Up 1 since the prior edition.

1 vs prior

Data
EditionClaude Sonnet 5
Week 36, 20265
Week 37, 20265
Week 38, 20266
Week 39, 20266
Week 40, 20265
Week 42, 20266
Claude Haiku 4.55
Claude Haiku 4.5 across 6 editions, from 5 to 5. Unchanged 0 since the prior edition.

unchanged

Data
EditionClaude Haiku 4.5
Week 36, 20265
Week 37, 20265
Week 38, 20265
Week 39, 20265
Week 40, 20265
Week 42, 20265
GPT-5.6 Sol6
GPT-5.6 Sol across 6 editions, from 6 to 6. Unchanged 0 since the prior edition.

unchanged

Data
EditionGPT-5.6 Sol
Week 36, 20266
Week 37, 20266
Week 38, 20266
Week 39, 20266
Week 40, 20266
Week 42, 20266
GPT-5.520
GPT-5.5 across 6 editions, from 20 to 20. Unchanged 0 since the prior edition.

unchanged

Data
EditionGPT-5.5
Week 36, 202620
Week 37, 202620
Week 38, 202619
Week 39, 202619
Week 40, 202620
Week 42, 202620
GPT-5.4 mini5
GPT-5.4 mini across 6 editions, from 5 to 5. Unchanged 0 since the prior edition.

unchanged

Data
EditionGPT-5.4 mini
Week 36, 20265
Week 37, 20265
Week 38, 20265
Week 39, 20265
Week 40, 20265
Week 42, 20265
Grok 4.61
Grok 4.6 across 6 editions, from 1 to 1. Unchanged 0 since the prior edition.

unchanged

Data
EditionGrok 4.6
Week 36, 20261
Week 37, 20261
Week 38, 20261
Week 39, 20261
Week 40, 20261
Week 42, 20261
Grok 4.31
Grok 4.3 across 6 editions, from 1 to 1. Unchanged 0 since the prior edition.

unchanged

Data
EditionGrok 4.3
Week 36, 20261
Week 37, 20261
Week 38, 20261
Week 39, 20261
Week 40, 20261
Week 42, 20261
Grok 4.20 (non-reasoning)1
Grok 4.20 (non-reasoning) across 6 editions, from 1 to 1. Unchanged 0 since the prior edition.

unchanged

Data
EditionGrok 4.20 (non-reasoning)
Week 36, 20261
Week 37, 20261
Week 38, 20261
Week 39, 20261
Week 40, 20261
Week 42, 20261
Mistral Medium 3.53
Mistral Medium 3.5 across 6 editions, from 3 to 3. Unchanged 0 since the prior edition.

unchanged

Data
EditionMistral Medium 3.5
Week 36, 20263
Week 37, 2026—
Week 38, 2026—
Week 39, 2026—
Week 40, 2026—
Week 42, 2026—
Mistral Small 43
Mistral Small 4 across 6 editions, from 3 to 3. Unchanged 0 since the prior edition.

unchanged

Data
EditionMistral Small 4
Week 36, 20263
Week 37, 2026—
Week 38, 2026—
Week 39, 2026—
Week 40, 2026—
Week 42, 2026—
DeepSeek V4 Pro39
DeepSeek V4 Pro across 6 editions, from 33 to 39. Down 7 since the prior edition.

7 vs prior

Data
EditionDeepSeek V4 Pro
Week 36, 202633
Week 37, 202635
Week 38, 202646
Week 39, 202644
Week 40, 202646
Week 42, 202639

Position changes

No model has changed its answer on a grilled cheese between consecutive editions.