En DashHotdogBenchmark

The Wrap Question, week by week

One piece of bread, rolled. The structural cousin of the hot dog.

Week 42, 2026, up close

Did each model agree with itself?

Every sample's answer, in the order it was taken, under each framing. A row of identical chips is a model that has made up its mind. Y is yes, N is no, ~ is a hedge.

ModelControlAssertedDeniedSelf-agreement
Claude Opus 5100%
Claude Sonnet 589%
Claude Haiku 4.5100%
GPT-5.6 Sol100%
GPT-5.5100%
GPT-5.4 mini100%
Grok 4.6100%
Grok 4.3100%
Grok 4.20 (non-reasoning)89%
Mistral Medium 3.5no datano datano data—
Mistral Small 4no datano datano data—
DeepSeek V4 Pro89%

How much did latency swing?

The fastest and slowest call behind each median, asked plainly. A long bar is a model whose speed you cannot count on.

ModelRangeFastestMedianSlowest
Claude Opus 52.3 s3.4 s9 s
Claude Sonnet 51 s1.1 s1.2 s
Claude Haiku 4.5464 ms519 ms520 ms
GPT-5.6 Sol914 ms926 ms1.3 s
GPT-5.51.1 s1.2 s1.3 s
GPT-5.4 mini596 ms697 ms1.2 s
Grok 4.612.1 s14.5 s15.3 s
Grok 4.310.2 s13.4 s15.3 s
Grok 4.20 (non-reasoning)441 ms570 ms9 s
DeepSeek V4 Pro1.6 s1.8 s2 s

Asked again the same week

Week 42, 2026 was run once. When a week is re-run, the earlier runs are kept and the answers that changed between them show up here.

Across editions

Verdict share by edition
Week 36, 2026: 6 affirmative, 6 negative, 0 non-committal . Open the edition. 66W36 Week 37, 2026: 7 affirmative, 3 negative, 0 non-committal . Open the edition. 73W37 Week 38, 2026: 7 affirmative, 3 negative, 0 non-committal . Open the edition. 73W38 Week 39, 2026: 7 affirmative, 3 negative, 0 non-committal . Open the edition. 73W39 Week 40, 2026: 7 affirmative, 3 negative, 0 non-committal . Open the edition. 73W40 Week 42, 2026: 5 affirmative, 5 negative, 0 non-committal . Open the edition. 55W42Edition (ISO week)

Each model contributes one vote, based on its majority verdict across samples, so a model sampled three times does not outvote one sampled once.

Show the data
Verdict share by edition — data
EditionAffirmativeNegativeNon-committalTotal
Week 36, 202666012
Week 37, 202673010
Week 38, 202673010
Week 39, 202673010
Week 40, 202673010
Week 42, 202655010

How easily each model changes its mind

Framing sensitivity per edition: the share of questions where telling the model the answer changed it. Editions that ran only the control leave a gap.

Claude Opus 58%
Claude Opus 5 across 6 editions, from 17% to 8%. Down 8% since the prior edition.

8% vs prior

Data
EditionClaude Opus 5
Week 36, 202617%
Week 37, 202617%
Week 38, 20268%
Week 39, 202617%
Week 40, 202617%
Week 42, 20268%
Claude Sonnet 525%
Claude Sonnet 5 across 6 editions, from 33% to 25%. Unchanged 0% since the prior edition.

unchanged

Data
EditionClaude Sonnet 5
Week 36, 202633%
Week 37, 202633%
Week 38, 202633%
Week 39, 202633%
Week 40, 202625%
Week 42, 202625%
Claude Haiku 4.525%
Claude Haiku 4.5 across 6 editions, from 25% to 25%. Unchanged 0% since the prior edition.

unchanged

Data
EditionClaude Haiku 4.5
Week 36, 202625%
Week 37, 202625%
Week 38, 202625%
Week 39, 202617%
Week 40, 202625%
Week 42, 202625%
GPT-5.6 Sol50%
GPT-5.6 Sol across 6 editions, from 50% to 50%. Unchanged 0% since the prior edition.

unchanged

Data
EditionGPT-5.6 Sol
Week 36, 202650%
Week 37, 202650%
Week 38, 202650%
Week 39, 202650%
Week 40, 202650%
Week 42, 202650%
GPT-5.550%
GPT-5.5 across 6 editions, from 50% to 50%. Unchanged 0% since the prior edition.

unchanged

Data
EditionGPT-5.5
Week 36, 202650%
Week 37, 202650%
Week 38, 202650%
Week 39, 202650%
Week 40, 202650%
Week 42, 202650%
GPT-5.4 mini50%
GPT-5.4 mini across 6 editions, from 50% to 50%. Unchanged 0% since the prior edition.

unchanged

Data
EditionGPT-5.4 mini
Week 36, 202650%
Week 37, 202650%
Week 38, 202650%
Week 39, 202650%
Week 40, 202650%
Week 42, 202650%
Grok 4.68%
Grok 4.6 across 6 editions, from 17% to 8%. Unchanged 0% since the prior edition.

unchanged

Data
EditionGrok 4.6
Week 36, 202617%
Week 37, 20268%
Week 38, 20268%
Week 39, 20268%
Week 40, 20268%
Week 42, 20268%
Grok 4.317%
Grok 4.3 across 6 editions, from 17% to 17%. Unchanged 0% since the prior edition.

unchanged

Data
EditionGrok 4.3
Week 36, 202617%
Week 37, 20268%
Week 38, 202617%
Week 39, 202617%
Week 40, 202617%
Week 42, 202617%
Grok 4.20 (non-reasoning)33%
Grok 4.20 (non-reasoning) across 6 editions, from 33% to 33%. Down 17% since the prior edition.

17% vs prior

Data
EditionGrok 4.20 (non-reasoning)
Week 36, 202633%
Week 37, 202650%
Week 38, 202650%
Week 39, 202655%
Week 40, 202650%
Week 42, 202633%
Mistral Medium 3.550%
Mistral Medium 3.5 across 6 editions, from 50% to 50%. Unchanged 0% since the prior edition.

unchanged

Data
EditionMistral Medium 3.5
Week 36, 202650%
Week 37, 2026—
Week 38, 2026—
Week 39, 2026—
Week 40, 2026—
Week 42, 2026—
Mistral Small 450%
Mistral Small 4 across 6 editions, from 50% to 50%. Unchanged 0% since the prior edition.

unchanged

Data
EditionMistral Small 4
Week 36, 202650%
Week 37, 2026—
Week 38, 2026—
Week 39, 2026—
Week 40, 2026—
Week 42, 2026—
DeepSeek V4 Pro17%
DeepSeek V4 Pro across 6 editions, from 17% to 17%. Unchanged 0% since the prior edition.

unchanged

Data
EditionDeepSeek V4 Pro
Week 36, 202617%
Week 37, 202617%
Week 38, 202617%
Week 39, 202625%
Week 40, 202617%
Week 42, 202617%

Median latency by model

Claude Opus 53.4 s
Claude Opus 5 across 6 editions, from 2.6 s to 3.4 s. Down 134 ms since the prior edition.

134 ms vs prior

Data
EditionClaude Opus 5
Week 36, 20262.6 s
Week 37, 20263.6 s
Week 38, 20263.6 s
Week 39, 20263 s
Week 40, 20263.6 s
Week 42, 20263.4 s
Claude Sonnet 51.1 s
Claude Sonnet 5 across 6 editions, from 1.1 s to 1.1 s. Down 891 ms since the prior edition.

891 ms vs prior

Data
EditionClaude Sonnet 5
Week 36, 20261.1 s
Week 37, 20261.4 s
Week 38, 20261.1 s
Week 39, 20261.2 s
Week 40, 20261.9 s
Week 42, 20261.1 s
Claude Haiku 4.5519 ms
Claude Haiku 4.5 across 6 editions, from 633 ms to 519 ms. Down 20 ms since the prior edition.

20 ms vs prior

Data
EditionClaude Haiku 4.5
Week 36, 2026633 ms
Week 37, 2026672 ms
Week 38, 2026514 ms
Week 39, 2026474 ms
Week 40, 2026539 ms
Week 42, 2026519 ms
GPT-5.6 Sol926 ms
GPT-5.6 Sol across 6 editions, from 1.3 s to 926 ms. Down 83 ms since the prior edition.

83 ms vs prior

Data
EditionGPT-5.6 Sol
Week 36, 20261.3 s
Week 37, 20261.7 s
Week 38, 20261.2 s
Week 39, 20261.9 s
Week 40, 20261 s
Week 42, 2026926 ms
GPT-5.51.2 s
GPT-5.5 across 6 editions, from 1.3 s to 1.2 s. Down 285 ms since the prior edition.

285 ms vs prior

Data
EditionGPT-5.5
Week 36, 20261.3 s
Week 37, 20261.4 s
Week 38, 20261.5 s
Week 39, 20261.8 s
Week 40, 20261.4 s
Week 42, 20261.2 s
GPT-5.4 mini697 ms
GPT-5.4 mini across 6 editions, from 678 ms to 697 ms. Down 476 ms since the prior edition.

476 ms vs prior

Data
EditionGPT-5.4 mini
Week 36, 2026678 ms
Week 37, 2026650 ms
Week 38, 20264.1 s
Week 39, 2026906 ms
Week 40, 20261.2 s
Week 42, 2026697 ms
Grok 4.614.5 s
Grok 4.6 across 6 editions, from 7 s to 14.5 s. Up 6.2 s since the prior edition.

6.2 s vs prior

Data
EditionGrok 4.6
Week 36, 20267 s
Week 37, 20267 s
Week 38, 20268.8 s
Week 39, 20268.2 s
Week 40, 20268.4 s
Week 42, 202614.5 s
Grok 4.313.4 s
Grok 4.3 across 6 editions, from 4.6 s to 13.4 s. Up 10 s since the prior edition.

10 s vs prior

Data
EditionGrok 4.3
Week 36, 20264.6 s
Week 37, 20263.9 s
Week 38, 20263.8 s
Week 39, 20263.2 s
Week 40, 20263.4 s
Week 42, 202613.4 s
Grok 4.20 (non-reasoning)570 ms
Grok 4.20 (non-reasoning) across 6 editions, from 385 ms to 570 ms. Up 101 ms since the prior edition.

101 ms vs prior

Data
EditionGrok 4.20 (non-reasoning)
Week 36, 2026385 ms
Week 37, 2026437 ms
Week 38, 2026438 ms
Week 39, 2026455 ms
Week 40, 2026469 ms
Week 42, 2026570 ms
Mistral Medium 3.5332 ms
Mistral Medium 3.5 across 6 editions, from 332 ms to 332 ms. Unchanged 0 ms since the prior edition.

unchanged

Data
EditionMistral Medium 3.5
Week 36, 2026332 ms
Week 37, 2026—
Week 38, 2026—
Week 39, 2026—
Week 40, 2026—
Week 42, 2026—
Mistral Small 4355 ms
Mistral Small 4 across 6 editions, from 355 ms to 355 ms. Unchanged 0 ms since the prior edition.

unchanged

Data
EditionMistral Small 4
Week 36, 2026355 ms
Week 37, 2026—
Week 38, 2026—
Week 39, 2026—
Week 40, 2026—
Week 42, 2026—
DeepSeek V4 Pro1.8 s
DeepSeek V4 Pro across 6 editions, from 4 s to 1.8 s. Up 158 ms since the prior edition.

158 ms vs prior

Data
EditionDeepSeek V4 Pro
Week 36, 20264 s
Week 37, 20262 s
Week 38, 20261.8 s
Week 39, 20262.3 s
Week 40, 20261.6 s
Week 42, 20261.8 s

Median output tokens by model

Claude Opus 5193
Claude Opus 5 across 6 editions, from 125 to 193. Down 9 since the prior edition.

9 vs prior

Data
EditionClaude Opus 5
Week 36, 2026125
Week 37, 2026178
Week 38, 2026193
Week 39, 2026137
Week 40, 2026202
Week 42, 2026193
Claude Sonnet 533
Claude Sonnet 5 across 6 editions, from 7 to 33. Down 54 since the prior edition.

54 vs prior

Data
EditionClaude Sonnet 5
Week 36, 20267
Week 37, 20267
Week 38, 20265
Week 39, 20265
Week 40, 202687
Week 42, 202633
Claude Haiku 4.55
Claude Haiku 4.5 across 6 editions, from 5 to 5. Unchanged 0 since the prior edition.

unchanged

Data
EditionClaude Haiku 4.5
Week 36, 20265
Week 37, 20265
Week 38, 20265
Week 39, 20265
Week 40, 20265
Week 42, 20265
GPT-5.6 Sol6
GPT-5.6 Sol across 6 editions, from 24 to 6. Unchanged 0 since the prior edition.

unchanged

Data
EditionGPT-5.6 Sol
Week 36, 202624
Week 37, 20266
Week 38, 20266
Week 39, 20266
Week 40, 20266
Week 42, 20266
GPT-5.532
GPT-5.5 across 6 editions, from 39 to 32. Down 13 since the prior edition.

13 vs prior

Data
EditionGPT-5.5
Week 36, 202639
Week 37, 202639
Week 38, 202637
Week 39, 202642
Week 40, 202645
Week 42, 202632
GPT-5.4 mini5
GPT-5.4 mini across 6 editions, from 5 to 5. Unchanged 0 since the prior edition.

unchanged

Data
EditionGPT-5.4 mini
Week 36, 20265
Week 37, 20265
Week 38, 20265
Week 39, 20265
Week 40, 20265
Week 42, 20265
Grok 4.61
Grok 4.6 across 6 editions, from 1 to 1. Unchanged 0 since the prior edition.

unchanged

Data
EditionGrok 4.6
Week 36, 20261
Week 37, 20261
Week 38, 20261
Week 39, 20261
Week 40, 20261
Week 42, 20261
Grok 4.31
Grok 4.3 across 6 editions, from 1 to 1. Unchanged 0 since the prior edition.

unchanged

Data
EditionGrok 4.3
Week 36, 20261
Week 37, 20261
Week 38, 20261
Week 39, 20261
Week 40, 20261
Week 42, 20261
Grok 4.20 (non-reasoning)2
Grok 4.20 (non-reasoning) across 6 editions, from 2 to 2. Unchanged 0 since the prior edition.

unchanged

Data
EditionGrok 4.20 (non-reasoning)
Week 36, 20262
Week 37, 20262
Week 38, 20262
Week 39, 20262
Week 40, 20262
Week 42, 20262
Mistral Medium 3.53
Mistral Medium 3.5 across 6 editions, from 3 to 3. Unchanged 0 since the prior edition.

unchanged

Data
EditionMistral Medium 3.5
Week 36, 20263
Week 37, 2026—
Week 38, 2026—
Week 39, 2026—
Week 40, 2026—
Week 42, 2026—
Mistral Small 42
Mistral Small 4 across 6 editions, from 2 to 2. Unchanged 0 since the prior edition.

unchanged

Data
EditionMistral Small 4
Week 36, 20262
Week 37, 2026—
Week 38, 2026—
Week 39, 2026—
Week 40, 2026—
Week 42, 2026—
DeepSeek V4 Pro79
DeepSeek V4 Pro across 6 editions, from 155 to 79. Down 7 since the prior edition.

7 vs prior

Data
EditionDeepSeek V4 Pro
Week 36, 2026155
Week 37, 202667
Week 38, 202666
Week 39, 2026103
Week 40, 202686
Week 42, 202679

Position changes

Models whose majority verdict changed between consecutive editions
ModelPrevious positionRevised positionBetween editions
Claude Opus 5AffirmativeNegativeWeek 40, 2026 → Week 42, 2026
Grok 4.20 (non-reasoning)AffirmativeNegativeWeek 40, 2026 → Week 42, 2026
Claude Opus 5NegativeAffirmativeWeek 36, 2026 → Week 37, 2026