En DashHotdogBenchmark

The reports

One straight-faced report per question.

3 questions, 11 models, 3 framings, 1 edition so far. Verdicts, latency, tokens, cost, framing sensitivity, and every verbatim answer. Latest: Week 36, 2026, September 2, 2026.

  1. Is a hot dog a sandwich?

    Yes6 of 11 models say yes, 5 say no.

    Minds
    Told the answer, Claude Sonnet 5, Claude Haiku 4.5, GPT-5.6 Sol, and 6 more changed their minds.
    Least sure
    Claude Sonnet 5
    Clock
    Mistral Small 4 in 347 ms, Grok 4.6 in 12.6 s

    Read the report →Tell them a hot dog is a sandwichTell them a hot dog is not a sandwichPDFWeek by week

  2. Is a hamburger a sandwich?

    Yesall 11 models say yes.

    Minds
    Told the answer, Claude Sonnet 5, GPT-5.6 Sol, GPT-5.5, and 4 more changed their minds.
    Clock
    Mistral Small 4 in 340 ms, Grok 4.6 in 7 s

    Read the report →Tell them a hamburger is a sandwichTell them a hamburger is not a sandwichPDFWeek by week

  3. Is a taco a sandwich?

    Noall 11 models say no.

    Minds
    Told the answer, GPT-5.6 Sol, GPT-5.5, GPT-5.4 mini, and 3 more changed their minds.
    Clock
    Mistral Medium 3.5 in 365 ms, Grok 4.6 in 10.5 s

    Read the report →Tell them a taco is a sandwichTell them a taco is not a sandwichPDFWeek by week

Older editions are in the archive. The scores are defined on the methodology page.