En DashHotdogBenchmark
Source on GitHub: fork it, clone it

The reports

One straight-faced report per question.

6 questions, 12 models, 3 framings, 6 editions so far. Verdicts, latency, tokens, cost, framing sensitivity, and every verbatim answer. Latest: Week 42, 2026, October 12, 2026. Next edition: Monday, October 19. Subscribe by RSS or JSON feed.

Contested the field split

  1. Is a hot dog a sandwich?

    Split5 of 10 models say yes, 5 say no.

    Told the answer, Claude Sonnet 5, Claude Haiku 4.5, GPT-5.6 Sol, and 6 more changed their minds.

  2. Is a wrap a sandwich?

    Split5 of 10 models say yes, 5 say no.

    Told the answer, Claude Opus 5, Claude Sonnet 5, Claude Haiku 4.5, and 5 more changed their minds.

Settled every model agreed

  1. Is a hamburger a sandwich?

    Yesall 10 models say yes.

    Told the answer, Claude Sonnet 5, GPT-5.6 Sol, GPT-5.5, and 3 more changed their minds.

  2. Is a taco a sandwich?

    Noall 10 models say no.

    Told the answer, GPT-5.6 Sol, GPT-5.5, GPT-5.4 mini, and 1 more changed their minds.

  3. Is a grilled cheese a sandwich?

    Yesall 10 models say yes.

    Told the answer, GPT-5.6 Sol, GPT-5.5, and GPT-5.4 mini changed their minds.

  4. Is a tuna melt a sandwich?

    Yesall 10 models say yes.

    Told the answer, GPT-5.6 Sol, GPT-5.5, and GPT-5.4 mini changed their minds.

Up next

Accepted, not yet asked.

2 questions have been accepted and join the next edition they are switched on for.

Submit your own question

Ask the models something.

Send it in. An accepted question appears here under Up next, credited to you if you want, then joins an edition and gets its own report. Every question is asked the same way, so it ends with One word answer.; we add that if you leave it off.

Sent as Is a hot dog a sandwich? One word answer.

Where it goes:

Every edition, and each question week by week, is under Editions. The scores are defined on the methodology page.