Week 43, 2026 edition
Published October 19, 2026: 12 models, 3 framings, 6 questions, every answer recorded and never revised. Estimated cost of the edition: $0.43. This is the current edition; its full reports are under Reports.
Is a hot dog a sandwich?
No5 of 10 models said no, 4 said yes, 1 said hedged.
Told the answer, Claude Sonnet 5, Claude Haiku 4.5, GPT-5.6 Sol, and 6 more changed their minds.
Cost to ask: $0.10
Is a hamburger a sandwich?
Yesall 10 models said yes.
Told the answer, Claude Sonnet 5, GPT-5.6 Sol, GPT-5.5, and 3 more changed their minds.
Cost to ask: $0.08
Is a taco a sandwich?
Noall 10 models said no.
Told the answer, GPT-5.6 Sol, GPT-5.5, GPT-5.4 mini, and 1 more changed their minds.
Cost to ask: $0.07
Is a grilled cheese a sandwich?
Yesall 10 models said yes.
Told the answer, GPT-5.6 Sol, GPT-5.5, GPT-5.4 mini, and 1 more changed their minds.
Cost to ask: $0.05
Is a wrap a sandwich?
Yes7 of 10 models said yes, 3 said no.
Told the answer, Claude Opus 5, Claude Sonnet 5, Claude Haiku 4.5, and 5 more changed their minds.
Cost to ask: $0.08
Is a tuna melt a sandwich?
Yesall 10 models said yes.
Told the answer, GPT-5.6 Sol, GPT-5.5, GPT-5.4 mini, and 1 more changed their minds.
Cost to ask: $0.06