The Grilled Cheese Case, week by week
Two slices, one filling, a pan. If this is not a sandwich nothing is.
Week 36, 2026, up close
Did each model agree with itself?
Every sample's answer, in the order it was taken, under each framing. A row of identical chips is a model that has made up its mind. Y is yes, N is no, ~ is a hedge.
| Model | Control | Asserted | Denied | Self-agreement |
|---|---|---|---|---|
| Claude Opus 5 | 100% | |||
| Claude Sonnet 5 | 100% | |||
| Claude Haiku 4.5 | 100% | |||
| GPT-5.6 Sol | 100% | |||
| GPT-5.5 | 100% | |||
| GPT-5.4 mini | 100% | |||
| Grok 4.6 | 100% | |||
| Grok 4.3 | 100% | |||
| Grok 4.20 (non-reasoning) | 89% | |||
| Mistral Medium 3.5 | 100% | |||
| Mistral Small 4 | 100% | |||
| DeepSeek V4 Pro | 89% |
How much did latency swing?
The fastest and slowest call behind each median, asked plainly. A long bar is a model whose speed you cannot count on.
| Model | Range | Fastest | Median | Slowest |
|---|---|---|---|---|
| Claude Opus 5 | 1.5 s | 1.5 s | 1.6 s | |
| Claude Sonnet 5 | 1.1 s | 1.1 s | 1.2 s | |
| Claude Haiku 4.5 | 611 ms | 633 ms | 1 s | |
| GPT-5.6 Sol | 965 ms | 988 ms | 1.1 s | |
| GPT-5.5 | 1 s | 1.4 s | 1.5 s | |
| GPT-5.4 mini | 702 ms | 1.3 s | 2 s | |
| Grok 4.6 | 3 s | 3.2 s | 4.4 s | |
| Grok 4.3 | 2.6 s | 2.9 s | 3.2 s | |
| Grok 4.20 (non-reasoning) | 356 ms | 395 ms | 396 ms | |
| Mistral Medium 3.5 | 334 ms | 2.4 s | 4.4 s | |
| Mistral Small 4 | 304 ms | 359 ms | 367 ms | |
| DeepSeek V4 Pro | 1.3 s | 1.5 s | 1.7 s |
Asked again the same week
Week 36, 2026 was run 6 times, on September 2 and September 3, 2026. Answers that changed between consecutive runs:
None. Every model gave the same majority answer each time.
Across editions
Week by week
One edition so far. Trends start with the second one; a line through a single point is a drawing, not a measurement.
Position changes
No model has changed its answer on a grilled cheese between consecutive editions.