Output Loop Bench · Reasoning
Decision race: AI models compared
Every business rated P1–P4 in batches: speed, and agreement with the original research. 7 models tested on the same task.
Rate trade businesses P1–P4
Every model rates the same 544 trade businesses P1–P4 in batches of 50. The top row is the original research banding, shown as a reference rather than the truth (its scores are hidden from the models), with how often each model lands in the same band.
| Model | Maker | Time | Tokens |
|---|---|---|---|
| Jev | TypeSafe | 11.6s | 228,488 |
| Perplexity Decisions | Perplexity | 16.9s | 205,695 |
| Clef | Other | 345.1s | 248,030 |
| claude-haiku-5-5 | Anthropic | 721.0s | 1,204,450 |
| gpt-6-luna | OpenAI | 796.5s | 261,061 |
| glm-5.3 | Z.ai | 996.7s | 294,771 |
| qwen3.8-flash | Alibaba (Qwen) | 2234.9s | 363,024 |