Output Loop Bench · Reasoning

Decision race: AI models compared

Every business rated P1–P4 in batches: speed, and agreement with the original research. 7 models tested on the same task.

Rate trade businesses P1–P4

Every model rates the same 544 trade businesses P1–P4 in batches of 50. The top row is the original research banding, shown as a reference rather than the truth (its scores are hidden from the models), with how often each model lands in the same band.

ModelMakerTimeTokens
JevTypeSafe11.6s228,488
Perplexity DecisionsPerplexity16.9s205,695
ClefOther345.1s248,030
claude-haiku-5-5Anthropic721.0s1,204,450
gpt-6-lunaOpenAI796.5s261,061
glm-5.3Z.ai996.7s294,771
qwen3.8-flashAlibaba (Qwen)2234.9s363,024

Open Decision race in the interactive Bench