Output Loop Bench · Workflows
Posting assistant: build
Why we chose this prompt: Can a fast model write a small, working automation from a plain-English job? Step 1 of 2: the model writes and saves the workflow; the Lab then runs it on a fresh inbox it never saw.
| Model | Maker | Time | Tokens |
|---|---|---|---|
| claude-haiku-5-5 | Anthropic | 287.1s | 3,465,769 |
| nemotron-3.5-lightning-30b-a3b | NVIDIA | 371.9s | 1,040,306 |
| qwen3.8-flash | Alibaba (Qwen) | 417.1s | 648,314 |
| gpt-6-luna | OpenAI | 539.5s | 2,280,003 |
| deepseek-v4.1-flash | DeepSeek | 752.8s | 2,591,772 |
| grok-4.7-build-fast | xAI | 879.4s | 2,976,090 |
| muse-glimmer-30b | Meta | 953.6s | 822,007 |