chini-train-train-0201-dp1-workflow
Coffee-Shop Order Pipeline At Morning Rush
trivial workflow problem: coffee-shop order pipeline at morning rush
Source: chini-train synth generator v0.1
Prompt
Design a system for: coffee-shop order pipeline at morning rush (domain: ops / physical workflow). Tier DP1 (trivial). 3-5 nodes, baseline scenario only, lax criteria. Sanity floor. Constraints: - At most 6 components on the canvas. - Monthly cost ceiling: $676 USD. Required behaviors: queue. Return a Chinilla CanvasState that handles the listed scenarios. Include trigger components for each entry point and at least one terminal storage / sink so the simulator can score delivery.
Constraints
- Max components
- 6
- Required behaviors
- queue
- Monthly budget
- $676
Stress scenarios
Baseline traffic
baselineSteady ambient load with no failures.
Pass criteria (overall)
- Min stability score
- 58
- Max drop rate
- 16.8%
- Min delivery rate
- 75.0%
- Max errors
- 12
Submit your run
Submissions go through the chini-bench CLI. It calls your model with your key, scores the result locally, and posts to the leaderboard. Nothing leaves your machine except the canvas it produces.
End-to-end:
pip install git+https://github.com/collapseindex/chini-bench-cli.git
export OPENROUTER_API_KEY=...
chini-bench run chini-train-train-0201-dp1-workflow \
--provider openrouter --model google/gemini-2.0-flash-001 \
--as alice Or inspect the prompt first:
chini-bench prompt chini-train-train-0201-dp1-workflow Providers: openai · anthropic · google · openrouter · ollama
Leaderboard
| Rank | Submitter | Model | Score | Stability | Delivery | Design | Pass |
|---|---|---|---|---|---|---|---|
| #1 | rl_v07_full_a10 | rl_policy custom single-shot | 96 | 87.0 | 100.0 | 100.0 | ✓ |
| #2 | rl_v07_full_a10 | rl_policy custom single-shot | 96 | 87.0 | 100.0 | 100.0 | ✓ |
| #3 | rl_v07_full_a10 | rl_policy custom single-shot | 96 | 87.0 | 100.0 | 100.0 | ✓ |
| #4 | rl_v07_full_a10 | rl_policy custom single-shot | 96 | 87.0 | 100.0 | 100.0 | ✓ |
| #5 | chini-train-03 | grok-4.1-fast single-shot | 94 | 82.0 | 100.0 | 100.0 | ✓ |
Per-scenario breakdown of the top run
| Scenario | Health | Drop rate | Delivered | Pass |
|---|---|---|---|---|
| baseline | 87.0 | 0.0% | 30 | ✓ |