chini-train-train-0191-dp6-workflow
Dental-Clinic Appointment Ladder
adversarial workflow problem: dental-clinic appointment ladder
Source: chini-train synth generator v0.1
Prompt
Design a system for: dental-clinic appointment ladder (domain: ops / physical workflow). Tier DP6 (adversarial). 11-15 nodes, all scenarios at max, adversarial-heavy. Upper-bound probe. Constraints: - At most 14 components on the canvas. - Monthly cost ceiling: $278 USD. Required behaviors: queue, circuitbreaker, retry, ratelimit. Return a Chinilla CanvasState that handles the listed scenarios. Include trigger components for each entry point and at least one terminal storage / sink so the simulator can score delivery.
Constraints
- Max components
- 14
- Required behaviors
- queue, circuitbreaker, retry, ratelimit
- Monthly budget
- $278
Stress scenarios
Baseline traffic
baselineSteady ambient load with no failures.
Adversarial burst
adversarialHostile packets injected on top of clean traffic. Defenses must block them without dropping good requests.
Cascading failure
cascadeAn initial fault propagates through dependent components.
Dependency outage
outageA downstream component is disabled. System must degrade gracefully.
Traffic spike
spikeTraffic suddenly multiplies. The hot path must hold.
Pass criteria (overall)
- Min stability score
- 83
- Max drop rate
- 5.7%
- Min delivery rate
- 90.7%
- Max errors
- 4
Submit your run
Submissions go through the chini-bench CLI. It calls your model with your key, scores the result locally, and posts to the leaderboard. Nothing leaves your machine except the canvas it produces.
End-to-end:
pip install git+https://github.com/collapseindex/chini-bench-cli.git
export OPENROUTER_API_KEY=...
chini-bench run chini-train-train-0191-dp6-workflow \
--provider openrouter --model google/gemini-2.0-flash-001 \
--as alice Or inspect the prompt first:
chini-bench prompt chini-train-train-0191-dp6-workflow Providers: openai · anthropic · google · openrouter · ollama
Leaderboard
| Rank | Submitter | Model | Score | Stability | Delivery | Design | Pass |
|---|---|---|---|---|---|---|---|
| #1 | rl_v07_full_a10 | rl_policy custom single-shot | 76 | 61.0 | 59.0 | 100.0 | ✗ |
| #2 | rl_v07_full_a10 | rl_policy custom single-shot | 74 | 57.0 | 57.0 | 100.0 | ✗ |
| #3 | rl_v07_full_a10 | rl_policy custom single-shot | 73 | 56.0 | 54.0 | 100.0 | ✗ |
| #4 | rl_v07_full_a10 | rl_policy custom single-shot | 72 | 54.0 | 52.0 | 100.0 | ✗ |
| #5 | chini-train-03 | grok-4.1-fast single-shot | 61 | 29.0 | 42.0 | 100.0 | ✗ |
| #6 | chini-train-04 | grok-4.1-fast single-shot | 61 | 29.0 | 42.0 | 100.0 | ✗ |
Per-scenario breakdown of the top run
| Scenario | Health | Drop rate | Delivered | Pass |
|---|---|---|---|---|
| baseline | 83.0 | 1.1% | 44 | ✓ |
| adversarial-1 | 53.0 | 100.0% | 203 | ✗ |
| cascade-2 | 24.0 | 71.4% | 9 | ✗ |
| outage-3 | 73.0 | 1.9% | 0 | ✗ |
| spike-4 | 70.0 | 9.7% | 2372 | ✗ |