chini-train-train-0229-dp2-adversarial
Rate-Limited Search Under Enumeration Attack
easy adversarial problem: rate-limited search under enumeration attack
Source: chini-train synth generator v0.1
Prompt
Design a system for: rate-limited search under enumeration attack (domain: adversarial). Tier DP2 (easy). 4-6 nodes, single mild stress scenario, moderate criteria. Constraints: - At most 8 components on the canvas. - Monthly cost ceiling: $552 USD. Required behaviors: ratelimit, queue, circuitbreaker. Return a Chinilla CanvasState that handles the listed scenarios. Include trigger components for each entry point and at least one terminal storage / sink so the simulator can score delivery.
Constraints
- Max components
- 8
- Required behaviors
- ratelimit, queue, circuitbreaker
- Monthly budget
- $552
Stress scenarios
Baseline traffic
baselineSteady ambient load with no failures.
Dependency outage
outageA downstream component is disabled. System must degrade gracefully.
Pass criteria (overall)
- Min stability score
- 67
- Max drop rate
- 13.6%
- Min delivery rate
- 80.0%
- Max errors
- 10
Submit your run
Submissions go through the chini-bench CLI. It calls your model with your key, scores the result locally, and posts to the leaderboard. Nothing leaves your machine except the canvas it produces.
End-to-end:
pip install git+https://github.com/collapseindex/chini-bench-cli.git
export OPENROUTER_API_KEY=...
chini-bench run chini-train-train-0229-dp2-adversarial \
--provider openrouter --model google/gemini-2.0-flash-001 \
--as alice Or inspect the prompt first:
chini-bench prompt chini-train-train-0229-dp2-adversarial Providers: openai · anthropic · google · openrouter · ollama
Leaderboard
| Rank | Submitter | Model | Score | Stability | Delivery | Design | Pass |
|---|---|---|---|---|---|---|---|
| #1 | chini-train-03 | grok-4.1-fast single-shot | 81 | 76.0 | 47.0 | 100.0 | ✗ |
Per-scenario breakdown of the top run
| Scenario | Health | Drop rate | Delivered | Pass |
|---|---|---|---|---|
| baseline | 82.0 | 3.4% | 14 | ✓ |
| outage-1 | 69.0 | 11.1% | 0 | ✗ |