chini-train-train-0039-dp2-adversarial
Comment System Under Spam-Bot Wave
easy adversarial problem: comment system under spam-bot wave
Source: chini-train synth generator v0.1
Prompt
Design a system for: comment system under spam-bot wave (domain: adversarial). Tier DP2 (easy). 4-6 nodes, single mild stress scenario, moderate criteria. Constraints: - At most 8 components on the canvas. - Monthly cost ceiling: $580 USD. Required behaviors: ratelimit, queue, circuitbreaker. Return a Chinilla CanvasState that handles the listed scenarios. Include trigger components for each entry point and at least one terminal storage / sink so the simulator can score delivery.
Constraints
- Max components
- 8
- Required behaviors
- ratelimit, queue, circuitbreaker
- Monthly budget
- $580
Stress scenarios
Baseline traffic
baselineSteady ambient load with no failures.
Traffic spike
spikeTraffic suddenly multiplies. The hot path must hold.
Pass criteria (overall)
- Min stability score
- 58
- Max drop rate
- 14.0%
- Min delivery rate
- 75.8%
- Max errors
- 10
Submit your run
Submissions go through the chini-bench CLI. It calls your model with your key, scores the result locally, and posts to the leaderboard. Nothing leaves your machine except the canvas it produces.
End-to-end:
pip install git+https://github.com/collapseindex/chini-bench-cli.git
export OPENROUTER_API_KEY=...
chini-bench run chini-train-train-0039-dp2-adversarial \
--provider openrouter --model google/gemini-2.0-flash-001 \
--as aliceOr inspect the prompt first:
chini-bench prompt chini-train-train-0039-dp2-adversarial Providers: openai · anthropic · google · openrouter · ollama
Leaderboard
| Rank | Submitter | Model | Score | Stability | Delivery | Design | Pass |
|---|---|---|---|---|---|---|---|
| #1 | chini-train-03 | opus-4.7 single-shot | 80 | 63.0 | 72.0 | 100.0 | ✗ |
| #2 | chini-train-03 | opus-4.7 single-shot | 80 | 63.0 | 72.0 | 100.0 | ✗ |
| #3 | chini-train-03 | grok-4.1-fast single-shot | 78 | 61.0 | 67.0 | 100.0 | ✗ |
Per-scenario breakdown of the top run
| Scenario | Health | Drop rate | Delivered | Pass |
|---|---|---|---|---|
| baseline | 80.0 | 3.4% | 14 | ✓ |
| spike-1 | 46.0 | 32.2% | 205 | ✗ |