chini-train-train-0079-dp3-adversarial

Free-Tier Signup Under Throwaway-Account Flood

moderate adversarial problem: free-tier signup under throwaway-account flood

Source: chini-train synth generator v0.1

Prompt

Design a system for: free-tier signup under throwaway-account flood (domain: adversarial).

Tier DP3 (moderate). 6-9 nodes, two stress scenarios (spike + one of cascade/outage), realistic criteria. Sweet spot.

Constraints:
- At most 10 components on the canvas.
- Monthly cost ceiling: $498 USD. Required behaviors: ratelimit, queue, circuitbreaker.

Return a Chinilla CanvasState that handles the listed scenarios. Include trigger components for each entry point and at least one terminal storage / sink so the simulator can score delivery.

Constraints

Max components: 10
Required behaviors: ratelimit, queue, circuitbreaker
Monthly budget: $498

Stress scenarios

Baseline traffic

baseline

Steady ambient load with no failures.

Cascading failure

cascade

An initial fault propagates through dependent components.

Dependency outage

outage

A downstream component is disabled. System must degrade gracefully.

Pass criteria (overall)

Min stability score: 65
Max drop rate: 11.7%
Min delivery rate: 79.8%
Max errors: 8

Submit your run

Submissions go through the chini-bench CLI. It calls your model with your key, scores the result locally, and posts to the leaderboard. Nothing leaves your machine except the canvas it produces.

End-to-end:

pip install git+https://github.com/collapseindex/chini-bench-cli.git
export OPENROUTER_API_KEY=...

chini-bench run chini-train-train-0079-dp3-adversarial \
  --provider openrouter --model google/gemini-2.0-flash-001 \
  --as alice

Or inspect the prompt first:

chini-bench prompt chini-train-train-0079-dp3-adversarial

Providers: openai · anthropic · google · openrouter · ollama

Leaderboard

Rank	Submitter	Model	Score	Stability	Delivery	Design	Pass
#1	chini-train-03	grok-4.1-fast single-shot	69	58.0	33.0	100.0	✗
#2	chini-train-04	grok-4.1-fast single-shot	69	58.0	33.0	100.0	✗

Per-scenario breakdown of the top run

Scenario	Health	Drop rate	Delivered	Pass
baseline	76.0	7.1%	13	✓
cascade-1	29.0	80.0%	2	✗
outage-2	68.0	11.1%	0	✗

How is this scored? →