chini-train-heldout-0012-dp4-personal

Study Schedule With Willpower Drain

hard personal problem: study schedule with willpower drain

Source: chini-train synth generator v0.1

Prompt

Design a system for: study schedule with willpower drain (domain: personal systems / habits).

Tier DP4 (hard). 7-10 nodes, three stress scenarios including adversarial, tight criteria.

Constraints:
- At most 11 components on the canvas.
- Monthly cost ceiling: $366 USD. Required behaviors: queue, circuitbreaker, retry, ratelimit.

Return a Chinilla CanvasState that handles the listed scenarios. Include trigger components for each entry point and at least one terminal storage / sink so the simulator can score delivery.

Constraints

Max components: 11
Required behaviors: queue, circuitbreaker, retry, ratelimit
Monthly budget: $366

Stress scenarios

Baseline traffic

baseline

Steady ambient load with no failures.

Cascading failure

cascade

An initial fault propagates through dependent components.

Traffic spike

spike

Traffic suddenly multiplies. The hot path must hold.

Adversarial burst

adversarial

Hostile packets injected on top of clean traffic. Defenses must block them without dropping good requests.

Pass criteria (overall)

Min stability score: 79
Max drop rate: 8.8%
Min delivery rate: 87.5%
Max errors: 6

Submit your run

Submissions go through the chini-bench CLI. It calls your model with your key, scores the result locally, and posts to the leaderboard. Nothing leaves your machine except the canvas it produces.

End-to-end:

pip install git+https://github.com/collapseindex/chini-bench-cli.git
export OPENROUTER_API_KEY=...

chini-bench run chini-train-heldout-0012-dp4-personal \
  --provider openrouter --model google/gemini-2.0-flash-001 \
  --as alice

Or inspect the prompt first:

chini-bench prompt chini-train-heldout-0012-dp4-personal

Providers: openai · anthropic · google · openrouter · ollama

Leaderboard

Rank	Submitter	Model	Score	Stability	Delivery	Design	Pass
#1	chini-train-08	fmt_a_v2 single-shot	82	55.0	73.0	100.0	✗
#2	chini-train-08	fmt_a_3b single-shot	82	55.0	73.0	100.0	✗
#3	chini-train-08	fmt_a_3b single-shot	82	55.0	73.0	100.0	✗
#4	chini-train-08	rl_v06_run2 single-shot	82	56.0	73.0	100.0	✗
#5	chini-train-08	rl_v07_pilot_a10b_k8_s0 single-shot	82	55.0	73.0	100.0	✗
#6	chini-train-08	rl_v07_pilot_a10b_k8_s2 single-shot	82	55.0	73.0	100.0	✗
#7	chini-train-08	rl_v07_pilot_a10b_k8_s3 single-shot	82	56.0	73.0	100.0	✗
#8	chini-train-08	rl_v07_pilot_a10b_k8_s7 single-shot	82	56.0	73.0	100.0	✗
#9	chini-train-08	rl_v07_full single-shot	82	56.0	73.0	100.0	✗
#10	chini-train-08	base_7b single-shot	78	43.0	69.0	100.0	✗
#11	chini-train-08	base_7b single-shot	78	43.0	69.0	100.0	✗
#12	chini-train-08	base_7b single-shot	78	43.0	69.0	100.0	✗
#13	chini-train-08	base single-shot	78	43.0	69.0	100.0	✗
#14	chini-train-08	base single-shot	75	62.0	27.0	100.0	✗
#15	chini-train-08	base_3b single-shot	75	62.0	27.0	100.0	✗
#16	chini-train-08	base_3b single-shot	75	62.0	27.0	100.0	✗
#17	chini-train-08	base single-shot	75	62.0	27.0	100.0	✗
#18	chini-train-08	fmt_a_v4_opus_7b single-shot	74	51.0	66.0	100.0	✗
#19	chini-train-08	fmt_a_v4_opus_7b single-shot	74	51.0	66.0	100.0	✗
#20	chini-train-08	fmt_a_v5_mixed_7b single-shot	74	47.0	46.0	100.0	✗
#21	chini-train-08	fmt_a_v5 single-shot	74	47.0	46.0	100.0	✗
#22	chini-train-08	rl_v07_pilot_a10b_k8_s5 single-shot	74	46.0	45.0	100.0	✗
#23	chini-train-08	fmtA single-shot	74	47.0	46.0	100.0	✗
#24	chini-train-08	fmt_a_7b single-shot	73	45.0	43.0	100.0	✗
#25	chini-train-08	fmt_a_7b single-shot	73	45.0	43.0	100.0	✗
#26	chini-train-08	fmt_a_7b single-shot	73	45.0	43.0	100.0	✗
#27	chini-train-08	rl_v07_pilot_a10b_k8_s1 single-shot	73	44.0	42.0	100.0	✗
#28	chini-train-08	rl_v07_pilot_a10b_k8_s6 single-shot	73	44.0	42.0	100.0	✗
#29	chini-train-08	rl_v07_pilot_a10b_k8_s4 single-shot	72	42.0	40.0	100.0	✗
#30	chini-train-08	fmt_a single-shot	64	47.0	47.0	75.0	✗

Per-scenario breakdown of the top run

Scenario	Health	Drop rate	Delivered	Pass
baseline	81.0	1.7%	29	✓
cascade-1	30.0	63.6%	8	✗
spike-2	61.0	16.4%	1035	✗
adversarial-3	49.0	88.4%	96	✗

How is this scored? →