seed(elixir-oban-worker): SKLD-bench v2.1 challenge pool (100 challenges)

[ty13r]

SKLD-bench v2.1 challenge pool: elixir-oban-worker

Third of 7 families being shipped this morning (ecto-schema-changeset PR #9, ecto-query-writer next).

Pool stats

• Total challenges: 100 (binary curve target hit exactly)
• Tier distribution: easy 35 / medium 35 / hard 22 / legendary 8
• Held-out: 20 balanced across tiers
• Capability coverage: 11 capabilities + 1 foundation = 12 dimensions

Capability coverage

Capability	Primary	Secondary	E	M	H	L
testing-workers	12	—	4	5	2	1
return-values	10	12	5	4	1	0
unique-constraints	10	4	3	4	2	1
args-serialization ⭐	9	25	4	3	1	1
worker-philosophy (F)	9	37	3	2	3	1
cron-scheduling	8	2	3	2	3	0
recurring-jobs-vs-cron	8	5	3	2	2	1
transactional-jobs	8	7	1	3	3	1
queues-and-priority	7	7	2	3	1	1
retry-strategy	7	16	2	2	2	1
perform-callback-basics	6	22	4	1	1	0
telemetry-and-observability	6	1	1	4	1	0

All 12 capabilities hit the ≥5 binary-family minimum. ⭐ args-serialization is the highest-impact safety fix (atom keys in args + struct serialization, both per plugin iron laws).

All three named Oban failure modes covered

1. Non-idempotent jobs → transactional-jobs (8) + perform-callback-basics (6)
2. Atom keys instead of strings in args → args-serialization (9)
3. Storing Elixir structs in args → args-serialization (same cluster)

Post-hoc calibration manifest

Drafting subagent was cut off by the Max subscription rate limit at the final _calibration.json step. All other content authored cleanly. Manifest generated post-hoc by walking the actual challenge files.

Score.py

Authored by drafting subagent. Uses regex for String.to_atom in worker bodies, atom-key detection in args (%{user_id: patterns), return-value protocol tags (:ok, {:ok, _}, {:error, _}, {:discard, _}, {:snooze, _}), presence of unique: blocks. Not re-validated post-hoc.

Research provenance

38 citations across 12 capabilities. Key source: oliver-kriska/claude-elixir-phoenix (three explicit Oban iron laws: idempotency, atom keys, stored structs).

Tier methodology

Heuristic per SEEDING-PLAN.md item 4.

🤖 Generated with Claude Code