-
Notifications
You must be signed in to change notification settings - Fork 0
Roadmap
Living product roadmap. Shipped reflects what is in main today. Later phases are ordered by dependency and recruiter value, not fixed dates.
flowchart LR
V1[v1_foundation]
V15[v1.5_hardening]
V2[v2_platform]
V25[v2.5_plugins]
V3[v3_scale]
V1 --> V15 --> V2 --> V25 --> V3
AssessmentOS is usable end-to-end for take-home / timed technical assessments:
| Area | Shipped |
|---|---|
| Question types | MCQ, coding (I/O + unit), SQL (SQLite), short answer; stubs for video / design / file |
| Coding depth | Multi-file workspace, entry file, time/memory limits, proportional scoring, simple Python I/O checker; unit via pytest / Jest / PHPUnit / JUnit / GoogleTest; mock runner default; Judge0 multi-file unit path |
| Authoring | TipTap rich prompts (quotes, code, images), question bank, sections, pools + randomize, publish + invite flow |
| Candidate | OTP gate, optional Turnstile CAPTCHA, IP rate limits, timers, activity events |
| Review | Per-question scores, anti-cheat timeline + chips, best-score collapse by email |
| Invites | Single-use default; multi-use open links with max uses; email templates + Resend |
| Agents | Recruiter MCP (assessments, questions, bank, sections, pools, invites, results, candidates) |
| Ops | Postgres + Drizzle migrations, local disk assets (STORAGE_DIR), AGPL-3.0 |
- Judge0 unit image — ✅ compose overlay + Dockerfile with pytest/Jest/PHPUnit/JUnit/gtest
-
Cloud object storage for assets — S3/R2 behind
/assets - Redis (or shared) rate limits — for horizontal API scale
- Observability — metrics, runner dashboards
- Admin polish — ✅ bank/pool/section UX + coding defaults + preview run
Exit: Unit coding against Judge0 in staging with durable assets.
- Organizations / teams — ✅ multi-recruiter orgs, roles, shared banks
- SSO — OIDC/SAML (keep password for self-host) — still later
- API hardening — ✅ scoped tokens, audit log, session-complete webhooks
- Exports — ✅ PDF/CSV packs; bulk invite CSV
- Candidate directory — ✅ org list, shortlist, cross-assessment history
5b. Integrity / AI-era anti-cheat — ✅ clickwrap + watermarks, richer signals, risk score, optional webcam snapshots (
docs/Integrity.md)
Landed: Org-scoped API + SDK/MCP, admin org UI, reviewer write-gating, candidate directory. SSO/billing still later.
Exit: Company onboards multiple recruiters under one org with SSO and auditable API access.
File upload, video, design plugins; full interactive checkers.
Live collab, billing (hosted), advanced anti-cheat, multi-region HA.
- Replacing general LMS / ATS products
- Closed-source core (stays AGPL-3.0)
- Guaranteeing every public Judge0 image runs all unit frameworks without the AssessmentOS unit overlay
- Building a full interactive IDE product
- Recruiter can ship a take-home this week
- MCP stays in parity with admin
- Self-host stays simple
- Plugin contract over one-off hacks
Canonical copy also lives at repo root ROADMAP.md; update both when phase exit criteria change.
Edit documentation in the repository docs/ folder on main. This wiki is synced automatically; direct wiki-only edits may be overwritten.