Skip to content

[Phase 6] Research Review (8-reviewer panel) #50

@jeremymanning

Description

@jeremymanning

Summary

Eight specialist reviewers + a generalist vote on accept / minor_revision / full_revision / reject.

What this phase does

Dispatches the generic research_reviewer plus all 7 specialist reviewers (idea_quality, creativity, implementation_correctness, implementation_completeness, code_quality_research, data_quality_research, filesystem_hygiene). Each writes a review record under projects/<PROJ-ID>/reviews/research/<author>__<YYYY-MM-DD>__research.md with frontmatter (verdict:, score:, artifact_hash:).

Project lifecycle stages handled

  • research_complete
  • research_review

Dependencies

Agents in this phase

Manual test plan (phase-level smoke test)

  1. Stage a project at the entry stage of this phase (see "stages handled" above)
  2. python -m llmxive run --project <PROJ-ID> --max-tasks N (N = number of agents in this phase)
  3. Verify the project transitions through every stage listed above
  4. Run each agent's manual test plan (linked via the sub-issue checklist)
  5. Verify state ends at the entry stage of the next phase, or human_input_needed/blocked on legitimate failure (never silently stuck)

Acceptance criteria (phase-level)

  • Every agent sub-issue passes its acceptance criteria
  • Phase-level smoke test passes end-to-end on a fresh project
  • No silent shortcuts — agents that can't do their work MUST fail loudly (write human_input_needed.yaml or emit verdict: failed), not mark tasks [X] with placeholder content
  • All artifacts written by this phase pass schema validation (where applicable)
  • Run-log entries record outcome, started_at, ended_at for every agent invocation

Metadata

Metadata

Assignees

No one assigned

    Labels

    pipeline-phaseTracks one phase of the agentic pipeline

    Type

    No type

    Projects

    No projects

    Milestone

    No milestone

    Relationships

    None yet

    Development

    No branches or pull requests

    Issue actions