Skip to content

feat: deterministic scoring pipeline, enterprise dashboard, and survey system#114

Merged
sungmanch merged 12 commits intomainfrom
feat/deterministic-scoring-enterprise-survey-20260210
Feb 10, 2026
Merged

feat: deterministic scoring pipeline, enterprise dashboard, and survey system#114
sungmanch merged 12 commits intomainfrom
feat/deterministic-scoring-enterprise-survey-20260210

Conversation

@sungmanch
Copy link
Copy Markdown
Collaborator

Summary

  • Deterministic scoring pipeline: Phase 1.1 (DeterministicScorer) and Phase 1.2 (DeterministicTypeMapper) compute rubric-based scores and type classifications without LLM calls, providing consistent baselines that workers override with
  • Enterprise dashboard: Full team management UI with member table, invite/edit dialogs, skill gap analysis, type distribution chart, and overview stats
  • Survey system: Post-analysis feedback collection with bottom sheet UI, API endpoint, and Supabase migration

Changes

  1. feat(pipeline): add deterministic scoring and type mapping stages
  2. feat(models): extend schemas for deterministic scores and worker insights
  3. feat(workers): integrate deterministic score overrides into insight workers
  4. feat(pipeline): wire deterministic stages into orchestrator pipeline
  5. feat(enterprise): add team dashboard with member management and analytics
  6. feat(survey): add post-analysis survey with bottom sheet UI
  7. refactor(ui): redesign report insights layout and remove dead components
  8. feat(app): add opengraph image, active timer hook, and API route updates
  9. feat(cli): add radar chart renderer and streaming chat display
  10. refactor(desktop): update renderer for new pipeline output format
  11. docs: update agent docs for deterministic scoring pipeline

Test Plan

  • TypeScript compilation passes (npx tsc --noEmit)
  • Unit tests pass (npm test)
  • Manual verification of enterprise dashboard
  • Manual verification of survey bottom sheet
  • CLI radar chart rendering test

Generated with Claude Code using /ship-it

sungmanch and others added 11 commits February 10, 2026 17:37
Phase 1.1 DeterministicScorer computes rubric-based scores from Phase1Output
metrics. Phase 1.2 DeterministicTypeMapper derives primaryType, controlLevel,
and distribution from those scores. Both run deterministically (zero LLM calls)
between data extraction and insight workers.

Co-Authored-By: Claude Opus 4.6 <noreply@anthropic.com>
…ghts

Add deterministicScores and deterministicTypeResult to orchestrator context
types. Update worker insight models with new fields for score overrides.
Extend verbose evaluation schema for enriched output format.

Co-Authored-By: Claude Opus 4.6 <noreply@anthropic.com>
…orkers

Workers now read context.deterministicScores after LLM call and override
overallXxxScore with rubric-computed values. TypeClassifier applies
deterministicTypeResult for primaryType/distribution/controlLevel.
Updated worker prompts for improved calibration guidance.

Co-Authored-By: Claude Opus 4.6 <noreply@anthropic.com>
Orchestrator now runs DeterministicScorer (Phase 1.1) and
DeterministicTypeMapper (Phase 1.2) between data extraction and workers.
applyDeterministicScores() applied as safety net after worker aggregation.
Updated ContentGateway and evaluation assembler for enriched output.

Co-Authored-By: Claude Opus 4.6 <noreply@anthropic.com>
…tics

New enterprise dashboard featuring team overview grid, member table with
invite/edit dialogs, skill gap analysis, type distribution chart, and
stat cards. Backed by useEnterprise hook with mock data for development.

Co-Authored-By: Claude Opus 4.6 <noreply@anthropic.com>
Survey API endpoint stores responses in Supabase. SurveyBottomSheet
component slides up after report viewing with useSurveyTrigger hook
controlling timing. Includes database migration for survey_responses table.

Co-Authored-By: Claude Opus 4.6 <noreply@anthropic.com>
Rework WorkerInsightsSection with inline professional insights in GrowthCard.
Remove unused GrowthAreasSection, ProfessionalInsightSidebar, DimensionSection,
and StickyUnlockBar. Update PremiumValueSummary and ReportTableOfContents
styling. Add enterprise navigation to DashboardSidebar.

Co-Authored-By: Claude Opus 4.6 <noreply@anthropic.com>
Add dynamic OpenGraph image generation. Introduce useActiveTimer hook for
session timing. Update analysis result and progress API routes for enriched
pipeline output. Remove unused useLatestAnalysis hook.

Co-Authored-By: Claude Opus 4.6 <noreply@anthropic.com>
New ASCII radar chart for terminal score visualization. Replace progress
spinner with streaming chat display showing real-time analysis messages.
Update animation system and uploader for enriched pipeline callbacks.

Co-Authored-By: Claude Opus 4.6 <noreply@anthropic.com>
Remove DimensionInsightsTerminal (replaced by web report). Update
usePersonalAnalytics, AnalyzePage, and ResultsPage for enriched evaluation
data. Update Lambda handler and test scripts for deterministic scoring.

Co-Authored-By: Claude Opus 4.6 <noreply@anthropic.com>
Document Phase 1.1/1.2 stages, deterministic score override pattern,
worker log message changes, and rubric calibration notes. Update
architecture, testing, deployment, and troubleshooting guides.

Co-Authored-By: Claude Opus 4.6 <noreply@anthropic.com>
@vercel
Copy link
Copy Markdown

vercel bot commented Feb 10, 2026

The latest updates on your projects. Learn more about Vercel for GitHub.

Project Deployment Actions Updated (UTC)
no-more-ai-slop Ready Ready Preview, Comment Feb 10, 2026 8:51am

Request Review

@sungmanch
Copy link
Copy Markdown
Collaborator Author

Code Review

Found 1 issue (filtered from 9 candidates, threshold: score ≥ 80):

  1. Missing environment variable validation in Survey API (score: 80)

    app/api/survey/route.ts uses non-null assertion (!) for NEXT_PUBLIC_SUPABASE_URL and SUPABASE_SERVICE_ROLE_KEY without validation, unlike other API routes (e.g., app/api/analysis/results/[resultId]/route.ts:134-139) which check for missing env vars before creating the Supabase client. At system boundaries, env var validation should be explicit per project conventions.

    https://github.com/sungmanch/no-more-AI-slop/blob/'"${FULL_SHA}"'/app/api/survey/route.ts#L19-L20


Also reviewed (no blocking issues):

  • CLAUDE.md compliance: All rules followed (language, no-fallback, structured JSON, dual data path filtering)
  • Git history: Clean rebase, no conflicting patterns
  • Previous PR feedback: N/A (no prior review comments)
  • Code comments: No stale comments or debug artifacts in new code

Generated with Claude Code

If useful, react with a thumbs-up. Otherwise, thumbs-down.

Match the validation pattern used in other API routes to throw early
when NEXT_PUBLIC_SUPABASE_URL or SUPABASE_SERVICE_ROLE_KEY is missing.

Co-Authored-By: Claude Opus 4.6 <noreply@anthropic.com>
@sungmanch sungmanch merged commit 5276002 into main Feb 10, 2026
2 checks passed
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment

Labels

None yet

Projects

None yet

Development

Successfully merging this pull request may close these issues.

1 participant