-
Notifications
You must be signed in to change notification settings - Fork 39
Closed
Labels
Description
Summary
PR #334 added 4 dbt assessors with a combined 26% weight (10+10+3+3). Need to verify that non-dbt projects are unaffected when these assessors return is_applicable=False.
Question
How does the scoring engine handle assessors that return is_applicable=False?
- If it skips them and re-normalizes weights: no impact (correct behavior)
- If it includes them with a 0 score: every non-dbt project's overall score drops
What to check
- Look at the scoring aggregation logic (likely in
src/agentready/services/or the assessment pipeline) - Confirm
is_applicable=Falseassessors are excluded from weight normalization - Run a before/after comparison on a non-dbt repo (e.g., any Python project on the leaderboard)
Context
The Tier 1 assessor count went from 6 to 10 with this PR. If weights aren't re-normalized, Tier 1 now sums to more than intended.
Found in
PR #334 — Feature/add dbt support
🤖 Generated with Claude Code
Reactions are currently unavailable