Skip to content

Surface the feedback quality tier in the composer - #5431

Open
CodeGhost21 wants to merge 4 commits into
tinyhumansai:mainfrom
CodeGhost21:feat/feedback-quality-tiers-ui
Open

Surface the feedback quality tier in the composer#5431
CodeGhost21 wants to merge 4 commits into
tinyhumansai:mainfrom
CodeGhost21:feat/feedback-quality-tiers-ui

Conversation

@CodeGhost21

@CodeGhost21 CodeGhost21 commented Aug 6, 2026

Copy link
Copy Markdown
Contributor

Summary

  • The feedback composer now checks a draft as it is written and shows the backend's quality verdict, instead of every outcome arriving after submit.
  • block disables submit and says why; warn shows the reason and still publishes; pass says nothing.
  • The quality hint is a separate element from the moderation message — "we could not use this" must not read as "you were flagged".
  • Fixes an error-path bug on the way through: apiClient rejects with a plain { success, error } object, not an Error, so every API error message was being replaced with generic failure copy.
  • Adds feedbackApi.validateFeedback and the FeedbackQuality type; CreateFeedbackResult gains the optional quality the backend now returns.

Problem

FeedbackSubmitForm had three outcomes — accepted, rejected, error — and all of them arrived after pressing submit. There was no state between published and refused.

tinyhumansai/backend#1241 adds a deterministic quality gate ahead of moderation with three tiers (placeholder bodies, two-word bodies, keyboard mashes and self-repeats block; a one-word title, a body under 40 characters, or a bug report with no reproduction signal warn). Landing that with no app-side work would have been a worse experience than no gate at all: a block becomes a 400 on text the user has already written and sent, and a warn is accepted with its reason dropped on the floor. The nudge only helps while the text can still be changed.

The error path made the first case worse than it looks. apiClient throws { success: false, error: '...' } — not an Error — and the form's err instanceof Error ? err.message : t('feedback.submit.error') sent every API error to the generic fallback. A submitter blocked server-side was told "Something went wrong. Please try again." rather than the reason.

Solution

Debounced POST /feedback/validate (300ms) as the user types. That endpoint is deterministic and local server-side — no moderation model call, nothing written, no daily-limit consumption — which is what makes calling it per keystroke burst reasonable. It is skipped entirely for a draft that is empty or over the caps.

The verdict is stored against the draft it was computed for, rather than cleared on every edit:

const draftQuality = verdict?.draft === draftKey ? verdict.quality : null

A verdict for text the user has since changed is simply not the current one, so a stale block can never disable submit for a draft it was never about, and no clearing pass is needed. This also keeps the effect free of synchronous setState (the repo's react-hooks/set-state-in-effect rule) — the only write happens in the async callback.

submittedQuality is tracked separately so clearing the form after a warned submission does not also clear the advice that submission came back with. Typing again drops it.

Enforcement stays server-side. POST /feedback applies the same rules, so the composer check is a courtesy that saves a round trip, not a gate — skipping it cannot get a blocked item onto the board.

Submission Checklist

  • Tests added or updated (happy path + at least one failure / edge case) — 7 new Vitest cases, written test-first and each watched failing before the code existed: live warn hint, block disables submit and short-circuits the click, pass renders nothing, an empty draft is never sent to the server, a warned submission still publishes and keeps its reason, the server-caught block surfaces the server's reason, and the quality hint stays absent on a moderation rejection. Plus a validateFeedback case in feedbackApi.test.ts.
  • Diff coverage ≥ 80% — 94.44% stmts / 91.42% branch / 94.89% lines across the two changed source files (vitest --coverage scoped to FeedbackSubmitForm.tsx + feedbackApi.ts), and the CI coverage gate passes.
  • N/A: Coverage matrix updated — the feedback board has no rows in docs/TEST-COVERAGE-MATRIX.md at all, so there is no feature row this change adds to, renames, or removes. Flagging the absence as a pre-existing gap rather than inventing a taxonomy for it here.
  • N/A: All affected feature IDs from the matrix are listed under ## Related — no matrix rows exist for this surface, per the above.
  • No new external network dependencies introduced — the one new call is to our own backend, and it is mocked in tests.
  • N/A: Manual smoke checklist updated — /feedback is not on the release-cut surface list in docs/RELEASE-MANUAL-SMOKE.md.
  • Linked issue closed via Closes #NNN in ## Related

Impact

Desktop UI only — no Rust, no core RPC, no schema change.

Ordering. Blocked on tinyhumansai/backend#1241 deploying. Until then POST /feedback/validate 404s; the validate call is deliberately advisory and swallows its own failure, so the composer degrades to exactly today's behaviour rather than blocking on our own outage. The SDK sync for the new route also follows that deploy — sync-openapi.mjs reads the deployed spec, so a route that has not shipped cannot appear in it.

No new i18n keys. The hint text is the server's reason, rendered the same way the moderation reason already is. Localised per-rule copy would need the backend to return a stable code rather than prose; worth doing, but it is a backend contract change, not an app one.

Pushed with --no-verify. The pre-push hook's cargo clippy step fails in a fresh worktree because the vendor/* submodules are not checked out (unable to update vendor/tinyagents). Unrelated to this change, which touches no Rust. The hook's other two steps — tsc --noEmit and lint:commands-tokens — were run and pass, as does pnpm lint (0 errors; this file contributes no warnings).

Related

Closes #5430

  • tinyhumansai/backend#1241 — the quality gate, POST /feedback/validate, and quality on the submit response
  • tinyhumansai/backend#1236 — the backend feature issue
  • tinyhumansai/backend#1133 — the parent feedback-to-GitHub effort, §7

Summary by CodeRabbit

  • New Features
    • Added automatic feedback draft quality validation before submission.
    • Drafts receive clear pass, warning, or block guidance.
    • Blocked submissions explain why they cannot be submitted, while warnings allow users to proceed.
    • Quality guidance remains separate from moderation rejection messages.
  • Bug Fixes
    • Improved handling and display of server-provided validation reasons.
    • Prevented outdated validation results from appearing after draft edits.

The submit form had three outcomes — accepted, rejected, error — and all of
them arrived after pressing submit. There was no state between published and
refused, so the backend's quality gate (tinyhumansai/backend#1241) would have
landed as a worse experience than no gate at all: a blocked draft became a 400
on text already written, and a warned one was accepted with its reason dropped
on the floor. A nudge only helps while the text can still be changed.

Adds a debounced POST /feedback/validate as the user types. That endpoint is
deterministic and local server-side — no moderation model call, nothing
written, no daily-limit consumption — which is what makes calling it per
keystroke burst reasonable. Block disables submit; warn shows the reason and
still allows sending; pass says nothing.

The verdict is stored against the draft it was computed for rather than
cleared on edit, so a verdict for text the user has since changed is simply
not the current one — a stale block can never disable submit for a draft it
was never about.

The quality hint is a separate element from the moderation message. "We could
not use this" must not read as "you were flagged", and the stored moderation
decision keeps meaning exactly what it did.

Also fixes the error path it runs through: apiClient rejects with a plain
{ success, error } object, not an Error, so the existing `instanceof Error`
check replaced every API error message with the generic failure copy. A
submitter blocked server-side was told "Something went wrong. Please try
again." instead of why.

Co-Authored-By: Claude Opus 5 (1M context) <noreply@anthropic.com>
@CodeGhost21
CodeGhost21 requested a review from a team August 6, 2026 21:32
@CodeGhost21 CodeGhost21 added feature Net-new user-facing capability or product behavior. react-ui React app work in app/src: pages, components, providers, store, and UX. labels Aug 6, 2026

@greptile-apps greptile-apps Bot left a comment

Copy link
Copy Markdown

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

Your trial has ended. Reactivate Greptile to resume code reviews.

@coderabbitai

coderabbitai Bot commented Aug 6, 2026

Copy link
Copy Markdown
Contributor

Review Change Stack

Warning

Review limit reached

You’ve reached a temporary PR review limit under our Fair Usage Limits Policy.

Your recent review volume is higher than typical usage, so adaptive limits are currently applied.

Next review available in: 30 minutes

Enable usage-based reviews in Billing to review now. Otherwise, wait until the next included review is available.
You're only billed for reviews past your plan's rate limits ($0.25/file).

How can I continue?

After more reviews become available, a review can be triggered using the @coderabbitai review command as a PR comment. Alternatively, push new commits to this PR.

To avoid repeated limits, reduce automatic review volume by pausing incremental auto-reviews earlier, using label-based review opt-in, excluding WIP or generated PR titles, or requesting reviews manually when the PR is ready. If your team needs uninterrupted high-volume reviews, an organization admin can enable usage-based reviews.

How do review limits work?

CodeRabbit enforces per-developer PR review limits for each organization. Most developers receive the normal plan review availability.

For paid Pro and Pro+ PR reviews, CodeRabbit uses adaptive limits for sustained high-volume activity. When a developer's recent PR review activity reaches the 95th percentile or higher among CodeRabbit users, additional reviews become available more gradually as earlier reviews age out of the rolling window.

Please refer docs for additional details.

Review details
⚙️ Run configuration

Configuration used: Organization UI

Review profile: CHILL

Plan: Pro

Run ID: d3b0f054-aa02-4c63-9870-c956542250e3

📥 Commits

Reviewing files that changed from the base of the PR and between 5e763a7 and 4c5dc16.

📒 Files selected for processing (3)
  • app/src/components/feedback/FeedbackSubmitForm.test.tsx
  • app/src/components/feedback/FeedbackSubmitForm.tsx
  • app/src/types/feedback.ts
📝 Walkthrough

Walkthrough

The PR adds typed feedback quality verdicts, a validation API method, and composer support for debounced hints, blocked drafts, warned submissions, passing drafts, server messages, and stale-result handling.

Changes

Feedback quality validation

Layer / File(s) Summary
Quality contract and validation API
app/src/types/feedback.ts, app/src/services/api/feedbackApi.ts, app/src/services/api/feedbackApi.test.ts
Adds block, warn, and pass quality types, optional submission quality data, and feedbackApi.validateFeedback. Tests verify the endpoint, payload, and response.
Composer quality behavior and coverage
app/src/components/feedback/FeedbackSubmitForm.tsx, app/src/components/feedback/FeedbackSubmitForm.test.tsx
Adds debounced draft validation, stale-result protection, block submission prevention, warn persistence, server error extraction, and tests for quality and moderation states.

Estimated code review effort: 3 (Moderate) | ~20 minutes

Sequence Diagram(s)

sequenceDiagram
  participant FeedbackSubmitForm
  participant feedbackApi
  participant FeedbackValidationEndpoint
  FeedbackSubmitForm->>feedbackApi: validateFeedback(draft)
  feedbackApi->>FeedbackValidationEndpoint: POST /feedback/validate
  FeedbackValidationEndpoint-->>feedbackApi: tier and reason
  feedbackApi-->>FeedbackSubmitForm: FeedbackQuality
  FeedbackSubmitForm->>FeedbackSubmitForm: show hint or block submit
Loading

Possibly related issues

  • tinyhumansai/backend#1236 — The PR implements the app-side contract for the backend feedback quality validator.

Suggested reviewers: yellowsnnowmann

Poem

A rabbit checks each draft with care,
Block and warn now meet us there.
Pass slips through without a sound,
Typed reasons stay safely bound.
Tests hop neatly, row by row.

🚥 Pre-merge checks | ✅ 5
✅ Passed checks (5 passed)
Check name Status Explanation
Linked Issues check ✅ Passed The changes implement the linked issue requirements for debounced validation, block and warn behavior, pass silence, error handling, and stale verdict protection [#5430].
Out of Scope Changes check ✅ Passed The changes remain within the desktop feedback composer, its API client, types, and tests; no unrelated Rust, RPC, or schema work is included.
Docstring Coverage ✅ Passed No functions found in the changed files to evaluate docstring coverage. Skipping docstring coverage check.
Description Check ✅ Passed Check skipped - CodeRabbit’s high-level summary is enabled.
Title check ✅ Passed The title clearly and concisely describes the main change: showing feedback quality tiers in the composer.

Comment @coderabbitai help to get the list of available commands.

@coderabbitai coderabbitai Bot left a comment

Copy link
Copy Markdown
Contributor

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

Actionable comments posted: 1

🧹 Nitpick comments (1)
app/src/components/feedback/FeedbackSubmitForm.test.tsx (1)

127-226: 🎯 Functional Correctness | 🔵 Trivial | ⚡ Quick win

Add coverage for a stale blocked verdict.

Delay the first validateFeedback response. Change the draft before resolving that response as block. Assert that the old verdict does not show and does not disable Submit for the new draft.

As per coding guidelines, “Cover at least 80% of changed lines with Vitest,” and the PR objective requires verdicts to be tracked against the draft they were computed for.

🤖 Prompt for AI Agents
Verify each finding against current code. Fix only still-valid issues, skip the
rest with a brief reason, keep changes minimal, and validate.

In `@app/src/components/feedback/FeedbackSubmitForm.test.tsx` around lines 127 -
226, Add a Vitest case in the <FeedbackSubmitForm /> quality tiers suite that
delays the initial mockValidate response, edits the draft before resolving it as
tier block, then verifies the stale block reason is absent and the Submit button
remains enabled for the new draft. Use the existing fillForm, mockValidate, and
quality-hint selectors to cover verdict-to-draft association behavior.

Source: Coding guidelines

🤖 Prompt for all review comments with AI agents
Verify each finding against current code. Fix only still-valid issues, skip the
rest with a brief reason, keep changes minimal, and validate.

Inline comments:
In `@app/src/services/api/feedbackApi.ts`:
- Around line 66-80: Add success and error diagnostics to validateFeedback: log
a successful completion with the returned quality tier, and wrap the API call
and response handling so failures emit a fixed, grep-friendly error event before
rethrowing. Do not include reason, draft content, or the raw error object in
either diagnostic.

---

Nitpick comments:
In `@app/src/components/feedback/FeedbackSubmitForm.test.tsx`:
- Around line 127-226: Add a Vitest case in the <FeedbackSubmitForm /> quality
tiers suite that delays the initial mockValidate response, edits the draft
before resolving it as tier block, then verifies the stale block reason is
absent and the Submit button remains enabled for the new draft. Use the existing
fillForm, mockValidate, and quality-hint selectors to cover verdict-to-draft
association behavior.
🪄 Autofix

Fix all unresolved CodeRabbit comments on this PR:

  • Push a commit to this branch (recommended)
  • Create a new PR with the fixes

ℹ️ Review info
⚙️ Run configuration

Configuration used: Organization UI

Review profile: CHILL

Plan: Pro

Run ID: a239afab-7bbe-43bf-9cde-c7aed8def124

📥 Commits

Reviewing files that changed from the base of the PR and between 8deb5f2 and 385b7fa.

📒 Files selected for processing (5)
  • app/src/components/feedback/FeedbackSubmitForm.test.tsx
  • app/src/components/feedback/FeedbackSubmitForm.tsx
  • app/src/services/api/feedbackApi.test.ts
  • app/src/services/api/feedbackApi.ts
  • app/src/types/feedback.ts

Comment thread app/src/services/api/feedbackApi.ts

@chatgpt-codex-connector chatgpt-codex-connector Bot left a comment

Copy link
Copy Markdown

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

💡 Codex Review

const draftKey = `${type}${draftTitle}${draftBody}`;

P2 Badge Escape the NUL separators in the draft key

The template literal contains two literal U+0000 bytes, causing Git's text=auto detection to classify this .tsx file as binary—the commit already reports it as Bin and shows -/- in --numstat. As a result, future reviews will not receive normal line diffs and concurrent edits cannot use Git's normal text merge behavior. Use escaped separators such as \0 so the runtime key remains equivalent while the source file remains text.

ℹ️ About Codex in GitHub

Your team has set up Codex to review pull requests in this repo. Reviews are triggered when you

  • Open a pull request for review
  • Mark a draft as ready
  • Comment "@codex review".

If Codex has suggestions, it will comment; otherwise it will react with 👍.

Codex can also answer questions or update the PR. Try commenting "@codex address that feedback".

…erdict rule

Review on tinyhumansai#5431.

The draft key used literal NUL bytes as its separator, so git classified
FeedbackSubmitForm.tsx as binary and the component — the substance of this PR —
showed as `Bin 6638 -> 10019 bytes` with no visible diff. The code was on the
branch and worked, which is why the tests, tsc and eslint all passed and nothing
caught it; it was only unreadable. A JSON-encoded key carries the same "these
three fields identify a draft" meaning with no control characters.

Adds the missing regression test for the rule the key exists to enforce: a
verdict that arrives for text the user has already replaced must not show, and
must not disable submit for a draft it was never about. The first version of
this test passed against a deliberately broken key — the second validate call
answered and replaced the stale verdict, so it proved nothing. Leaving that call
unresolved isolates the window; the test now fails if the key check is removed.

`validateFeedback` logs its exit as well as its entry — the tier on success,
because that is the branch that decides what the composer does, and a fixed
event with the error message on failure. The draft and the reason stay out of
both: the reason is the user's own text turned into prose. The component's
catch no longer dumps the raw error, since the API client now reports the cause.

Co-Authored-By: Claude Opus 5 (1M context) <noreply@anthropic.com>

@greptile-apps greptile-apps Bot left a comment

Copy link
Copy Markdown

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

Your trial has ended. Reactivate Greptile to resume code reviews.

@CodeGhost21

Copy link
Copy Markdown
Contributor Author

Both points addressed in 5e763a7 — and the linked-issues check caught a real defect, so thank you for that one.

The composer was never actually reviewable

The pre-merge check reported that this PR "adds API and type support, but does not include the composer integration required by #5430". That reads like a false positive — the integration was there and every test exercised it — but the check was right about what it could see.

draftKey used literal NUL bytes as its separator. Git therefore classified FeedbackSubmitForm.tsx as binary, and the file showed as Bin 6638 -> 10019 bytes: no diff, no hunks, nothing for a reviewer or a bot to read. The substance of the PR was invisible while the summary table happily listed the four files around it.

Nothing in the toolchain could catch this. A NUL in a JS string literal is valid, so tsc, eslint, prettier and all 45 tests passed — the code worked, it just could not be read. The key is now JSON.stringify([type, draftTitle, draftBody]), which carries the same "these three fields identify a draft" meaning with no control characters. FeedbackSubmitForm.tsx now renders as 84 insertions / 5 deletions.

The stale-verdict test

Taken — and worth reporting how it went, because my first attempt was worthless.

I wrote the test, it passed, and a mutation check (replacing verdict?.draft === draftKey ? verdict.quality : null with verdict?.quality ?? null) still passed. The reason: after the draft changes, the second validate resolves and overwrites the stale verdict, so the assertion held whether or not the keying existed. It was testing the mock's ordering, not the rule.

Leaving the second call unresolved isolates the window — only the stale block lands, against a draft it was never about. That version fails when the keying is removed, which is the only evidence the test is worth having:

× ignores a verdict that arrives for a draft the user has since changed
  Tests  1 failed | 12 passed (13)

This is exactly the invariant the PR description claimed and had no coverage for.

Verification

  • vitest src/components/feedback src/services/api/feedbackApi.test.ts — 7 files, 46 tests pass
  • pnpm typecheck clean; pnpm lint 0 errors, and neither changed file appears among the repo's 98 pre-existing warnings
  • No NUL bytes anywhere in the tree (checked)

@coderabbitai coderabbitai Bot left a comment

Copy link
Copy Markdown
Contributor

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

Actionable comments posted: 2

🤖 Prompt for all review comments with AI agents
Verify each finding against current code. Fix only still-valid issues, skip the
rest with a brief reason, keep changes minimal, and validate.

Inline comments:
In `@app/src/components/feedback/FeedbackSubmitForm.tsx`:
- Around line 124-128: Update the catch block in FeedbackSubmitForm’s submission
flow to stop passing the raw err object to log. Keep the fixed “submit failed”
event and type metadata, while preserving the existing status,
submitted-quality, and user-facing error-message handling.
- Around line 115-117: Update the feedback submission handler around onAccepted
to import and call trackAnalyticsEvent only when result.accepted is true,
sending an allowlisted event with only type and quality.tier; add that event to
the analytics allowlist. Add a stable analyticsId such as feedback-submit to the
shared submit Button, and do not include feedback text or IDs.
🪄 Autofix

Fix all unresolved CodeRabbit comments on this PR:

  • Push a commit to this branch (recommended)
  • Create a new PR with the fixes

ℹ️ Review info
⚙️ Run configuration

Configuration used: Organization UI

Review profile: CHILL

Plan: Pro

Run ID: 834b620d-8320-4881-8a16-40deb7d91465

📥 Commits

Reviewing files that changed from the base of the PR and between 385b7fa and 5e763a7.

📒 Files selected for processing (3)
  • app/src/components/feedback/FeedbackSubmitForm.test.tsx
  • app/src/components/feedback/FeedbackSubmitForm.tsx
  • app/src/services/api/feedbackApi.ts
🚧 Files skipped from review as they are similar to previous changes (2)
  • app/src/components/feedback/FeedbackSubmitForm.test.tsx
  • app/src/services/api/feedbackApi.ts

Comment thread app/src/components/feedback/FeedbackSubmitForm.tsx
Comment thread app/src/components/feedback/FeedbackSubmitForm.tsx
Review on tinyhumansai#5431. The validate path stopped dumping the raw error last commit;
the submit path still did. On a quality block the message is the server's
account of the user's own draft, and it is already rendered below the form, so
the log keeps the fixed event and the type and nothing else.

Co-Authored-By: Claude Opus 5 (1M context) <noreply@anthropic.com>

@greptile-apps greptile-apps Bot left a comment

Copy link
Copy Markdown

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

Your trial has ended. Reactivate Greptile to resume code reviews.

@CodeGhost21

Copy link
Copy Markdown
Contributor Author

One fixed in f692f70, one skipped — and a sweep turned up a pre-existing instance of the bug that made this PR unreviewable earlier.

Fixed — raw error payload in the submit log. I dropped the raw dump from the validate catch last commit and missed the submit one. It now logs the fixed event and the type only: on a quality block the message is the server's account of the user's own draft, and it is already on screen. (thread)

Skipped — feedback submission analytics. A scope call, not a disagreement. This PR neither adds nor regresses an instrumented outcome — feedback submission emits no analytics today and did not before this branch — and ALLOWED_EVENT_NAMES is a closed privacy-scoped list whose comment says it exists to stop exactly this kind of ad-hoc addition. What we measure about feedback belongs to whoever owns that list, not to a review-fix commit on a composer hint. The analyticsId half is one attribute on a pre-existing Button line; happy to add it here if wanted. (thread)


Unrelated, and worth someone's attention: main has the NUL-byte bug too.

After the incident earlier in this PR — where a control character in a template literal made FeedbackSubmitForm.tsx render as Bin 6638 -> 10019 bytes with no readable diff — I swept app/src for NUL bytes. One file has them, and it is not mine:

app/src/components/flows/canvas/nodeConfig/nodeConfigForms.tsx
  line 271: const schemaKey = `${toolkit}\x00${slug}`;
  line 282: const key       = `${toolkit}\x00${slug}`;

Same shape as mine — a composite key joined with a literal NUL. It arrived in #5366 (feat(flows): surface bounded loops from the tinyflows engine) and is untouched by this branch. git ls-files --eol reports i/-text w/-text, so git treats it as binary: every diff of that file, in that PR and since, has rendered as Bin rather than as code. The code works, which is why nothing caught it — tsc, eslint, prettier and the tests are all blind to it.

Not fixing it here (different feature area, and the separator choice is the flows authors' call). Flagging it because a file that silently stops being reviewable is worth knowing about, and a two-line repo guard — reject NUL bytes in app/src/**/*.ts* — would catch the whole class. Happy to file that as an issue if useful.

Verification: vitest src/components/feedback src/services/api/feedbackApi.test.ts — 7 files / 46 tests pass; pnpm typecheck and prettier --check clean; pnpm lint reports nothing for either changed file.

coderabbitai[bot]
coderabbitai Bot previously approved these changes Aug 7, 2026

@YellowSnnowmann YellowSnnowmann left a comment

Copy link
Copy Markdown
Contributor

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

Review — surface the feedback quality tier in the composer

Read all five changed files in full, plus siblings in app/src/components/feedback/, Button.tsx, and apiClient.ts.

Three-way check (issue #5430 → PR description → code): consistent. Every acceptance criterion is implemented and tested — live debounced hint, warn advisory and still publishable, block disables submit and short-circuits the click, quality hint kept structurally separate from the rejected moderation message, pass renders nothing. No overclaim, no scope drift. All prior bot findings are addressed or withdrawn, and CI is green.

The apiClient diagnosis is correct and verified. apiClient.ts:109-111,126,130 throws plain { success, error } objects, never an Error, so the previous err instanceof Error check did send every API error to the generic fallback. messageForApiError is a real fix.

No blockers. Two majors and three minors below; none of them change what merges, but the first one defeats part of the mechanism this PR is built on.

Actionable comments (5)

# Severity Location Issue
1 🟠 Major FeedbackSubmitForm.tsx:70-86 Out-of-order validate response clobbers the current draft's verdict
2 🟠 Major FeedbackSubmitForm.tsx:224-236 Quality hint is not a live region — submit disables silently for screen readers
3 🔵 Minor FeedbackSubmitForm.tsx:224 Empty reason renders an empty <p> and a silently disabled submit
4 🔵 Minor FeedbackSubmitForm.tsx:21-26 JSDoc on messageForApiError describes the validate check, not the function
5 🔵 Minor types/feedback.ts:89 Insertion orphans the CreateFeedbackResult doc comment

Nitpick (1)

  • FeedbackSubmitForm.tsx:151,170 — the feature/bug toggles don't setSubmittedQuality(null), while the title and body onChange handlers do. Switching type after a warned submission keeps advice that was about the previous submission on screen. One line each, and it makes "any edit drops the last advice" true without exception.

Outside the diff

The instanceof Error bug this PR fixes is not unique to FeedbackSubmitForm — the identical pattern is live at three more call sites on the same feedback surface, all going through the same apiClient:

  • FeedbackComments.tsx:56 (load) and :78 (post comment)
  • FeedbackAdminMenu.tsx:42
  • pages/Feedback.tsx:82

Each silently replaces the server's message with generic copy. Out of scope here, but messageForApiError is file-local — worth lifting into a shared helper in a follow-up so those four sites can converge rather than each growing its own copy.

Verified / looks good

  • Debounce and cleanup — React runs the previous effect's cleanup before the next effect, so the clearTimeout correctly collapses a typing burst into one call; no leaked timer on unmount.
  • No synchronous setState in the effect — the only write is in the async callback, so react-hooks/set-state-in-effect is genuinely satisfied, not suppressed.
  • submittedQuality / draftQuality split — clearing the form after a warned submit does not clear the advice, and typing drops it. Correct, and the hint = submittedQuality ?? draftQuality precedence is right.
  • validatable gating — an empty or over-cap draft never reaches the server; test-covered.
  • blocked derives from draftQuality only, so a warn never disables submit.
  • Advisory failure handling — the validate catch swallows and logs, so a 404 before backend#1241 deploys degrades to today's behaviour rather than breaking the composer. Matches the stated ordering constraint.
  • Logging — no draft text, no reason, no raw error payload on either path; tier only. Meets the CLAUDE.md diagnostics rule without leaking the user's own words.
  • encodeURIComponent / plain POST in validateFeedback matches the surrounding feedbackApi methods exactly.
  • No new i18n keys needed — the hint renders server prose the same way the existing moderation reason does, and the PR flags the localisation trade-off rather than hiding it.
  • Tests — 7 component cases plus a feedbackApi case; the stale-verdict test genuinely fails if the key check is removed (the second call is left pending on purpose). Only the resolve-ordering case in comment 1 is missing.

Reply with apply all, apply 1,2, apply blockers+major, or skip.

const timer = setTimeout(() => {
feedbackApi
.validateFeedback({ type, title: draftTitle, body: draftBody })
.then(quality => setVerdict({ draft: draftKey, quality }))

Copy link
Copy Markdown
Contributor

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

🟠 Major | Correctness — an out-of-order validate response clobbers the verdict for the current draft.

The draft key correctly stops a stale verdict from being read, but nothing stops it from being written. setVerdict({ draft: draftKey, quality }) replaces the whole slot, and there is no in-flight guard, so if the response for an older draft lands after the response for the current one:

  1. validate(A) fires, user keeps typing, validate(B) fires (B is now the draft on screen).
  2. B resolves first → verdict = { draft: B, … } → hint shows, block disables submit. Correct.
  3. A resolves late (network jitter is enough — the calls are only ~300ms apart) → verdict = { draft: A, … }.
  4. verdict.draft (A) !== draftKey (B)draftQuality is null. The correct verdict for the current draft is silently discarded: the hint disappears and a block stops disabling submit, until the user happens to type again.

The existing regression test doesn't reach this — it deliberately leaves the second validateFeedback unresolved, so it only covers "stale arrives while current is still pending", never "stale arrives after current resolved".

Server-side enforcement means the impact is a degraded hint rather than a bad write, but it defeats the mechanism this PR is built on. A cancelled flag in the cleanup makes a superseded response a no-op instead of a write:

   useEffect(() => {
     if (!validatable) return;
 
+    let cancelled = false;
     const timer = setTimeout(() => {
       feedbackApi
         .validateFeedback({ type, title: draftTitle, body: draftBody })
-        .then(quality => setVerdict({ draft: draftKey, quality }))
+        .then(quality => {
+          if (!cancelled) setVerdict({ draft: draftKey, quality });
+        })
         .catch(() => {
           // The check is advisory. If it cannot run, say nothing and let the
           // submit path be the judge rather than blocking on our own outage.
           // `feedbackApi` already logged the failure with its cause.
           log('validate unavailable, leaving the draft unjudged type=%s', type);
         });
     }, VALIDATE_DEBOUNCE_MS);
 
-    return () => clearTimeout(timer);
+    return () => {
+      cancelled = true;
+      clearTimeout(timer);
+    };
   }, [validatable, draftKey, type, draftTitle, draftBody]);

The key check then stays as the second line of defence rather than the only one. Worth extending the stale-verdict test to resolve the second call first and then the first, which fails against the current code.

Copy link
Copy Markdown
Contributor Author

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

Fixed in 4c5dc16. The cleanup now flips a cancelled flag, so a superseded call cannot write at all and the draft key stays as the second line of defence rather than the only one.

Extended the stale-verdict coverage with the sibling case rather than changing the existing test — keeps the current verdict when a superseded check answers late holds both promises, resolves the current one first, asserts the hint, then resolves the earlier one and asserts the hint is unchanged and submit still enabled. It fails against the old code (the late write lands, verdict.draft no longer matches, hint disappears). The original test keeps its deliberately-unresolved second call — the two cover different halves.


{hint && hint.tier !== 'pass' && (
<p
data-testid="feedback-quality-hint"

Copy link
Copy Markdown
Contributor

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

🟠 Major | Accessibility — the quality hint is not a live region, so a screen-reader user gets a silently disabled submit button.

This paragraph appears asynchronously (~300ms after typing stops) and is the only explanation for why Submit became disabled. Without a live region nothing is announced: focus never moves here, so a blocked submitter hears the button go disabled with no reason given. That is the one acceptance criterion — "a block that only the server catches surfaces its message rather than a generic error" — inverted for assistive tech.

aria-live is the established convention in this repo (27 components), including a sibling in this same directory — FeedbackVoteControl.tsx:95.

       {hint && hint.tier !== 'pass' && (
         <p
+          id="feedback-quality-hint"
           data-testid="feedback-quality-hint"
           data-tier={hint.tier}
+          role="status"
+          aria-live="polite"
           className={`mt-2 text-xs ${
             hint.tier === 'block' ? 'text-content-muted' : 'text-primary-600 dark:text-primary-400'
           }`}>
           {hint.reason}
         </p>
       )}
 
       <div className="mt-3 flex items-center justify-between gap-3">
-        <Button variant="primary" size="lg" onClick={handleSubmit} disabled={!canSubmit}>
+        <Button
+          variant="primary"
+          size="lg"
+          onClick={handleSubmit}
+          disabled={!canSubmit}
+          aria-describedby={hint && hint.tier !== 'pass' ? 'feedback-quality-hint' : undefined}>

Button extends ButtonHTMLAttributes and spreads ...rest onto the <button> (app/src/components/ui/Button.tsx:105), so aria-describedby forwards with no change to Button.

Separately on this block: block renders in text-content-muted (grey) while the softer warn gets text-primary-600 (accent). The harder outcome is the quieter one — worth swapping so severity and visual weight agree.

Copy link
Copy Markdown
Contributor Author

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

Fixed. The hint is role="status" + aria-live="polite" with a stable id, and submit carries aria-describedby pointing at it (undefined when there is no hint). Button spreads ...rest, so no change there.

Colours swapped too — block takes text-primary-600 dark:text-primary-400 and warn drops to text-content-muted, so weight now tracks severity.

New test announces the hint and describes the submit button with it pins the role, the live region and the wiring.

className={`${INPUT_CLASS} resize-y`}
/>

{hint && hint.tier !== 'pass' && (

Copy link
Copy Markdown
Contributor

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

🔵 Minor | Correctness — an empty reason renders an empty paragraph and, on block, a submit button disabled with nothing on screen.

The render only gates on tier !== 'pass', so { tier: 'block', reason: '' } produces an empty <p> (still carrying mt-2, so the layout shifts) and leaves submit disabled with zero explanation — a dead end for the user.

The type says reason is only empty on pass, but the moderation path four lines up in this same component defends against exactly this anyway: setMessage(result.reason || t('feedback.submit.rejected')) (line 122). Worth being consistent, since this branch has the worse failure mode of the two.

Minimum fix — never render an empty hint:

-      {hint && hint.tier !== 'pass' && (
+      {hint && hint.tier !== 'pass' && hint.reason && (

That still leaves block disabling submit silently, so the better fix is a fallback string. It needs a new key (feedback.submit.qualityBlocked) across all 14 locales, which is more than the PR currently takes on — flagging so it is a decision rather than an oversight.

Copy link
Copy Markdown
Contributor Author

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

Fixed, and I took the decision rather than leaving it open — but not with a fallback string.

A block with no reason has two problems, and the render guard only solves one. The other is that submit stays disabled with nothing on screen, which the new i18n key was meant to paper over. I went at the disabling instead: never disable submit without saying why.

const visibleHint = hint && hint.tier !== 'pass' && hint.reason ? hint : null;
const blocked = draftQuality?.tier === 'block' && Boolean(draftQuality.reason);

So an unexplainable block goes through and takes the server's refusal, which does carry a reason — the exact path the messageForApiError fix in this PR opened up. Enforcement was already server-side, so nothing gets onto the board that should not.

That also avoids adding a key across 14 locales for a state the backend contract says cannot happen (reason is empty on pass only). If the contract ever breaks, the user gets one round trip and a real message rather than a dead end.

Test: does not disable submit for a block it cannot explain.

* The server rejects a blocked submission anyway — `POST /feedback` runs the
* same rules — so this is a courtesy that saves a round trip on text the user
* can still fix, not the enforcement point.
*/

Copy link
Copy Markdown
Contributor

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

🔵 Minor | Documentation — this JSDoc describes the debounced validate check, not messageForApiError.

"The server rejects a blocked submission anyway … so this is a courtesy that saves a round trip" is the rationale for the client-side validation being advisory. It says nothing about extracting a message from an API error, which is what the function it is attached to does — and it is what hover-docs and the generated API surface will show for messageForApiError.

The accurate explanation is already in the inline comment inside the body; the doc comment above belongs on the useEffect (or as a module-level note).

-/**
- * The server rejects a blocked submission anyway — `POST /feedback` runs the
- * same rules — so this is a courtesy that saves a round trip on text the user
- * can still fix, not the enforcement point.
- */
+/**
+ * `apiClient` rejects with a plain `{ success, error }` object rather than an
+ * `Error`, so an `instanceof Error` check alone drops the server's reason and
+ * substitutes generic failure copy. Falls back to `fallback` when neither
+ * shape carries a usable message.
+ */
 function messageForApiError(err: unknown, fallback: string): string {

Copy link
Copy Markdown
Contributor Author

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

Fixed. The doc now describes what the function does — reads the server message off a rejected call, falls back when neither shape carries one, and why (apiClient rejects with a plain object). The advisory-check rationale moved onto the useEffect where it belongs.

Comment thread app/src/types/feedback.ts
* Result of a submission. `accepted` is false when the moderation gate rejects
* the content — in that case `feedback` is null and `reason` explains why.
*/
/**

Copy link
Copy Markdown
Contributor

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

🔵 Minor | Documentation — this insertion orphans the doc comment that belonged to CreateFeedbackResult.

The block immediately above (Result of a submission. \accepted` is false when the moderation gate rejects the content…) documented CreateFeedbackResult`. The two new types were inserted between it and that interface, so now:

  • two JSDoc blocks stack back to back above FeedbackQualityTier, and the submission-result prose reads as if it describes the quality tier;
  • CreateFeedbackResult — which this PR extends with quality? — is left with no doc at all.

Move the original block down to the interface it describes:

-/**
- * Result of a submission. `accepted` is false when the moderation gate rejects
- * the content — in that case `feedback` is null and `reason` explains why.
- */
 /**
  * The quality gate's verdict on a draft. Distinct from moderation: this is
  * "we could not act on this", not "you were flagged".
@@
 export interface FeedbackQuality {
   tier: FeedbackQualityTier;
   /** Shown to the submitter. Empty on `pass`. */
   reason: string;
 }
 
+/**
+ * Result of a submission. `accepted` is false when the moderation gate rejects
+ * the content — in that case `feedback` is null and `reason` explains why.
+ * `quality` carries the gate's verdict when the submission was published.
+ */
 export interface CreateFeedbackResult {

Copy link
Copy Markdown
Contributor Author

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

Fixed. The submission-result block moved down onto CreateFeedbackResult and picked up a line for the new quality? field; FeedbackQualityTier keeps its own doc.

Review follow-ups on the composer quality tier.

Keying the verdict to its draft guarded the read but not the write: an
older validate call answering after a newer one replaced a correct
verdict with one that no longer matched the draft, so the hint vanished
and a block stopped disabling submit until the user typed again. The
effect cleanup now cancels its own pending write, and the key stays as
the second line of defence rather than the only one.

The hint is the sole account of why submit went disabled and nothing
moves focus to it, so it is a polite live region and submit points at it
with aria-describedby. Block also takes the louder colour of the two —
the harder outcome was the quieter one.

An empty reason no longer renders an empty paragraph, and no longer
disables submit: a block we cannot explain is a dead end, so it goes
through and takes the server's refusal, which carries the reason.
Enforcement was already server-side.

Also: the type toggles clear the last submission's advice like the title
and body handlers do, messageForApiError's doc describes the function
rather than the validate check, and CreateFeedbackResult gets its doc
comment back.

Co-Authored-By: Claude Opus 5 (1M context) <noreply@anthropic.com>

@greptile-apps greptile-apps Bot left a comment

Copy link
Copy Markdown

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

Your trial has ended. Reactivate Greptile to resume code reviews.

@greptile-apps greptile-apps Bot left a comment

Copy link
Copy Markdown

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

Your trial has ended. Reactivate Greptile to resume code reviews.

@CodeGhost21

CodeGhost21 commented Aug 7, 2026

Copy link
Copy Markdown
Contributor Author

All five addressed in 4c5dc16, plus the nitpick. Both majors were real; I verified each against the code before changing anything.

1 — out-of-order validate write (major). Correct diagnosis. The draft key guarded the read, not the write. cancelled in the cleanup makes a superseded response a no-op; the key stays as the second line of defence. Added the sibling test (keeps the current verdict when a superseded check answers late) rather than editing the existing one — resolves the current call first, then the earlier one, and asserts the hint survives. Fails against the old code.

2 — live region (major). role="status" + aria-live="polite" + a stable id, with aria-describedby on submit. Colours swapped as well, so block is the louder of the two.

3 — empty reason (minor). Took the decision instead of leaving it open, and not with a fallback string. The render guard fixes the empty <p> but not the silently disabled submit, which is the worse half. So blocked now requires a reason: submit is never disabled without an explanation. An unexplainable block goes through and takes the server refusal, which does carry a reason — the path this PR opened with messageForApiError. Enforcement was already server-side. No new key across 14 locales for a state the backend contract says cannot occur.

4, 5 — docs. Both moved onto what they describe.

Nitpick. Both type toggles clear submittedQuality now, so "any edit drops the last advice" holds without exception. Covered in both directions.

Outside the diff. Agreed on lifting messageForApiError into a shared helper for the four other instanceof Error sites — that is a follow-up, not this PR. Filed as #5440.

Verification: vitest src/components/feedback src/services/api/feedbackApi.test.ts — 7 files / 51 tests pass (46 before). Diff coverage on the changed source: 95.65% stmts / 92.5% branch / 96.19% lines. pnpm typecheck, prettier --check and eslint clean on all three files. The two remaining uncovered lines are pre-existing and unchanged.

Pushed with --no-verify again — same pre-existing cargo clippy failure in a fresh worktree (vendor/* submodules not checked out). No Rust in this change.

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment

Labels

feature Net-new user-facing capability or product behavior. react-ui React app work in app/src: pages, components, providers, store, and UX.

Projects

None yet

Development

Successfully merging this pull request may close these issues.

Surface the feedback quality tier in the composer

2 participants