Merged
Conversation
b99bf4c to
fa1529f
Compare
6
approved these changes
Mar 24, 2026
This file contains hidden or bidirectional Unicode text that may be interpreted or compiled differently than what appears below. To review, open the file in an editor that reveals hidden Unicode characters.
Learn more about bidirectional Unicode characters
Sign up for free
to join this conversation on GitHub.
Already have an account?
Sign in to comment
Add this suggestion to a batch that can be applied as a single commit.This suggestion is invalid because no changes were made to the code.Suggestions cannot be applied while the pull request is closed.Suggestions cannot be applied while viewing a subset of changes.Only one suggestion per line can be applied in a batch.Add this suggestion to a batch that can be applied as a single commit.Applying suggestions on deleted lines is not supported.You must change the existing code in this line in order to create a valid suggestion.Outdated suggestions cannot be applied.This suggestion has been applied or marked resolved.Suggestions cannot be applied from pending reviews.Suggestions cannot be applied on multi-line comments.Suggestions cannot be applied while the pull request is queued to merge.Suggestion cannot be applied right now. Please check back later.
Automated fix fix for
Lint/HashCompareByIdentitycorpus conformance.Details
Lint/HashCompareByIdentityResult
Changes
Agent conversation excerpt
RuboCop flags this pattern too. So the FP is likely a config/exclusion issue (the file is under
vendor/). Let me investigate further.The file has syntax errors under RuboCop's parser, so RuboCop never runs the cop on it. Let me verify with a higher target Ruby version.
Root cause identified: RuboCop's parser fails on this file (syntax errors at line 224+), so it never runs
Lint/HashCompareByIdentity. Prism handles the file fine, so nitrocop reports offenses RuboCop can't even check. This is a parser-level difference, not a cop detection bug.I'll document this finding on the cop struct and commit.
Now let me verify the tests still pass.
Tests pass. Now let me commit.
The 2 extended-corpus FPs are in a file with syntax `
Summary: The 2 extended-corpus FPs for
Lint/HashCompareByIdentityare not a cop detection bug. Both are inzaml.rbwhich has syntax errors (invalid multibyte escapes) that break RuboCop's parser — RuboCop only reportsLint/Syntaxand never runs any other cop on that file. Prism handles the file fine, so nitrocop correctly detects theobject_idkey pattern.This is a parser-level difference that would need to be fixed at the engine/runner level (skipping non-syntax cops on files with parse errors), not in individual cop implementations. I've documented the finding on the cop struct.
Task prompt (4222 tokens)
Fix Lint/HashCompareByIdentity — 2 FP, 0 FN
Cross-Corpus Risk
Risk class: extended-only edge case against a standard-perfect baseline.
Treat the extended examples as a narrow edge case, not proof that the broad pattern is safe.
Any carve-out that reduces the extended FP/FN count but regresses the standard corpus is a bad fix.
Prefer the smallest context-specific change you can justify from RuboCop behavior and the vendor spec.
This is concentrated in only a few repos, which increases the risk of overfitting to one local shape.
Instructions
You are fixing ONE cop in nitrocop, a Rust Ruby linter that uses Prism for parsing.
Current state: 203 matches, 2 false positives, 0 false negatives.
Focus on: FP (nitrocop flags code RuboCop does not).
Workflow
behavior on BOTH the specific FP case AND the general pattern:
tests/fixtures/cops/lint/hash_compare_by_identity/offense.rbwith^annotationtests/fixtures/cops/lint/hash_compare_by_identity/no_offense.rbcargo test --lib -- cop::lint::hash_compare_by_identitysrc/cop/lint/hash_compare_by_identity.rscargo test --lib -- cop::lint::hash_compare_by_identity///doc comment on the cop struct documenting what you found and fixedFixture Format
Mark offenses with
^markers on the line AFTER the offending source line:The
^characters must align with the offending columns. The message format isLint/HashCompareByIdentity: <message text>.If your test passes immediately
If you add a test case and it passes without code changes, the corpus mismatch is
caused by config/context differences, not a detection bug.
Do NOT loop trying to make the test fail. Instead:
src/config/or the cop's config handling, not detection logica
///comment on the cop struct and commitCRITICAL: Avoid regressions in the opposite direction
When fixing FPs, your change MUST NOT suppress legitimate detections. When fixing FNs,
your change MUST NOT flag code that RuboCop accepts. A fix that eliminates a few issues
in one direction but introduces hundreds in the other is a catastrophic regression.
Before exempting a category of patterns, verify with RuboCop that the general case
is still an offense:
If RuboCop flags the general pattern but not your specific case, the difference is in
a narrow context (e.g., enclosing structure, receiver type, argument count) — your fix
must target that specific context, not the broad category.
Rule of thumb: if your fix adds an early
returnorcontinuethat skips a wholenode type, operator class, or naming pattern, it's probably too broad. Prefer adding a
condition that matches the SPECIFIC differentiating context.
Rules
src/cop/lint/hash_compare_by_identity.rsandtests/fixtures/cops/lint/hash_compare_by_identity/cargo test --lib -- cop::lint::hash_compare_by_identityto verify your fix (do NOT run the full test suite)git stashStart Here
Use the existing corpus data to focus on the most concentrated regressions first.
Helpful local commands:
python3 scripts/investigate-cop.py Lint/HashCompareByIdentity --repos-onlypython3 scripts/investigate-cop.py Lint/HashCompareByIdentity --contextpython3 scripts/verify-cop-locations.py Lint/HashCompareByIdentityTop FP repos:
pitluga__supply_drop__d64c50c(2 FP) — exampleexamples/vendored-puppet/vendor/puppet-2.7.8/lib/puppet/util/zaml.rb:73Representative FP examples:
pitluga__supply_drop__d64c50c: examples/vendored-puppet/vendor/puppet-2.7.8/lib/puppet/util/zaml.rb:73— UseHash#compare_by_identityinstead of usingobject_idfor keys.pitluga__supply_drop__d64c50c: examples/vendored-puppet/vendor/puppet-2.7.8/lib/puppet/util/zaml.rb:77— UseHash#compare_by_identityinstead of usingobject_idfor keys.Pre-diagnostic Results
Diagnosis Summary
Each example was tested by running nitrocop on the extracted source in isolation
with
--force-default-configto determine if the issue is a code bug or config issue.Note: source context is truncated and may not parse perfectly. If a diagnosis
seems wrong (e.g., your test passes immediately for a 'CODE BUG'), treat it as
a config/context issue instead.
FP #1:
pitluga__supply_drop__d64c50c: examples/vendored-puppet/vendor/puppet-2.7.8/lib/puppet/util/zaml.rb:73CONFIRMED false positive — CODE BUG
nitrocop incorrectly flags this pattern in isolation.
Fix the detection logic to not flag this.
Enclosing structure: method body (line:
def label_for(obj))The offense is inside this structure — this is likely WHY
RuboCop does not flag it. Your fix should detect this context.
Full source context (add relevant parts to no_offense.rb):
Message:
UseHash#compare_by_identityinstead of usingobject_idfor keys.FP #2:
pitluga__supply_drop__d64c50c: examples/vendored-puppet/vendor/puppet-2.7.8/lib/puppet/util/zaml.rb:77CONFIRMED false positive — CODE BUG
nitrocop incorrectly flags this pattern in isolation.
Fix the detection logic to not flag this.
Enclosing structure: method body (line:
def new_label_for(obj))The offense is inside this structure — this is likely WHY
RuboCop does not flag it. Your fix should detect this context.
Full source context (add relevant parts to no_offense.rb):
Message:
UseHash#compare_by_identityinstead of usingobject_idfor keys.Current Rust Implementation
src/cop/lint/hash_compare_by_identity.rsRuboCop Ruby Implementation (ground truth)
vendor/rubocop/lib/rubocop/cop/lint/hash_compare_by_identity.rbRuboCop Test Excerpts
vendor/rubocop/spec/rubocop/cop/lint/hash_compare_by_identity_spec.rbCurrent Fixture: offense.rb
tests/fixtures/cops/lint/hash_compare_by_identity/offense.rbCurrent Fixture: no_offense.rb
tests/fixtures/cops/lint/hash_compare_by_identity/no_offense.rb