Skip to content

🐛 Strip underscore separators from a big int in the schema numeric checks#199

Merged
frenck merged 1 commit into
mainfrom
frenck/schema-underscore-bigint
Jul 3, 2026
Merged

🐛 Strip underscore separators from a big int in the schema numeric checks#199
frenck merged 1 commit into
mainfrom
frenck/schema-underscore-bigint

Conversation

@frenck

@frenck frenck commented Jul 3, 2026

Copy link
Copy Markdown
Owner

Breaking change

None. It makes the schema numeric keywords apply to a big-integer value that has YAML 1.1 _ digit separators, where they were previously skipped. Values only become more correctly validated.

Proposed change

A YAML 1.1 big-int literal keeps its _ digit separators in the resolved value (20_000_000_000_000_000_001). The schema numeric helpers parsed that lexeme directly: as_f64 failed on the underscores and returned None, so check_numeric bailed out at its first line and skipped every numeric keyword, and as_i128 failed too, so even the exact multipleOf path was unreachable. The net effect was that an odd big integer with separators passed multipleOf: 2 (and slipped past minimum/maximum).

Both helpers now strip _ before parsing, matching how the value itself resolves, so the numeric checks run and are exact again. Follow-up to #196.

Found while addressing the same underscore issue flagged in the OPT_SORT_KEYS review (#197).

Type of change

  • Dependency or tooling upgrade
  • Bugfix (non-breaking change that fixes an issue)
  • New feature (non-breaking change that adds functionality)
  • Deprecation (replaces or removes a feature, with a migration path)
  • Breaking change (a fix or feature that changes existing behavior)
  • Code quality, refactor, or test-only change
  • Documentation only

Additional information

Checklist

  • I have read the AI Policy, and this pull request was not created by an autonomous agent.
  • I fully understand the code in this pull request and can explain every line, including any AI-assisted changes.
  • The change is covered by tests, and uv run pytest passes locally. A pull request cannot be merged unless CI is green.
  • uv run ruff check . and uv run ruff format --check . pass.
  • cargo fmt --check and cargo clippy --all-targets -- -D warnings pass.
  • Round-trip fidelity is preserved: an unmodified document still re-emits byte-for-byte.
  • No commented-out or dead code is left in the pull request.

If the change is user-facing:

  • Documentation under docs/ is added or updated, and docs/verify_examples.py still passes.

…ecks

A YAML 1.1 big-int literal keeps its `_` digit separators in the resolved value
(`20_000_000_000_000_000_001`). The schema numeric helpers parsed that lexeme
directly: `as_f64` failed on the underscores and returned `None`, so
`check_numeric` bailed out at its first line and skipped every numeric keyword,
and `as_i128` failed too, so even the exact `multipleOf` path was unreachable.
The net effect was that an odd big integer with separators passed `multipleOf: 2`
(and slipped past `minimum`/`maximum`).

Both helpers now strip `_` before parsing, matching how the value itself
resolves, so the numeric checks run and are exact again. Follow-up to #196.

Found while addressing the same underscore issue in the OPT_SORT_KEYS review.
Copilot AI review requested due to automatic review settings July 3, 2026 15:35
@frenck frenck added the bugfix Inconsistencies or issues which will cause a problem for users or implementers. label Jul 3, 2026
@coderabbitai

coderabbitai Bot commented Jul 3, 2026

Copy link
Copy Markdown

Warning

Review limit reached

@frenck, you've reached your PR review limit, so we couldn't start this review.

Next review available in: 24 minutes

Enable usage-based reviews in Billing to review now. Otherwise, wait until the next included review is available.
You're only billed for reviews past your plan's rate limits ($0.25/file).

How can I continue?

After more reviews become available, a review can be triggered using the @coderabbitai review command as a PR comment. Alternatively, push new commits to this PR.

To avoid repeated limits, reduce automatic review volume by pausing incremental auto-reviews earlier, using label-based review opt-in, excluding WIP or generated PR titles, or requesting reviews manually when the PR is ready. If your team needs uninterrupted high-volume reviews, an organization admin can enable usage-based reviews.

How do review limits work?

CodeRabbit enforces per-developer PR review limits for each organization. Most developers receive the normal plan review availability.

For paid Pro and Pro+ PR reviews, CodeRabbit uses adaptive limits for sustained high-volume activity. When a developer's recent PR review activity reaches the 95th percentile or higher among CodeRabbit users, additional reviews become available more gradually as earlier reviews age out of the rolling window.

Please refer docs for additional details.

Review details
⚙️ Run configuration

Configuration used: Repository UI

Review profile: CHILL

Plan: Pro

Run ID: 52a86094-4d1a-4763-8162-d29cb7184e7c

📥 Commits

Reviewing files that changed from the base of the PR and between b22e0c4 and af752ac.

📒 Files selected for processing (2)
  • src/schema/mod.rs
  • tests/features/test_schema.py

Thanks for using CodeRabbit! It's free for OSS, and your support helps us grow. If you like it, consider giving us a shout-out.

❤️ Share

Comment @coderabbitai help to get the list of available commands.

@codspeed-hq

codspeed-hq Bot commented Jul 3, 2026

Copy link
Copy Markdown

Merging this PR will not alter performance

✅ 16 untouched benchmarks


Comparing frenck/schema-underscore-bigint (af752ac) with main (b22e0c4)

Open in CodSpeed

Copilot AI left a comment

Copy link
Copy Markdown

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

Pull request overview

This PR fixes a schema-validation bug where a YAML 1.1 big-integer literal with _ digit separators (e.g. 20_000_000_000_000_000_001) silently skipped every numeric JSON Schema keyword. Because the resolved BigInt retains its source lexeme (underscores included), the schema helpers as_f64 and as_i128 failed to parse it: as_f64 returning None short-circuited check_numeric at its entry gate, so minimum/maximum/exclusiveMinimum/exclusiveMaximum/multipleOf were all skipped, and as_i128 failing disabled the exact multipleOf modulo path. Both helpers now strip _ before parsing, matching how the value itself resolves. This is a focused follow-up to #196 (exact integer multipleOf) and the underscore issue noted in #197.

Changes:

  • Strip _ separators in as_i128 before parsing a BigInt lexeme, restoring the exact multipleOf integer path.
  • Strip _ separators in as_f64 before parsing a BigInt lexeme, so check_numeric no longer bails out and bound checks run.
  • Add a regression test covering underscore-separated YAML 1.1 big integers against multipleOf and minimum.

Reviewed changes

Copilot reviewed 2 out of 2 changed files in this pull request and generated no comments.

File Description
src/schema/mod.rs Strips _ from BigInt lexemes in as_i128 and as_f64 so numeric schema keywords apply to underscored YAML 1.1 big integers.
tests/features/test_schema.py Adds test_numeric_checks_handle_yaml_1_1_underscore_big_ints verifying multipleOf and minimum are enforced on underscored big-int literals.

💡 Add Copilot custom instructions for smarter, more guided reviews. Learn how to get started.

@codecov-commenter

Copy link
Copy Markdown

Codecov Report

✅ All modified and coverable lines are covered by tests.
✅ Project coverage is 92.54%. Comparing base (b22e0c4) to head (af752ac).

Additional details and impacted files
@@           Coverage Diff           @@
##             main     #199   +/-   ##
=======================================
  Coverage   92.54%   92.54%           
=======================================
  Files          40       40           
  Lines       11931    11931           
=======================================
  Hits        11041    11041           
  Misses        890      890           

☔ View full report in Codecov by Harness.
📢 Have feedback on the report? Share it here.

🚀 New features to boost your workflow:
  • ❄️ Test Analytics: Detect flaky tests, report on failures, and find test suite problems.

@frenck frenck merged commit 34955d0 into main Jul 3, 2026
74 of 75 checks passed
@frenck frenck deleted the frenck/schema-underscore-bigint branch July 3, 2026 16:03
@github-actions github-actions Bot locked as resolved and limited conversation to collaborators Jul 5, 2026
Sign up for free to subscribe to this conversation on GitHub. Already have an account? Sign in.

Labels

bugfix Inconsistencies or issues which will cause a problem for users or implementers.

Projects

None yet

Development

Successfully merging this pull request may close these issues.

3 participants