Skip to content

v0.2.4: DataCanvas spill fixes

Choose a tag to compare

View all tags
@cyanheads cyanheads released this 16 Jul 05:49
v0.2.4
This tag was signed with the committer’s verified signature.
cyanheads Casey Hand
SSH Key Fingerprint: lkZCAfVCK5qsrcvEYCs0BnVRDCX7pKsdCZkw5yYKMuw
Verified
Learn about vigilant mode.
0afa1e7
This commit was signed with the committer’s verified signature.
cyanheads Casey Hand
SSH Key Fingerprint: lkZCAfVCK5qsrcvEYCs0BnVRDCX7pKsdCZkw5yYKMuw
Verified
Learn about vigilant mode.

DataCanvas spill fixes

Spill eligibility is serialized payload size rather than row count, and staged tables keep their column types and both cadences.

Fixed:

  • Wide results under 500 rows now spill — exceedsInlineBudget() replaces the INLINE_LIMIT = 500 gate and measures records against the same PREVIEW_CHARS budget passed to spillover() as previewChars. (#23)
  • Spilled numeric columns keep their type through a leading all-null run — spillover() now receives an explicit schema from deriveSpillSchema() derived over every staged row instead of sniffing its own preview buffer. (#21)
  • Daily-only columns survive a mixed hourly + daily spill, unioned into the one staged table under the existing table_name contract. (#22)

Changed:

  • canvas_id and truncated descriptions no longer claim a ~500-record threshold — corrected in the three spill-capable tools, README.md, and docs/design.md.

Dependency bumps:

  • ignore ^7.0.5 → ^7.0.6

156 tests pass; bun run devcheck clean.

CHANGELOG v0.2.4

Assets 3
Loading