Skip to content

Add Partition codec (#464)#464

Closed
terrelln wants to merge 1 commit into
facebook:devfrom
terrelln:export-D95218214
Closed

Add Partition codec (#464)#464
terrelln wants to merge 1 commit into
facebook:devfrom
terrelln:export-D95218214

Conversation

@terrelln
Copy link
Copy Markdown
Contributor

@terrelln terrelln commented Mar 5, 2026

Summary:

Add a partition codec that:

  • Can replace ZL_NODE_QUANTIZE_OFFSETS (preset present, but implementation not optimized for this yet)
  • Can replace ZL_NODE_QUANTIZE_LENGTHS (preset present, but implementation not optimized for this yet)
  • Can implement the VarByte16 and Bucket16 codecs from contrib/lz-research

See the design doc for details.

Reviewed By: Cyan4973

Differential Revision: D95218214

@meta-cla meta-cla Bot added the cla signed label Mar 5, 2026
@meta-codesync
Copy link
Copy Markdown

meta-codesync Bot commented Mar 5, 2026

@terrelln has exported this pull request. If you are a Meta employee, you can view the originating Diff in D95218214.

terrelln added a commit to terrelln/openzl that referenced this pull request Mar 5, 2026
Summary:
Pull Request resolved: facebook#464

Add a partition codec that:
* Can replace `ZL_NODE_QUANTIZE_OFFSETS` (preset present, but implementation not optimized for this yet)
* Can replace `ZL_NODE_QUANTIZE_LENGTHS` (preset present, but implementation not optimized for this yet)
* Can implement the `VarByte16` and `Bucket16` codecs from `contrib/lz-research`

See the [design doc](https://docs.google.com/document/d/15ojKVhaCa1wwecbt3mRCgiy59pveJVQBASKbC2zuzEI/edit?tab=t.6ggqt4jnzgcj#heading=h.wvrp8vwdxgp8) for details.

Differential Revision: D95218214
terrelln added a commit to terrelln/openzl that referenced this pull request Mar 6, 2026
Summary:
Pull Request resolved: facebook#464

Add a partition codec that:
* Can replace `ZL_NODE_QUANTIZE_OFFSETS` (preset present, but implementation not optimized for this yet)
* Can replace `ZL_NODE_QUANTIZE_LENGTHS` (preset present, but implementation not optimized for this yet)
* Can implement the `VarByte16` and `Bucket16` codecs from `contrib/lz-research`

See the [design doc](https://docs.google.com/document/d/15ojKVhaCa1wwecbt3mRCgiy59pveJVQBASKbC2zuzEI/edit?tab=t.6ggqt4jnzgcj#heading=h.wvrp8vwdxgp8) for details.

Differential Revision: D95218214
terrelln added a commit to terrelln/openzl that referenced this pull request Mar 9, 2026
Summary:
Pull Request resolved: facebook#464

Add a partition codec that:
* Can replace `ZL_NODE_QUANTIZE_OFFSETS` (preset present, but implementation not optimized for this yet)
* Can replace `ZL_NODE_QUANTIZE_LENGTHS` (preset present, but implementation not optimized for this yet)
* Can implement the `VarByte16` and `Bucket16` codecs from `contrib/lz-research`

See the [design doc](https://docs.google.com/document/d/15ojKVhaCa1wwecbt3mRCgiy59pveJVQBASKbC2zuzEI/edit?tab=t.6ggqt4jnzgcj#heading=h.wvrp8vwdxgp8) for details.

Differential Revision: D95218214
terrelln added a commit to terrelln/openzl that referenced this pull request Mar 9, 2026
Summary:
Pull Request resolved: facebook#464

Add a partition codec that:
* Can replace `ZL_NODE_QUANTIZE_OFFSETS` (preset present, but implementation not optimized for this yet)
* Can replace `ZL_NODE_QUANTIZE_LENGTHS` (preset present, but implementation not optimized for this yet)
* Can implement the `VarByte16` and `Bucket16` codecs from `contrib/lz-research`

See the [design doc](https://docs.google.com/document/d/15ojKVhaCa1wwecbt3mRCgiy59pveJVQBASKbC2zuzEI/edit?tab=t.6ggqt4jnzgcj#heading=h.wvrp8vwdxgp8) for details.

Differential Revision: D95218214
@terrelln terrelln force-pushed the export-D95218214 branch 2 times, most recently from 21ec41e to 220e202 Compare March 9, 2026 23:40
terrelln added a commit to terrelln/openzl that referenced this pull request Mar 9, 2026
Summary:
Pull Request resolved: facebook#464

Add a partition codec that:
* Can replace `ZL_NODE_QUANTIZE_OFFSETS` (preset present, but implementation not optimized for this yet)
* Can replace `ZL_NODE_QUANTIZE_LENGTHS` (preset present, but implementation not optimized for this yet)
* Can implement the `VarByte16` and `Bucket16` codecs from `contrib/lz-research`

See the [design doc](https://docs.google.com/document/d/15ojKVhaCa1wwecbt3mRCgiy59pveJVQBASKbC2zuzEI/edit?tab=t.6ggqt4jnzgcj#heading=h.wvrp8vwdxgp8) for details.

Differential Revision: D95218214
terrelln added a commit to terrelln/openzl that referenced this pull request Mar 11, 2026
Summary:

Add a partition codec that:
* Can replace `ZL_NODE_QUANTIZE_OFFSETS` (preset present, but implementation not optimized for this yet)
* Can replace `ZL_NODE_QUANTIZE_LENGTHS` (preset present, but implementation not optimized for this yet)
* Can implement the `VarByte16` and `Bucket16` codecs from `contrib/lz-research`

See the [design doc](https://docs.google.com/document/d/15ojKVhaCa1wwecbt3mRCgiy59pveJVQBASKbC2zuzEI/edit?tab=t.6ggqt4jnzgcj#heading=h.wvrp8vwdxgp8) for details.

Differential Revision: D95218214
terrelln added a commit to terrelln/openzl that referenced this pull request Mar 11, 2026
Summary:

Add a partition codec that:
* Can replace `ZL_NODE_QUANTIZE_OFFSETS` (preset present, but implementation not optimized for this yet)
* Can replace `ZL_NODE_QUANTIZE_LENGTHS` (preset present, but implementation not optimized for this yet)
* Can implement the `VarByte16` and `Bucket16` codecs from `contrib/lz-research`

See the [design doc](https://docs.google.com/document/d/15ojKVhaCa1wwecbt3mRCgiy59pveJVQBASKbC2zuzEI/edit?tab=t.6ggqt4jnzgcj#heading=h.wvrp8vwdxgp8) for details.

Differential Revision: D95218214
terrelln added a commit to terrelln/openzl that referenced this pull request Mar 11, 2026
Summary:

Add a partition codec that:
* Can replace `ZL_NODE_QUANTIZE_OFFSETS` (preset present, but implementation not optimized for this yet)
* Can replace `ZL_NODE_QUANTIZE_LENGTHS` (preset present, but implementation not optimized for this yet)
* Can implement the `VarByte16` and `Bucket16` codecs from `contrib/lz-research`

See the [design doc](https://docs.google.com/document/d/15ojKVhaCa1wwecbt3mRCgiy59pveJVQBASKbC2zuzEI/edit?tab=t.6ggqt4jnzgcj#heading=h.wvrp8vwdxgp8) for details.

Differential Revision: D95218214
terrelln added a commit to terrelln/openzl that referenced this pull request Mar 11, 2026
Summary:

Add a partition codec that:
* Can replace `ZL_NODE_QUANTIZE_OFFSETS` (preset present, but implementation not optimized for this yet)
* Can replace `ZL_NODE_QUANTIZE_LENGTHS` (preset present, but implementation not optimized for this yet)
* Can implement the `VarByte16` and `Bucket16` codecs from `contrib/lz-research`

See the [design doc](https://docs.google.com/document/d/15ojKVhaCa1wwecbt3mRCgiy59pveJVQBASKbC2zuzEI/edit?tab=t.6ggqt4jnzgcj#heading=h.wvrp8vwdxgp8) for details.

Differential Revision: D95218214
terrelln added a commit to terrelln/openzl that referenced this pull request Mar 11, 2026
Summary:
Pull Request resolved: facebook#464

Add a partition codec that:
* Can replace `ZL_NODE_QUANTIZE_OFFSETS` (preset present, but implementation not optimized for this yet)
* Can replace `ZL_NODE_QUANTIZE_LENGTHS` (preset present, but implementation not optimized for this yet)
* Can implement the `VarByte16` and `Bucket16` codecs from `contrib/lz-research`

See the [design doc](https://docs.google.com/document/d/15ojKVhaCa1wwecbt3mRCgiy59pveJVQBASKbC2zuzEI/edit?tab=t.6ggqt4jnzgcj#heading=h.wvrp8vwdxgp8) for details.

Differential Revision: D95218214
terrelln added a commit to terrelln/openzl that referenced this pull request Mar 12, 2026
Summary:

Add a partition codec that:
* Can replace `ZL_NODE_QUANTIZE_OFFSETS` (preset present, but implementation not optimized for this yet)
* Can replace `ZL_NODE_QUANTIZE_LENGTHS` (preset present, but implementation not optimized for this yet)
* Can implement the `VarByte16` and `Bucket16` codecs from `contrib/lz-research`

See the [design doc](https://docs.google.com/document/d/15ojKVhaCa1wwecbt3mRCgiy59pveJVQBASKbC2zuzEI/edit?tab=t.6ggqt4jnzgcj#heading=h.wvrp8vwdxgp8) for details.

Reviewed By: Cyan4973

Differential Revision: D95218214
Summary:

Add a partition codec that:
* Can replace `ZL_NODE_QUANTIZE_OFFSETS` (preset present, but implementation not optimized for this yet)
* Can replace `ZL_NODE_QUANTIZE_LENGTHS` (preset present, but implementation not optimized for this yet)
* Can implement the `VarByte16` and `Bucket16` codecs from `contrib/lz-research`

See the [design doc](https://docs.google.com/document/d/15ojKVhaCa1wwecbt3mRCgiy59pveJVQBASKbC2zuzEI/edit?tab=t.6ggqt4jnzgcj#heading=h.wvrp8vwdxgp8) for details.

Reviewed By: Cyan4973

Differential Revision: D95218214
@meta-codesync meta-codesync Bot changed the title Add Partition codec Add Partition codec (#464) Mar 12, 2026
@meta-codesync meta-codesync Bot closed this in 13e2d2a Mar 13, 2026
@meta-codesync
Copy link
Copy Markdown

meta-codesync Bot commented Mar 13, 2026

This pull request has been merged in 13e2d2a.

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment

Projects

None yet

Development

Successfully merging this pull request may close these issues.

1 participant