Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

GH-32662: [C#] Make dictionaries in file and memory implementations work correctly and support integration tests #39146

Merged
merged 8 commits into from
Dec 10, 2023

Conversation

CurtHagenlocher
Copy link
Contributor

@CurtHagenlocher CurtHagenlocher commented Dec 8, 2023

Rationale for this change

While dictionary support was implemented for C# in #6870 for streams, support did not extend to files or memory buffers. This change rectifies that.

What changes are included in this PR?

Changes to the memory and file implementations to support reading and writing of dictionaries, including nested dictionaries.
Changes to the integration tests so that they work with dictionaries.
Enabling the dictionary tests in CI.

Are these changes tested?

Yes, both directly and indirectly via the integration tests.

Are there any user-facing changes?

No.

@github-actions github-actions bot added awaiting committer review Awaiting committer review and removed awaiting review Awaiting review labels Dec 8, 2023
@CurtHagenlocher
Copy link
Contributor Author

Hmm... I seem to have made this ridiculously hard by misunderstanding the spec... .

@CurtHagenlocher
Copy link
Contributor Author

Going to rethink this a little

@CurtHagenlocher CurtHagenlocher merged commit a5a366d into apache:main Dec 10, 2023
11 checks passed
@CurtHagenlocher CurtHagenlocher removed the awaiting committer review Awaiting committer review label Dec 10, 2023
@CurtHagenlocher CurtHagenlocher deleted the DictionaryCase branch December 10, 2023 15:43
Copy link

After merging your PR, Conbench analyzed the 4 benchmarking runs that have been run so far on merge-commit a5a366d.

There were no benchmark performance regressions. 🎉

The full Conbench report has more details. It also includes information about 2 possible false positives for unstable benchmarks that are known to sometimes produce them.

mapleFU pushed a commit to mapleFU/arrow that referenced this pull request Dec 13, 2023
…ions work correctly and support integration tests (apache#39146)

### Rationale for this change

While dictionary support was implemented for C# in apache#6870 for streams, support did not extend to files or memory buffers. This change rectifies that.

### What changes are included in this PR?

Changes to the memory and file implementations to support reading and writing of dictionaries, including nested dictionaries.
Changes to the integration tests so that they work with dictionaries.
Enabling the dictionary tests in CI.

### Are these changes tested?

Yes, both directly and indirectly via the integration tests.

### Are there any user-facing changes?

No.

* Closes: apache#32662

Authored-by: Curt Hagenlocher <curt@hagenlocher.org>
Signed-off-by: Curt Hagenlocher <curt@hagenlocher.org>
clayburn pushed a commit to clayburn/arrow that referenced this pull request Jan 23, 2024
…ions work correctly and support integration tests (apache#39146)

### Rationale for this change

While dictionary support was implemented for C# in apache#6870 for streams, support did not extend to files or memory buffers. This change rectifies that.

### What changes are included in this PR?

Changes to the memory and file implementations to support reading and writing of dictionaries, including nested dictionaries.
Changes to the integration tests so that they work with dictionaries.
Enabling the dictionary tests in CI.

### Are these changes tested?

Yes, both directly and indirectly via the integration tests.

### Are there any user-facing changes?

No.

* Closes: apache#32662

Authored-by: Curt Hagenlocher <curt@hagenlocher.org>
Signed-off-by: Curt Hagenlocher <curt@hagenlocher.org>
dgreiss pushed a commit to dgreiss/arrow that referenced this pull request Feb 19, 2024
…ions work correctly and support integration tests (apache#39146)

### Rationale for this change

While dictionary support was implemented for C# in apache#6870 for streams, support did not extend to files or memory buffers. This change rectifies that.

### What changes are included in this PR?

Changes to the memory and file implementations to support reading and writing of dictionaries, including nested dictionaries.
Changes to the integration tests so that they work with dictionaries.
Enabling the dictionary tests in CI.

### Are these changes tested?

Yes, both directly and indirectly via the integration tests.

### Are there any user-facing changes?

No.

* Closes: apache#32662

Authored-by: Curt Hagenlocher <curt@hagenlocher.org>
Signed-off-by: Curt Hagenlocher <curt@hagenlocher.org>
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Projects
None yet
Development

Successfully merging this pull request may close these issues.

[C#] arrow::read_feather() cannot read DictionaryArray written from C#
1 participant