Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

[gpuCI] Auto-merge branch-0.17 to branch-0.18 [skip ci] #6896

Merged
merged 1 commit into from
Dec 3, 2020

Conversation

GPUtester
Copy link
Collaborator

Auto-merge triggered by push to branch-0.17 that creates a PR to keep branch-0.18 up-to-date. If this PR is unable to be immediately merged due to conflicts, it will remain open for the team to manually merge.

Closes #6530 

Changes:
- Added a method of specifying the nullability of list columns. The API change is as follows: `table_metadata_with_nullability.column_nullable[i]` used to be the nullability of column[i]. Now it contains the flattened nullability of the table e.g. for a table of three columns, `int, list<double>, float`, the nullability vector contains the values:

|Index|Nullability of|
|-|-|
|0|int column|
|1|Level 0 of list column (list itself)|
|2|Level 1 of list column (double values)|
|3|float column|

- Modified the method of checking schema across `write_chunk()` calls. Now the entire schema vector is compared rather than just types.
- Fixed a bug introduced in list writing PR where a non-nested column following a list column would have the wrong value of definition bits. Now all such cases where the information was being queried from schema have been fixed to use `parquet_column_view`
- Fixed a regression introduced in a later commit in list writing PR while adding column_view with offset support to list columns. Changed pinned memory to normal pageable memory.
- Added missing tests for chunked writer where the nullability is mismatched across calls, or nullability is specified in first call.

Authors:
  - Devavret Makkar <dmakkar@nvidia.com>
  - Devavret Makkar <devavret@users.noreply.github.com>

Approvers:
  - Vukasin Milovanovic
  - Keith Kraus
  - Mark Harris

URL: #6831
@GPUtester GPUtester requested review from a team as code owners December 3, 2020 22:58
@GPUtester GPUtester merged commit 3d80bb8 into branch-0.18 Dec 3, 2020
@GPUtester
Copy link
Collaborator Author

SUCCESS - Auto-merge complete.

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
None yet
Projects
None yet
Development

Successfully merging this pull request may close these issues.

2 participants