Skip to content

[Python] Provide a private / distributed add column api in Python#823

Merged
eddyxu merged 5 commits intomainfrom
lei/python_add_column
May 4, 2023
Merged

[Python] Provide a private / distributed add column api in Python#823
eddyxu merged 5 commits intomainfrom
lei/python_add_column

Conversation

@eddyxu
Copy link
Copy Markdown
Member

@eddyxu eddyxu commented May 4, 2023

No description provided.

@eddyxu eddyxu requested a review from changhiskhan May 4, 2023 02:53
@eddyxu eddyxu self-assigned this May 4, 2023
Comment thread python/src/dataset.rs
fn create_version_from_fragments(
self_: PyRef<Self>,
schema: &PyAny,
fragments: Vec<&PyAny>,
Copy link
Copy Markdown
Contributor

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

who should be responsible for making sure all of the fragments have the same schema (and batch size?)

Copy link
Copy Markdown
Member Author

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

feel that when we have some framework integration, we should do there?

@eddyxu eddyxu merged commit 25c3807 into main May 4, 2023
@eddyxu eddyxu deleted the lei/python_add_column branch May 4, 2023 05:45
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment

Labels

None yet

Projects

None yet

Development

Successfully merging this pull request may close these issues.

2 participants