Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

DM-38689: Remove gen2 compatibility code from functors and deprecate pipe.tasks.parquetTable #771

Merged
merged 6 commits into from Apr 19, 2023

Conversation

erykoff
Copy link
Contributor

@erykoff erykoff commented Apr 17, 2023

No description provided.

@erykoff erykoff requested a review from timj April 18, 2023 15:55
Copy link
Member

@timj timj left a comment

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

Looks great.

Do the test_functors.py tests run even faster now without the temporary files?

@@ -269,7 +244,10 @@ def multilevelColumns(self, data, columnIndex=None, returnTuple=False):
combine columns from the various component functors.

"""
if isinstance(data, (DeferredDatasetHandle, InMemoryDatasetHandle)) and columnIndex is None:
if not isinstance(data, (DeferredDatasetHandle, InMemoryDatasetHandle)):
raise RuntimeError(f"Unexpected data type. Got {get_full_type_name}.")
Copy link
Member

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

Suggested change
raise RuntimeError(f"Unexpected data type. Got {get_full_type_name}.")
raise RuntimeError(f"Unexpected data type. Got {get_full_type_name(data)}.")

@erykoff erykoff merged commit 8d2eb0a into main Apr 19, 2023
1 check passed
@erykoff erykoff deleted the tickets/DM-38689 branch April 19, 2023 16:45
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
None yet
Projects
None yet
Development

Successfully merging this pull request may close these issues.

None yet

2 participants