Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

[ENH] Speed up hierarchical checks and unify with panel approach #4061

Merged
merged 1 commit into from Jan 6, 2023

Conversation

danbartl
Copy link
Collaborator

@danbartl danbartl commented Jan 4, 2023

Roll out of #3935 to hierarchical checks.

Also unified the approach here, since in my view checks should use the same functions (essentially panel and hierarchical are just variations of each other)

Copy link
Collaborator

@fkiraly fkiraly left a comment

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

brilliant!

Yes, I have also noticed this when I was working on dask and applied the same pattern: #4011

Overall, I think it may make sense to move panel/hierarchical closer long-term, perhaps even looking at a merge.

The problem is that there are some mtypes that do not clearly generalize to hierarchical, which are in use primarily in the "panel" based tasks like time series classification, e.g., 3D numpy array (although one could say, nD for n>3 means hierarchical).

At least currently that implies that panel needs to be treated separately. If it were only frames, I would fully agree that panel and hierarchical scitypes could be merged.

@fkiraly fkiraly added module:datatypes datatypes module: data containers, checkers & converters enhancement Adding new functionality labels Jan 4, 2023
@danbartl danbartl merged commit 4a0fbfe into sktime:main Jan 6, 2023
klam-data pushed a commit to CodeSmithDSMLProjects/sktime that referenced this pull request Jan 18, 2023
Roll out of panel datatype check changes to hierarchical datatype
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
enhancement Adding new functionality module:datatypes datatypes module: data containers, checkers & converters
Projects
None yet
Development

Successfully merging this pull request may close these issues.

None yet

2 participants