[ENH] Polars conversion utilities #6455
Merged
Conversation
This file contains bidirectional Unicode text that may be interpreted or compiled differently than what appears below. To review, open the file in an editor that reveals hidden Unicode characters.
Learn more about bidirectional Unicode characters
pranavvp16
requested review from
achieveordie,
benHeid,
fkiraly and
yarnabrina
as code owners
fkiraly
changed the title
fkiraly
added
module:datatypes
pranavvp16
force-pushed
the
polars_support
branch
from
4ad79c7
to
245d820
Compare
|
I'm thinking to add a check in the obj.index = obj.index.to_timestamp()So we have two solutions now
I ran into this error when trying to convert the load_airline dataset into polars. Also I would like to know if I can create a deepcopy of the pandas obj being passed as we are renaming the index columns of the dataframe which in turn changes the index names of the original pandas dataframe too. |
fkiraly
approved these changes
May 26, 2024
geetu040
pushed a commit
to geetu040/sktime
that referenced
this pull request
Jun 4, 2024
Adds conversion functions from polars to pandas and vice versa, with relevant tests for the functions. sktime#5423
fkiraly
pushed a commit
to sktime/skpro
that referenced
this pull request
Aug 18, 2024
adds index support as part of #440 and is used to sync up polars conversion utilities between skpro and sktime. Correponding sktime pr for polars conversion utilities is sktime/sktime#6455. In this pr: If a pandas Dataframe is a `from_type` and polars frame is a `to_type` then during the conversion, we will save the index (assumed never to be in multi-index format) and insert it as an individual column with column name `__index__`. Then the resulting pandas dataframe will be converted to a polars dataframe. In the inverse function, if we are converting from polars dataframe to pandas dataframe, if the column `__index__` exists in the pandas dataframe post-conversion, then we will map that column to the index before returning the pandas Dataframe After this is merged, #447 will be implemented as a `polars` only estimator. tests will also be written to check polars input end to end and pandas input and output through the polars estimator (i.e pandas input into polars estimator -> polars predictions -> pandas output)
Sign up for free
to join this conversation on GitHub.
Already have an account?
Sign in to comment
Add this suggestion to a batch that can be applied as a single commit.
This suggestion is invalid because no changes were made to the code.
Suggestions cannot be applied while the pull request is closed.
Suggestions cannot be applied while viewing a subset of changes.
Only one suggestion per line can be applied in a batch.
Add this suggestion to a batch that can be applied as a single commit.
Applying suggestions on deleted lines is not supported.
You must change the existing code in this line in order to create a valid suggestion.
Outdated suggestions cannot be applied.
This suggestion has been applied or marked resolved.
Suggestions cannot be applied from pending reviews.
Suggestions cannot be applied on multi-line comments.
Suggestions cannot be applied while the pull request is queued to merge.
Suggestion cannot be applied right now. Please check back later.
Adds conversion functions from polars to pandas and vice versa, with relevant tests for the functions.
#5423