Skip to content

fall back to pandas if no datetime format is found#587

Merged
GaelVaroquaux merged 2 commits into
skrub-data:mainfrom
LeoGrin:datetime_improvement
Jun 11, 2023
Merged

fall back to pandas if no datetime format is found#587
GaelVaroquaux merged 2 commits into
skrub-data:mainfrom
LeoGrin:datetime_improvement

Conversation

@LeoGrin
Copy link
Copy Markdown
Contributor

@LeoGrin LeoGrin commented Jun 10, 2023

Fix #555

We now fall back on pandas.to_datetime format inference when we don't find a format with _infer_datetime_format. Indeed, this function relies on pandas' guess_datetime_format, which doesn't work for weirder date format, and pandas.to_datetime uses dateutil when guess_datetime_format doesn't work.

The code to catch warnings could maybe be simplified.

Copy link
Copy Markdown
Member

@GaelVaroquaux GaelVaroquaux left a comment

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

LGTM. Merging

@GaelVaroquaux GaelVaroquaux merged commit 17d9791 into skrub-data:main Jun 11, 2023
Vincent-Maladiere pushed a commit that referenced this pull request Jun 12, 2023
* fall back to pandas if no datetime format is found

* change changelog
GaelVaroquaux added a commit that referenced this pull request Jun 12, 2023
* Quick bootstrap

* misc

* fix contributing link

* stabilize current LP layout

* add skrub banner

* replace banner with the target

* center feature blocks

* replace banner with the pipeline

* enable transparent bg for banner

* add skrub banner

* remove secondary sidebar

* DOC: landing page is jinja, not rst (#589)

* fall back to pandas if no datetime format is found (#587)

* fall back to pandas if no datetime format is found

* change changelog

* Fix X shape in minhash_encoder docstrings (#584)

* Parallelize the `GapEncoder` (#582)

* Parallelize the Gap column-wise

* Add changelog entry

* Update skrub/_gap_encoder.py

---------

Co-authored-by: Gael Varoquaux <gael.varoquaux@normalesup.org>

* fix fetching params (#591)

* remove index.rst

* add empty but toctree index.rst

---------

Co-authored-by: Gael Varoquaux <gael.varoquaux@normalesup.org>
Co-authored-by: LeoGrin <45738728+LeoGrin@users.noreply.github.com>
Co-authored-by: Lilian <lilian@boulard.fr>
Co-authored-by: Jovan Stojanovic <62058944+jovan-stojanovic@users.noreply.github.com>
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment

Labels

None yet

Projects

None yet

Development

Successfully merging this pull request may close these issues.

Improving DateTime detection?

2 participants