Skip to content

Feature/dataloader#152

Merged
rafaelleaygalenq merged 25 commits intomasterfrom
feature/dataloader
Jun 21, 2021
Merged

Feature/dataloader#152
rafaelleaygalenq merged 25 commits intomasterfrom
feature/dataloader

Conversation

@sacha-lasry
Copy link
Copy Markdown
Contributor

Added a class to easily load text data using Dask, whether it is stored locally or on GCS. The TextLoader class can be fetched with a single path, but also with a list of path, that may contain wildcards

Copy link
Copy Markdown
Contributor

@hugovasselin hugovasselin left a comment

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

Bravo Sacha hyper propre ! A part une petite coquille dans le readme pas grand chose à changer mais plutôt des pistes de réflexions :)

Notamment la dépendance à Dask obligatoire ca peut rendre la lib plus lourde et compliquée à installer

Comment thread README.md Outdated
Comment thread README.md Outdated
Comment thread README.md
Comment thread README.md
Comment thread nlpretext/textloader.py Outdated
Comment thread nlpretext/textloader.py
Comment thread nlpretext/textloader.py Outdated
Comment thread requirements.txt Outdated
@sacha-lasry sacha-lasry requested a review from hugovasselin June 14, 2021 13:15
@amaleelhamri
Copy link
Copy Markdown
Contributor

C'est parfait Sacha merci!! Est-ce qu'on peut juste upgrade la version avant de merge ?

hugovasselin
hugovasselin previously approved these changes Jun 17, 2021
Copy link
Copy Markdown
Contributor

@hugovasselin hugovasselin left a comment

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

Top merci Sacha!

Comment thread README.md
@rafaelleaygalenq rafaelleaygalenq merged commit 8094379 into master Jun 21, 2021
@rafaelleaygalenq rafaelleaygalenq deleted the feature/dataloader branch June 21, 2021 13:09
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment

Labels

None yet

Projects

None yet

Development

Successfully merging this pull request may close these issues.

4 participants