Skip to content

rewrite DataPreparator #118

Open
monkey0head opened this issue Apr 6, 2022 · 0 comments 路 May be fixed by #121
Open

rewrite DataPreparator #118

monkey0head opened this issue Apr 6, 2022 · 0 comments 路 May be fixed by #121
Assignees
@monkey0head
Labels
enhancement New feature or request high priority Should be done in the first place

Comments

@monkey0head
Copy link
Contributor

monkey0head commented Apr 6, 2022 •
edited

馃殌 Feature Request

Datapreparator should become a class used to:

  • convert dataframe to spark
  • check dataframe for NaNs
  • convert timestamp

Motivation

To make a preprocessing sequence:
DataPreparator (get spark dataframe with valid data types) - Splitters/Filters (split/crop dataframe) - Indexer (create indexers for train at first)
@monkey0head monkey0head added enhancement New feature or request high priority Should be done in the first place labels Apr 6, 2022
@monkey0head monkey0head self-assigned this Apr 6, 2022
@monkey0head monkey0head linked a pull request Apr 8, 2022 that will close this issue
Open
Sign up for free to subscribe to this conversation on GitHub. Already have an account? Sign in.
Assignees

@monkey0head monkey0head

Labels
enhancement New feature or request high priority Should be done in the first place
Projects
None yet
Milestone
No milestone
Development

Successfully merging a pull request may close this issue.

brilliant return of good old datapreparator sberbank-ai-lab/RePlay
1 participant
@monkey0head