Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

To do list #3

Open
7 of 8 tasks
piever opened this issue Feb 22, 2018 · 2 comments
Open
7 of 8 tasks

To do list #3

piever opened this issue Feb 22, 2018 · 2 comments

Comments

@piever
Copy link
Collaborator

piever commented Feb 22, 2018

  • Think about summarize groupby etc... Is there need for macros?

  • Pipeline when using functions from IndexedTables that don't take data as first argument?

  • Docstrings

  • support distributed tables?

  • allow escaping symbols

  • _ to refer to table inside @with

  • Make all macros compatible with table of tables (better to wait for table of tables proper support in JuliaDB)

  • begin end syntax to make multiple transformations in a row

@piever
Copy link
Collaborator Author

piever commented Feb 25, 2018

Consider how best to optimize @apply for grouped data. Ideally, the macro should keep track of anything that happens during the grouping and only select the columns that are used.

@piever
Copy link
Collaborator Author

piever commented Mar 12, 2018

Regarding the distributed table support, we're missing a method for view(::DTable, i) and either broadcasting or indexing on Dagger.DArray

EDIT: all row-wise operation should automatically use delayedmap in the distributed case. Possibly add a chunk version of macros (@apply_in_chunks)

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
None yet
Projects
None yet
Development

No branches or pull requests

1 participant