Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

Sign up for GitHub

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Jump to bottom

Parallelize child column construction in scatter() for lists columns #6791

Closed
wants to merge 10 commits into from
Closed

Parallelize child column construction in scatter() for lists columns #6791

wants to merge 10 commits into from

Commits on Nov 14, 2020

  1. [scatter<list>] Initial impl: 

    Supports lists of:
  1. fixed width data types
  2. strings
  3. lists (of all of the above, and lists(of ...))
    @mythrocks
    mythrocks committed Nov 14, 2020
    Configuration menu
    Copy the full SHA
    5741f69 View commit details
    Browse the repository at this point in the history

  2. [scatter<list>] Minor refactoring: 

    1. Additional type checking for child columns
2. Moved list_device_view functions inline
    @mythrocks
    mythrocks committed Nov 14, 2020
    Configuration menu
    Copy the full SHA
    3cac246 View commit details
    Browse the repository at this point in the history

Commits on Nov 15, 2020

  1. [scatter<list>] Changelog, + clang-format.

    @mythrocks
    mythrocks committed Nov 15, 2020
    Configuration menu
    Copy the full SHA
    bce24b4 View commit details
    Browse the repository at this point in the history

Commits on Nov 16, 2020

  1. [scatter<list>] Switch to rmm::cuda_stream_view

    @mythrocks
    mythrocks committed Nov 16, 2020
    Configuration menu
    Copy the full SHA
    a7dc525 View commit details
    Browse the repository at this point in the history

  2. [scatter<list>] Move label_t to scoped label_type

    @mythrocks
    mythrocks committed Nov 16, 2020
    Configuration menu
    Copy the full SHA
    c764de2 View commit details
    Browse the repository at this point in the history

  3. [scatter<list>] Switch from device_vector to device_uvector.

    @mythrocks
    mythrocks committed Nov 16, 2020
    Configuration menu
    Copy the full SHA
    b1caeef View commit details
    Browse the repository at this point in the history

  4. [scatter<list>] Fix documentation. Switch size types to size_type.

    @mythrocks
    mythrocks committed Nov 16, 2020
    Configuration menu
    Copy the full SHA
    2da4f15 View commit details
    Browse the repository at this point in the history

  5. [scatter<list>] Fix documentation.

    @mythrocks
    mythrocks committed Nov 16, 2020
    Configuration menu
    Copy the full SHA
    09325c7 View commit details
    Browse the repository at this point in the history

  6. [scatter<list>] More documentation fixes, const correctness

    @mythrocks
    mythrocks committed Nov 16, 2020
    Configuration menu
    Copy the full SHA
    4b6a54f View commit details
    Browse the repository at this point in the history

Commits on Nov 17, 2020

  1. [scatter<list>] Optimize for parallel child column construction: 

    WIP: Attempting to replace O(N**2) with a single thrust::for_each_n().
Borked, because of empty lists. Will need closer look.
    @mythrocks
    mythrocks committed Nov 17, 2020
    Configuration menu
    Copy the full SHA
    6931ac8 View commit details
    Browse the repository at this point in the history