Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

Sign up for GitHub

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Jump to bottom

Performance improvement for nvtext tokenize/token functions #13480

Merged
merged 31 commits into from
Jun 29, 2023
Merged

Performance improvement for nvtext tokenize/token functions #13480

merged 31 commits into from
Jun 29, 2023

Commits on May 31, 2023

  1. Performance improvement for nvtext tokenize for long strings

    @davidwendt
    davidwendt committed May 31, 2023
    Configuration menu
    Copy the full SHA
    63bde3b View commit details
    Browse the repository at this point in the history

Commits on Jun 2, 2023

  1. Merge branch 'branch-23.08' into nvtext-perf-tokenize

    @davidwendt
    davidwendt committed Jun 2, 2023
    Configuration menu
    Copy the full SHA
    6a6f668 View commit details
    Browse the repository at this point in the history

  2. fix perf of normalize spaces

    @davidwendt
    davidwendt committed Jun 2, 2023
    Configuration menu
    Copy the full SHA
    1f99968 View commit details
    Browse the repository at this point in the history

  3. Merge branch 'branch-23.08' into nvtext-perf-tokenize

    @davidwendt
    davidwendt committed Jun 2, 2023
    Configuration menu
    Copy the full SHA
    bd2c072 View commit details
    Browse the repository at this point in the history

Commits on Jun 6, 2023

  1. Merge branch 'branch-23.08' into nvtext-perf-tokenize

    @davidwendt
    davidwendt committed Jun 6, 2023
    Configuration menu
    Copy the full SHA
    1dbe89a View commit details
    Browse the repository at this point in the history

Commits on Jun 7, 2023

  1. Merge branch 'branch-23.08' into nvtext-perf-tokenize

    @davidwendt
    davidwendt committed Jun 7, 2023
    Configuration menu
    Copy the full SHA
    b06a871 View commit details
    Browse the repository at this point in the history

  2. Merge branch 'branch-23.08' into nvtext-perf-tokenize

    @davidwendt
    davidwendt committed Jun 7, 2023
    Configuration menu
    Copy the full SHA
    764f154 View commit details
    Browse the repository at this point in the history

  3. update comments, style; name const value

    @davidwendt
    davidwendt committed Jun 7, 2023
    Configuration menu
    Copy the full SHA
    05a9c55 View commit details
    Browse the repository at this point in the history

Commits on Jun 8, 2023

  1. Merge branch 'branch-23.08' into nvtext-perf-tokenize

    @davidwendt
    davidwendt committed Jun 8, 2023
    Configuration menu
    Copy the full SHA
    d743154 View commit details
    Browse the repository at this point in the history

  2. Merge branch 'branch-23.08' into nvtext-perf-tokenize

    @davidwendt
    davidwendt committed Jun 8, 2023
    Configuration menu
    Copy the full SHA
    a7d8826 View commit details
    Browse the repository at this point in the history

Commits on Jun 9, 2023

  1. Merge branch 'branch-23.08' into nvtext-perf-tokenize

    @davidwendt
    davidwendt committed Jun 9, 2023
    Configuration menu
    Copy the full SHA
    408ad51 View commit details
    Browse the repository at this point in the history

Commits on Jun 12, 2023

  1. Merge branch 'branch-23.08' into nvtext-perf-tokenize

    @davidwendt
    davidwendt committed Jun 12, 2023
    Configuration menu
    Copy the full SHA
    a68711d View commit details
    Browse the repository at this point in the history

  2. Merge branch 'branch-23.08' into nvtext-perf-tokenize

    @davidwendt
    davidwendt committed Jun 12, 2023
    Configuration menu
    Copy the full SHA
    031b666 View commit details
    Browse the repository at this point in the history

Commits on Jun 13, 2023

  1. Merge branch 'branch-23.08' into nvtext-perf-tokenize

    @davidwendt
    davidwendt committed Jun 13, 2023
    Configuration menu
    Copy the full SHA
    d023e40 View commit details
    Browse the repository at this point in the history

  2. remove unneeded prefetch logic from normalize spaces

    @davidwendt
    davidwendt committed Jun 13, 2023
    Configuration menu
    Copy the full SHA
    51954c1 View commit details
    Browse the repository at this point in the history

  3. Merge branch 'branch-23.08' into nvtext-perf-tokenize

    @davidwendt
    davidwendt committed Jun 13, 2023
    Configuration menu
    Copy the full SHA
    7c89985 View commit details
    Browse the repository at this point in the history

Commits on Jun 14, 2023

  1. Merge branch 'branch-23.08' into nvtext-perf-tokenize

    @davidwendt
    davidwendt committed Jun 14, 2023
    Configuration menu
    Copy the full SHA
    50e75f1 View commit details
    Browse the repository at this point in the history

Commits on Jun 20, 2023

  1. Merge branch 'branch-23.08' into nvtext-perf-tokenize

    @davidwendt
    davidwendt committed Jun 20, 2023
    Configuration menu
    Copy the full SHA
    d59e695 View commit details
    Browse the repository at this point in the history

  2. Merge branch 'nvtext-perf-tokenize' of github.com:davidwendt/cudf int… 

    …o nvtext-perf-tokenize
    @davidwendt
    davidwendt committed Jun 20, 2023
    Configuration menu
    Copy the full SHA
    09b67cf View commit details
    Browse the repository at this point in the history

Commits on Jun 21, 2023

  1. Merge branch 'branch-23.08' into nvtext-perf-tokenize

    @davidwendt
    davidwendt committed Jun 21, 2023
    Configuration menu
    Copy the full SHA
    541440f View commit details
    Browse the repository at this point in the history

  2. Merge branch 'branch-23.08' into nvtext-perf-tokenize

    @davidwendt
    davidwendt committed Jun 21, 2023
    Configuration menu
    Copy the full SHA
    e1e6709 View commit details
    Browse the repository at this point in the history

Commits on Jun 22, 2023

  1. Merge branch 'nvtext-perf-tokenize' of github.com:davidwendt/cudf int… 

    …o nvtext-perf-tokenize
    @davidwendt
    davidwendt committed Jun 22, 2023
    Configuration menu
    Copy the full SHA
    12b75c5 View commit details
    Browse the repository at this point in the history

  2. Merge branch 'branch-23.08' into nvtext-perf-tokenize

    @davidwendt
    davidwendt committed Jun 22, 2023
    Configuration menu
    Copy the full SHA
    c5357c6 View commit details
    Browse the repository at this point in the history

Commits on Jun 23, 2023

  1. Merge branch 'branch-23.08' into nvtext-perf-tokenize

    @davidwendt
    davidwendt committed Jun 23, 2023
    Configuration menu
    Copy the full SHA
    241d7d3 View commit details
    Browse the repository at this point in the history

  2. Merge branch 'branch-23.08' into nvtext-perf-tokenize

    @davidwendt
    davidwendt committed Jun 23, 2023
    Configuration menu
    Copy the full SHA
    75a8c39 View commit details
    Browse the repository at this point in the history

  3. Merge branch 'nvtext-perf-tokenize' of github.com:davidwendt/cudf int… 

    …o nvtext-perf-tokenize
    @davidwendt
    davidwendt committed Jun 23, 2023
    Configuration menu
    Copy the full SHA
    bf03f1a View commit details
    Browse the repository at this point in the history

Commits on Jun 24, 2023

  1. Merge branch 'branch-23.08' into nvtext-perf-tokenize

    @davidwendt
    davidwendt committed Jun 24, 2023
    Configuration menu
    Copy the full SHA
    58701e7 View commit details
    Browse the repository at this point in the history

Commits on Jun 26, 2023

  1. Merge branch 'branch-23.08' into nvtext-perf-tokenize

    @davidwendt
    davidwendt committed Jun 26, 2023
    Configuration menu
    Copy the full SHA
    946ca1c View commit details
    Browse the repository at this point in the history

  2. fix next-token boundary check

    @davidwendt
    davidwendt committed Jun 26, 2023
    Configuration menu
    Copy the full SHA
    95787ff View commit details
    Browse the repository at this point in the history

  3. Merge branch 'branch-23.08' into nvtext-perf-tokenize

    @davidwendt
    davidwendt committed Jun 26, 2023
    Configuration menu
    Copy the full SHA
    4bdac42 View commit details
    Browse the repository at this point in the history

Commits on Jun 28, 2023

  1. Merge branch 'branch-23.08' into nvtext-perf-tokenize

    @davidwendt
    davidwendt committed Jun 28, 2023
    Configuration menu
    Copy the full SHA
    48288fe View commit details
    Browse the repository at this point in the history