Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

Sign up for GitHub

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Jump to bottom

ANN_BENCH #130

Merged
merged 79 commits into from
Jun 27, 2024
Merged

ANN_BENCH #130

merged 79 commits into from
Jun 27, 2024

Commits on May 17, 2024

  1. enable asynchronous host-refinement for cagra index build

    @mfoerste4
    mfoerste4 committed May 17, 2024
    Configuration menu
    Copy the full SHA
    4416b0b View commit details
    Browse the repository at this point in the history

  2. Copy the benchmark scaffolding from RAFT

    @achirkin
    achirkin committed May 17, 2024
    Configuration menu
    Copy the full SHA
    118906c View commit details
    Browse the repository at this point in the history

  3. GGNN/HNSW/FAISS_CPU are compiled

    @achirkin
    achirkin committed May 17, 2024
    Configuration menu
    Copy the full SHA
    7814d35 View commit details
    Browse the repository at this point in the history

  4. Fix FAISS_GPU builds

    @achirkin
    achirkin committed May 17, 2024
    Configuration menu
    Copy the full SHA
    f8d8b68 View commit details
    Browse the repository at this point in the history

  5. move alloc out of OMP region

    @mfoerste4
    mfoerste4 committed May 17, 2024
    Configuration menu
    Copy the full SHA
    946e106 View commit details
    Browse the repository at this point in the history

  6. added test for refinement -- disabled until detail::build API is exposed

    @mfoerste4
    mfoerste4 committed May 17, 2024
    Configuration menu
    Copy the full SHA
    7c6644e View commit details
    Browse the repository at this point in the history

Commits on May 21, 2024

  1. Merge remote-tracking branch 'origin/branch-24.06' into fea-ann-bench

    @tfeher
    tfeher committed May 21, 2024
    Configuration menu
    Copy the full SHA
    0619207 View commit details
    Browse the repository at this point in the history

  2. cuvs_ivf_flat bench compiles

    @tfeher
    tfeher committed May 21, 2024
    Configuration menu
    Copy the full SHA
    9313d1f View commit details
    Browse the repository at this point in the history

Commits on May 22, 2024

  1. IVF compiles, linker error

    @tfeher
    tfeher committed May 22, 2024
    Configuration menu
    Copy the full SHA
    2e61d61 View commit details
    Browse the repository at this point in the history

  2. Disabled ivf_pq refinement, as a workaround for linking error

    @tfeher
    tfeher committed May 22, 2024
    Configuration menu
    Copy the full SHA
    8c6f9fe View commit details
    Browse the repository at this point in the history

  3. expose more cagra build parameters

    @mfoerste4
    mfoerste4 committed May 22, 2024
    Configuration menu
    Copy the full SHA
    2c3f5e4 View commit details
    Browse the repository at this point in the history

  4. clarify code

    @mfoerste4
    mfoerste4 committed May 22, 2024
    Configuration menu
    Copy the full SHA
    4d5ff0c View commit details
    Browse the repository at this point in the history

  5. fix merge conflict

    @mfoerste4
    mfoerste4 committed May 22, 2024
    Configuration menu
    Copy the full SHA
    545032b View commit details
    Browse the repository at this point in the history

Commits on May 23, 2024

  1. Accept host_mdspan for IVF-PQ build and extend

    @tfeher
    tfeher committed May 23, 2024
    Configuration menu
    Copy the full SHA
    53caff9 View commit details
    Browse the repository at this point in the history

Commits on May 24, 2024

  1. slightly reduce expected recall to catch refinement 1 results on all … 

    …archs
    @mfoerste4
    mfoerste4 committed May 24, 2024
    Configuration menu
    Copy the full SHA
    d2c1dad View commit details
    Browse the repository at this point in the history

  2. Fix extend API

    @tfeher
    tfeher committed May 24, 2024
    Configuration menu
    Copy the full SHA
    9f31182 View commit details
    Browse the repository at this point in the history

  3. Merge remote-tracking branch 'origin/branch-24.06' into ivf_pq_host_m… 

    …dspan
    @tfeher
    tfeher committed May 24, 2024
    Configuration menu
    Copy the full SHA
    292e947 View commit details
    Browse the repository at this point in the history

  4. init 

    Signed-off-by: Mickael Ide <mide@nvidia.com>
    @lowener
    lowener committed May 24, 2024
    Configuration menu
    Copy the full SHA
    f1297da View commit details
    Browse the repository at this point in the history

  5. CAGRA bench compiles

    @tfeher
    tfeher committed May 24, 2024
    Configuration menu
    Copy the full SHA
    9445708 View commit details
    Browse the repository at this point in the history

  6. Fix refine_host duplication, add test

    @lowener
    lowener committed May 24, 2024
    Configuration menu
    Copy the full SHA
    2401fcd View commit details
    Browse the repository at this point in the history

  7. fix style

    @tfeher
    tfeher committed May 24, 2024
    Configuration menu
    Copy the full SHA
    0d214c0 View commit details
    Browse the repository at this point in the history

  8. Update cpp/include/cuvs/neighbors/refine.hpp 

    Co-authored-by: Tamas Bela Feher <tfeher@nvidia.com>
    @lowener @tfeher
    lowener and tfeher authored May 24, 2024
    Configuration menu
    Copy the full SHA
    5efe1c6 View commit details
    Browse the repository at this point in the history

  9. Add half, update doc

    @lowener
    lowener committed May 24, 2024
    Configuration menu
    Copy the full SHA
    4b9ec70 View commit details
    Browse the repository at this point in the history

  10. Merge branch 'branch-24.06' into ivf_pq_host_mdspan

    @cjnolet
    cjnolet authored May 24, 2024
    Configuration menu
    Copy the full SHA
    4418cf7 View commit details
    Browse the repository at this point in the history

  11. Merge branch 'branch-24.06' into 24-06_refine

    @cjnolet
    cjnolet authored May 24, 2024
    Configuration menu
    Copy the full SHA
    09c1d73 View commit details
    Browse the repository at this point in the history

Commits on May 25, 2024

  1. add full doc

    @lowener
    lowener committed May 25, 2024
    Configuration menu
    Copy the full SHA
    5dcaecb View commit details
    Browse the repository at this point in the history

Commits on May 26, 2024

  1. Fix test compilation issue

    @tfeher
    tfeher committed May 26, 2024
    Configuration menu
    Copy the full SHA
    55924cf View commit details
    Browse the repository at this point in the history

Commits on May 27, 2024

  1. Revert math dependencies to PRIVATE

    @tfeher
    tfeher committed May 27, 2024
    Configuration menu
    Copy the full SHA
    8c37b94 View commit details
    Browse the repository at this point in the history

  2. Merge remote-tracking branch 'origin/branch-24.06' into fea-ann-bench

    @tfeher
    tfeher committed May 27, 2024
    Configuration menu
    Copy the full SHA
    8837d2d View commit details
    Browse the repository at this point in the history

  3. Add ivf_flat<half> 

    Signed-off-by: Mickael Ide <mide@nvidia.com>
    @lowener
    lowener committed May 27, 2024
    Configuration menu
    Copy the full SHA
    c0fbae5 View commit details
    Browse the repository at this point in the history

  4. enable cuvs_ prefix for algos, disable half

    @tfeher
    tfeher committed May 27, 2024
    Configuration menu
    Copy the full SHA
    a84659a View commit details
    Browse the repository at this point in the history

  5. Merge remote-tracking branch 'tfeher/ivf_pq_host_mdspan' into fea-ann… 

    …-bench
    @tfeher
    tfeher committed May 27, 2024
    Configuration menu
    Copy the full SHA
    c7d1bb6 View commit details
    Browse the repository at this point in the history

  6. Fix deserialization of IVF methods

    @tfeher
    tfeher committed May 27, 2024
    Configuration menu
    Copy the full SHA
    669fc0e View commit details
    Browse the repository at this point in the history

  7. Merge branch '24-06_refine' into fea-ann-bench

    @tfeher
    tfeher committed May 27, 2024
    Configuration menu
    Copy the full SHA
    eac32f0 View commit details
    Browse the repository at this point in the history

  8. re-enable refinement

    @tfeher
    tfeher committed May 27, 2024
    Configuration menu
    Copy the full SHA
    a6dcbd0 View commit details
    Browse the repository at this point in the history

Commits on May 28, 2024

  1. Fix refinment data type

    @tfeher
    tfeher committed May 28, 2024
    Configuration menu
    Copy the full SHA
    8e2b62a View commit details
    Browse the repository at this point in the history

  2. enable brute force benchmark

    @tfeher
    tfeher committed May 28, 2024
    Configuration menu
    Copy the full SHA
    bb6dbb2 View commit details
    Browse the repository at this point in the history

  3. cuvs brute needs dataset for search

    @tfeher
    tfeher committed May 28, 2024
    Configuration menu
    Copy the full SHA
    d1969ce View commit details
    Browse the repository at this point in the history

  4. Fix set_search_param

    @tfeher
    tfeher committed May 28, 2024
    Configuration menu
    Copy the full SHA
    971623c View commit details
    Browse the repository at this point in the history

  5. Fix index arg for cagra::serialize_to_hnswlib

    @tfeher
    tfeher committed May 28, 2024
    Configuration menu
    Copy the full SHA
    aafc748 View commit details
    Browse the repository at this point in the history

  6. Merge remote-tracking branch 'origin/branch-24.06' into fea-ann-bench

    @tfeher
    tfeher committed May 28, 2024
    Configuration menu
    Copy the full SHA
    e412122 View commit details
    Browse the repository at this point in the history

Commits on May 29, 2024

  1. cleanup API - use std::variant to switch algo of cagra graph build

    @mfoerste4
    mfoerste4 committed May 29, 2024
    Configuration menu
    Copy the full SHA
    9823831 View commit details
    Browse the repository at this point in the history

  2. fix c-api nn_descent

    @mfoerste4
    mfoerste4 committed May 29, 2024
    Configuration menu
    Copy the full SHA
    f310971 View commit details
    Browse the repository at this point in the history

  3. move documentation to API header

    @mfoerste4
    mfoerste4 committed May 29, 2024
    Configuration menu
    Copy the full SHA
    c1136c5 View commit details
    Browse the repository at this point in the history

  4. resolve merge conflicts

    @mfoerste4
    mfoerste4 committed May 29, 2024
    Configuration menu
    Copy the full SHA
    bb87c97 View commit details
    Browse the repository at this point in the history

  5. correct typo

    @mfoerste4
    mfoerste4 committed May 29, 2024
    Configuration menu
    Copy the full SHA
    8506c6a View commit details
    Browse the repository at this point in the history

  6. review suggestions

    @mfoerste4
    mfoerste4 committed May 29, 2024
    Configuration menu
    Copy the full SHA
    3a6e776 View commit details
    Browse the repository at this point in the history

  7. check valid nn_descent graph-degree / rename build_paramas to graph_b… 

    …uild_params
    @mfoerste4
    mfoerste4 committed May 29, 2024
    Configuration menu
    Copy the full SHA
    42aa3eb View commit details
    Browse the repository at this point in the history

  8. updating docs

    @mfoerste4
    mfoerste4 committed May 29, 2024
    Configuration menu
    Copy the full SHA
    68f490b View commit details
    Browse the repository at this point in the history

Commits on May 30, 2024

  1. Update CAGRA API (NN descent build by default)

    @tfeher
    tfeher committed May 30, 2024
    Configuration menu
    Copy the full SHA
    95f6064 View commit details
    Browse the repository at this point in the history

  2. Fix style

    @tfeher
    tfeher committed May 30, 2024
    Configuration menu
    Copy the full SHA
    3e22b13 View commit details
    Browse the repository at this point in the history

  3. remove cagra's build_host and build_device functions

    @tfeher
    tfeher committed May 30, 2024
    Configuration menu
    Copy the full SHA
    fd66402 View commit details
    Browse the repository at this point in the history

  4. Merge remote-tracking branch 'origin/branch-24.06' into fea-ann-bench

    @tfeher
    tfeher committed May 30, 2024
    Configuration menu
    Copy the full SHA
    b867488 View commit details
    Browse the repository at this point in the history

  5. Merge remote-tracking branch 'origin/pull-request/131' into fea-ann-b… 

    …ench
    @tfeher
    tfeher committed May 30, 2024
    Configuration menu
    Copy the full SHA
    d82e497 View commit details
    Browse the repository at this point in the history

Commits on Jun 3, 2024

  1. Merge remote-tracking branch 'origin/branch-24.06' into fea-ann-bench

    @tfeher
    tfeher committed Jun 3, 2024
    Configuration menu
    Copy the full SHA
    4f67adc View commit details
    Browse the repository at this point in the history

  2. Handle detailed CAGRA build params in benchmark wrapper

    @tfeher
    tfeher committed Jun 3, 2024
    Configuration menu
    Copy the full SHA
    a96dcb9 View commit details
    Browse the repository at this point in the history

Commits on Jun 4, 2024

  1. Add compatibility helper for aliasing cuvs-raft algorithms to allow u… 

    …sing old raft configs with the new benchmark executable
    @achirkin
    achirkin committed Jun 4, 2024
    Configuration menu
    Copy the full SHA
    2eaf0c6 View commit details
    Browse the repository at this point in the history

  2. Fix style errors

    @achirkin
    achirkin committed Jun 4, 2024
    Configuration menu
    Copy the full SHA
    9e90d8d View commit details
    Browse the repository at this point in the history

  3. Re-enable all benchmark components

    @achirkin
    achirkin committed Jun 4, 2024
    Configuration menu
    Copy the full SHA
    48f8353 View commit details
    Browse the repository at this point in the history

  4. Merge branch 'branch-24.08' into fea-ann-bench

    @achirkin
    achirkin authored Jun 4, 2024
    Configuration menu
    Copy the full SHA
    0fbf825 View commit details
    Browse the repository at this point in the history

Commits on Jun 5, 2024

  1. Apply clang-tidy suggestions

    @achirkin
    achirkin committed Jun 5, 2024
    Configuration menu
    Copy the full SHA
    6a20121 View commit details
    Browse the repository at this point in the history

  2. Remove the unused dev_list parameter and add a few more clang-tidy fixes

    @achirkin
    achirkin committed Jun 5, 2024
    Configuration menu
    Copy the full SHA
    1e64d05 View commit details
    Browse the repository at this point in the history

  3. Merge branch 'branch-24.08' into fea-ann-bench

    @achirkin
    achirkin authored Jun 5, 2024
    Configuration menu
    Copy the full SHA
    baf8863 View commit details
    Browse the repository at this point in the history

Commits on Jun 6, 2024

  1. Merge branch 'branch-24.08' into fea-ann-bench

    @achirkin
    achirkin authored Jun 6, 2024
    Configuration menu
    Copy the full SHA
    c047931 View commit details
    Browse the repository at this point in the history

  2. Fix using missing (de)serialize_file

    @achirkin
    achirkin committed Jun 6, 2024
    Configuration menu
    Copy the full SHA
    887a656 View commit details
    Browse the repository at this point in the history

Commits on Jun 10, 2024

  1. Merge branch 'branch-24.08' into fea-ann-bench

    @achirkin
    achirkin authored Jun 10, 2024
    Configuration menu
    Copy the full SHA
    001108d View commit details
    Browse the repository at this point in the history

  2. Fix: serialize_to_hnswlib_file -> serialize_to_hnswlib

    @achirkin
    achirkin committed Jun 10, 2024
    Configuration menu
    Copy the full SHA
    449be8c View commit details
    Browse the repository at this point in the history

Commits on Jun 11, 2024

  1. Properly add instances of serialize_to_hnswlib

    @achirkin
    achirkin committed Jun 11, 2024
    Configuration menu
    Copy the full SHA
    a71dcb0 View commit details
    Browse the repository at this point in the history

  2. Add an aggregate target CUVS_ANN_BENCH_ALL to build all enabled bench… 

    …marks when the --limit-bench-ann argument is not passed to build.sh
    @achirkin
    achirkin committed Jun 11, 2024
    Configuration menu
    Copy the full SHA
    8887225 View commit details
    Browse the repository at this point in the history

  3. Include the bench-ann component into the CI alongside with the tests

    @achirkin
    achirkin committed Jun 11, 2024
    Configuration menu
    Copy the full SHA
    a32abd5 View commit details
    Browse the repository at this point in the history

  4. Add openblas dependency to test environment

    @achirkin
    achirkin committed Jun 11, 2024
    Configuration menu
    Copy the full SHA
    c22035c View commit details
    Browse the repository at this point in the history

  5. Merge branch 'branch-24.08' into fea-ann-bench

    @achirkin
    achirkin authored Jun 11, 2024
    Configuration menu
    Copy the full SHA
    512cff6 View commit details
    Browse the repository at this point in the history

Commits on Jun 12, 2024

  1. Add openblas requirement to libcuvs-tests recipe (meta.yaml)

    @achirkin
    achirkin committed Jun 12, 2024
    Configuration menu
    Copy the full SHA
    c8ae918 View commit details
    Browse the repository at this point in the history

  2. Temporarily disable all algos except cuvs

    @achirkin
    achirkin committed Jun 12, 2024
    Configuration menu
    Copy the full SHA
    3fd97f6 View commit details
    Browse the repository at this point in the history

  3. Re-enable all benchmarks but GGNN.

    @achirkin
    achirkin committed Jun 12, 2024
    Configuration menu
    Copy the full SHA
    3daa597 View commit details
    Browse the repository at this point in the history

  4. Merge branch 'branch-24.08' into fea-ann-bench

    @achirkin
    achirkin authored Jun 12, 2024
    Configuration menu
    Copy the full SHA
    10171cf View commit details
    Browse the repository at this point in the history

Commits on Jun 17, 2024

  1. Merge branch 'branch-24.08' into fea-ann-bench

    @achirkin
    achirkin authored Jun 17, 2024
    Configuration menu
    Copy the full SHA
    398a808 View commit details
    Browse the repository at this point in the history

Commits on Jun 19, 2024

  1. Merge branch 'branch-24.08' into fea-ann-bench

    @achirkin
    achirkin authored Jun 19, 2024
    Configuration menu
    Copy the full SHA
    d7c25bd View commit details
    Browse the repository at this point in the history

  2. Move openblas conda dependency from build to host

    @achirkin
    achirkin committed Jun 19, 2024
    Configuration menu
    Copy the full SHA
    660c40d View commit details
    Browse the repository at this point in the history