Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

Sign up for GitHub

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Jump to bottom

Add support for BM25 with the Weaviate document store #2860

Merged
merged 11 commits into from Jul 27, 2022
Merged

Add support for BM25 with the Weaviate document store #2860

merged 11 commits into from Jul 27, 2022

Commits on Jul 19, 2022

  1. Upgrading Weaviate used for testing to 1.14.1 from 1.11.0 

    This has also brought up an issue with one of the test filtering for value "a". This test has started to fail, as "a" is a default stopword in Weaviate, so I have changed this test to look for value "c" instead of value "a" to get around the stopword issue.
    @zoltan-fedor
    zoltan-fedor committed Jul 19, 2022
    Configuration menu
    Copy the full SHA
    5049815 View commit details
    Browse the repository at this point in the history

  2. Weaviate client upgrade 

    From v3.3.3 to v3.6.0
    @zoltan-fedor
    zoltan-fedor committed Jul 19, 2022
    Configuration menu
    Copy the full SHA
    9c506ba View commit details
    Browse the repository at this point in the history

Commits on Jul 20, 2022

  1. Adding BM25 Retrieval to Weaviate 

    Weaviate now supports BM25 retrieval in experiment mode and with some limitations (like it cannot be combined with filters).
This commit adds support for inverted index (BM25) querying against Weaviate.
    @zoltan-fedor
    zoltan-fedor committed Jul 20, 2022
    Configuration menu
    Copy the full SHA
    34c69c3 View commit details
    Browse the repository at this point in the history

  2. Running Black on the recent code changes

    @zoltan-fedor
    zoltan-fedor committed Jul 20, 2022
    Configuration menu
    Copy the full SHA
    2e41faa View commit details
    Browse the repository at this point in the history

  3. Update Documentation & Code Style

    @github-actions
    github-actions[bot] committed Jul 20, 2022
    Configuration menu
    Copy the full SHA
    841da82 View commit details
    Browse the repository at this point in the history

Commits on Jul 21, 2022

  1. Fixing linting issues after code changes by black

    @zoltan-fedor
    zoltan-fedor committed Jul 21, 2022
    Configuration menu
    Copy the full SHA
    1608432 View commit details
    Browse the repository at this point in the history

  2. Merge branch 'feature-weaviate-bm25' of github.com:zoltan-fedor/hayst… 

    …ack into feature-weaviate-bm25
    @zoltan-fedor
    zoltan-fedor committed Jul 21, 2022
    Configuration menu
    Copy the full SHA
    d03bfa0 View commit details
    Browse the repository at this point in the history

Commits on Jul 26, 2022

  1. The BM25 query needs to be in all lowercase for now 

    The BM25 query needs to be provided all lowercase while the functionality is in experimental mode in Weaviate.
See https://app.slack.com/client/T0181DYT9KN/C017EG2SL3H/thread/C017EG2SL3H-1658790227.208119
    @zoltan-fedor
    zoltan-fedor committed Jul 26, 2022
    Configuration menu
    Copy the full SHA
    22c89fc View commit details
    Browse the repository at this point in the history

  2. Fixing method parameter docstring to highlight that they are not supp… 

    …orted in Weaviate
    @zoltan-fedor
    zoltan-fedor committed Jul 26, 2022
    Configuration menu
    Copy the full SHA
    386d1d6 View commit details
    Browse the repository at this point in the history

  3. Update Documentation & Code Style

    @github-actions
    github-actions[bot] committed Jul 26, 2022
    Configuration menu
    Copy the full SHA
    60f07dc View commit details
    Browse the repository at this point in the history

  4. Merge branch 'deepset-ai:master' into feature-weaviate-bm25

    @zoltan-fedor
    zoltan-fedor committed Jul 26, 2022
    Configuration menu
    Copy the full SHA
    747031b View commit details
    Browse the repository at this point in the history