Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Revampt client & server approach. #316

Merged
merged 3 commits into from
Apr 22, 2024
Merged

Conversation

emrgnt-cmplxty
Copy link
Contributor

@emrgnt-cmplxty emrgnt-cmplxty commented Apr 22, 2024

🚀 This description was created by Ellipsis for commit 4df8771

Summary:

This PR introduces a new pipeline HyDEPipeline for creating synthetic queries, updates various files to accommodate this change, and makes minor updates to other files.

Key points:

  • Introduced a new pipeline HyDEPipeline for creating synthetic queries.
  • Added HyDEPipeline to PIPELINE_OPTIONS in config_pipeline.py.
  • Updated README.md with instructions for HyDEPipeline.
  • Updated litellm version in pyproject.toml.
  • Deleted run_synthetic_query_client.py.
  • Updated get_embedding function in OpenAIEmbeddingProvider class in base.py to include type hints.
  • Removed unused import in run_qna_client.py.
  • Updated QnARAGPipeline class in rag.py to include default values for system_prompt and task_prompt parameters.

Generated with ❤️ by ellipsis.dev

Copy link

vercel bot commented Apr 22, 2024

The latest updates on your projects. Learn more about Vercel for Git ↗︎

Name Status Preview Comments Updated (UTC)
r2r-docs ✅ Ready (Inspect) Visit Preview 💬 Add feedback Apr 22, 2024 4:59pm

@emrgnt-cmplxty emrgnt-cmplxty marked this pull request as ready for review April 22, 2024 16:58
@emrgnt-cmplxty emrgnt-cmplxty merged commit a25a69b into dev Apr 22, 2024
1 of 2 checks passed
Copy link
Contributor

@ellipsis-dev ellipsis-dev bot left a comment

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

👍 Looks good to me!

  • Reviewed the entire pull request up to 4df8771
  • Looked at 372 lines of code in 9 files
  • Took 3 minutes and 12 seconds to review
More info
  • Skipped 2 files when reviewing.
  • Skipped posting 7 additional comments because they didn't meet confidence threshold of 50%.
1. r2r/pipelines/hyde/rag.py:42:
  • Assessed confidence : 50%
  • Comment:
    The HyDEPipeline class seems to be a new pipeline introduced in this PR. It inherits from the QnARAGPipeline class and overrides some of its methods. Please ensure that the overridden methods in the HyDEPipeline class are functioning as expected and that they are compatible with the rest of the codebase.
  • Reasoning:
    The PR seems to be about introducing a new pipeline called 'HyDE'. The changes include renaming and moving the 'synthetic_query_pipeline.py' to 'hyde/rag.py', updating the 'README.md' file to reflect the new pipeline, and updating the 'config_pipeline.py' to include the new pipeline. The 'run_synthetic_query_client.py' file has been deleted, and the 'run_qna_client.py' file has been updated. The 'pyproject.toml' file has been updated to change the version of 'litellm' from '^1.34.0' to '^1.35.18'. The 'base.py' file in the 'openai' directory under 'embeddings' has been updated to change the formatting of the 'get_embedding' function. The 'init.py' file in the 'pipelines' directory has been updated to import the 'HyDEPipeline' from 'hyde.rag'. The 'rag.py' file in the 'qna' directory under 'pipelines' has been updated to change the formatting of the 'init' function. The changes seem to be consistent with the PR title and there don't seem to be any logical bugs, performance bugs, or security bugs. However, I need to check the codebase to confirm this.
2. README.md:125:
  • Assessed confidence : 50%
  • Comment:
    The 'README.md' file has been updated to reflect the new 'HyDE' pipeline. Please ensure that the updated instructions are correct and that they provide the necessary information for users to understand and use the 'HyDE' pipeline.
  • Reasoning:
    The 'README.md' file has been updated to reflect the new 'HyDE' pipeline. The 'Synthetic Queries Example' section has been renamed to 'HyDE Example' and the commands to run the server and client have been updated. The 'HyDE Pipeline' is described as a more advanced synthetic query pipeline designed to enhance the RAG system's learning and performance. The changes seem to be consistent with the PR title and there don't seem to be any logical bugs, performance bugs, or security bugs. However, I need to check the codebase to confirm this.
3. pyproject.toml:23:
  • Assessed confidence : 50%
  • Comment:
    The version of 'litellm' has been updated from '^1.34.0' to '^1.35.18'. Please ensure that this version update does not introduce any breaking changes and that it is compatible with the rest of the codebase.
  • Reasoning:
    The 'pyproject.toml' file has been updated to change the version of 'litellm' from '^1.34.0' to '^1.35.18'. This seems to be a minor version update. I need to check the codebase to confirm that this update does not introduce any breaking changes.
4. r2r/embeddings/openai/base.py:76:
  • Assessed confidence : 50%
  • Comment:
    The 'get_embedding' function in the 'OpenAIEmbeddingProvider' class has been updated. Please ensure that the updated function is functioning as expected and that it is compatible with the rest of the codebase.
  • Reasoning:
    The 'base.py' file in the 'openai' directory under 'embeddings' has been updated to change the formatting of the 'get_embedding' function. The function now takes two arguments: 'text' and 'stage', and it raises a ValueError if 'stage' is not equal to 'PipelineStage.SEARCH'. This seems to be a minor change and there don't seem to be any logical bugs, performance bugs, or security bugs. However, I need to check the codebase to confirm this.
5. r2r/examples/clients/run_qna_client.py:3:
  • Assessed confidence : 50%
  • Comment:
    The 'json' module has been removed from the imports in the 'run_qna_client.py' file. Please ensure that this module is no longer needed and that its removal does not affect the functionality of the rest of the codebase.
  • Reasoning:
    The 'run_qna_client.py' file has been updated. The 'json' module has been removed from the imports and there don't seem to be any other changes. This seems to be a minor change and there don't seem to be any logical bugs, performance bugs, or security bugs. However, I need to check the codebase to confirm this.
6. r2r/examples/servers/config_pipeline.py:30:
  • Assessed confidence : 50%
  • Comment:
    The 'config_pipeline.py' file has been updated to include the new 'HyDE' pipeline. Please ensure that the updated file is functioning as expected and that it is compatible with the rest of the codebase.
  • Reasoning:
    The 'config_pipeline.py' file has been updated to include the new 'HyDE' pipeline. The 'HyDEPipeline' has been imported from 'hyde.rag' and it has been added to the 'PIPELINE_OPTIONS' dictionary. The 'create_app' function has been updated to use the 'PIPELINE_OPTIONS' dictionary to get the pipeline implementation. These changes seem to be consistent with the PR title and there don't seem to be any logical bugs, performance bugs, or security bugs. However, I need to check the codebase to confirm this.
7. r2r/pipelines/__init__.py:7:
  • Assessed confidence : 50%
  • Comment:
    The 'init.py' file in the 'pipelines' directory has been updated to import the 'HyDEPipeline' from 'hyde.rag'. Please ensure that this import is correct and that it does not introduce any circular dependencies.
  • Reasoning:
    The 'init.py' file in the 'pipelines' directory has been updated to import the 'HyDEPipeline' from 'hyde.rag'. This seems to be a minor change and there don't seem to be any logical bugs, performance bugs, or security bugs. However, I need to check the codebase to confirm this.

Workflow ID: wflow_xD6P97C0z9KYjx8W


Not what you expected? You can customize the content of the reviews using rules. Learn more here.

emrgnt-cmplxty added a commit that referenced this pull request Apr 22, 2024
* Revampt client & server approach.

* cleanups

* tweak hyde prompt
emrgnt-cmplxty added a commit that referenced this pull request Apr 23, 2024
* Revampt client & server approach.

* cleanups

* tweak hyde prompt
emrgnt-cmplxty added a commit that referenced this pull request Apr 23, 2024
* Revampt client & server approach.

* cleanups

* tweak hyde prompt
emrgnt-cmplxty added a commit that referenced this pull request Apr 23, 2024
* Revampt client & server approach.

* cleanups

* tweak hyde prompt
emrgnt-cmplxty added a commit that referenced this pull request Apr 24, 2024
* update the default embd. (#310)

* Feature/add jina reranker rebased (#312)

* Add jina reranker

* fix oai

* Revampt client & server approach. (#316)

* Revampt client & server approach.

* cleanups

* tweak hyde prompt

* Feature/add agent provider (#317)

* update pipeline (#315)

* Update CONTRIBUTING.md

* Delete CONTRIBUTOR.md

* Adding agent provider

* Feature/add agent provider rebased v2 (#319)

* modify prompt provider workflow, add agent

* fix run qna client

* add provider abstraction

* tweaks and cleans

* move text splitter config locale

* Feature/modify get all uniq values (#325)

* refine

* update

* format

* fix

* Feature/dev merge rebased (#329)

* Update local_rag.mdx

* Update llms.mdx (#322)

* update the default embd. (#310)

* Feature/add agent provider (#317)

* update pipeline (#315)

* Update CONTRIBUTING.md

* Delete CONTRIBUTOR.md

* Adding agent provider

* Feature/modify get all uniq values (#325)

* refine

* update

* format

* fix

* dev merge

* Feature/fix dev merge mistakes rebased (#330)

* Feature/add agent provider (#317)

* update pipeline (#315)

* Update CONTRIBUTING.md

* Delete CONTRIBUTOR.md

* Adding agent provider

* Feature/modify get all uniq values (#325)

* refine

* update

* format

* fix

* dev merge

* cleanup

* Feature/dev cleanup (#331)

* final pub

* final pub

* json clean

* fix sentence transformer issue

* include rerank

* fix llama cpp

* rebase

* fix rerank

* small tweaks

* rollbk config

* cleanup
@emrgnt-cmplxty emrgnt-cmplxty deleted the feature/revamp-clients branch April 24, 2024 17:33
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
None yet
Projects
None yet
Development

Successfully merging this pull request may close these issues.

1 participant