-
Notifications
You must be signed in to change notification settings - Fork 263
New issue
Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.
By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.
Already on GitHub? Sign in to your account
Revampt client & server approach. #316
Merged
Merged
Conversation
This file contains bidirectional Unicode text that may be interpreted or compiled differently than what appears below. To review, open the file in an editor that reveals hidden Unicode characters.
Learn more about bidirectional Unicode characters
The latest updates on your projects. Learn more about Vercel for Git ↗︎
|
There was a problem hiding this comment.
Choose a reason for hiding this comment
The reason will be displayed to describe this comment to others. Learn more.
👍 Looks good to me!
- Reviewed the entire pull request up to 4df8771
- Looked at
372
lines of code in9
files - Took 3 minutes and 12 seconds to review
More info
- Skipped
2
files when reviewing. - Skipped posting
7
additional comments because they didn't meet confidence threshold of50%
.
1. r2r/pipelines/hyde/rag.py:42
:
- Assessed confidence :
50%
- Comment:
TheHyDEPipeline
class seems to be a new pipeline introduced in this PR. It inherits from theQnARAGPipeline
class and overrides some of its methods. Please ensure that the overridden methods in theHyDEPipeline
class are functioning as expected and that they are compatible with the rest of the codebase. - Reasoning:
The PR seems to be about introducing a new pipeline called 'HyDE'. The changes include renaming and moving the 'synthetic_query_pipeline.py' to 'hyde/rag.py', updating the 'README.md' file to reflect the new pipeline, and updating the 'config_pipeline.py' to include the new pipeline. The 'run_synthetic_query_client.py' file has been deleted, and the 'run_qna_client.py' file has been updated. The 'pyproject.toml' file has been updated to change the version of 'litellm' from '^1.34.0' to '^1.35.18'. The 'base.py' file in the 'openai' directory under 'embeddings' has been updated to change the formatting of the 'get_embedding' function. The 'init.py' file in the 'pipelines' directory has been updated to import the 'HyDEPipeline' from 'hyde.rag'. The 'rag.py' file in the 'qna' directory under 'pipelines' has been updated to change the formatting of the 'init' function. The changes seem to be consistent with the PR title and there don't seem to be any logical bugs, performance bugs, or security bugs. However, I need to check the codebase to confirm this.
2. README.md:125
:
- Assessed confidence :
50%
- Comment:
The 'README.md' file has been updated to reflect the new 'HyDE' pipeline. Please ensure that the updated instructions are correct and that they provide the necessary information for users to understand and use the 'HyDE' pipeline. - Reasoning:
The 'README.md' file has been updated to reflect the new 'HyDE' pipeline. The 'Synthetic Queries Example' section has been renamed to 'HyDE Example' and the commands to run the server and client have been updated. The 'HyDE Pipeline' is described as a more advanced synthetic query pipeline designed to enhance the RAG system's learning and performance. The changes seem to be consistent with the PR title and there don't seem to be any logical bugs, performance bugs, or security bugs. However, I need to check the codebase to confirm this.
3. pyproject.toml:23
:
- Assessed confidence :
50%
- Comment:
The version of 'litellm' has been updated from '^1.34.0' to '^1.35.18'. Please ensure that this version update does not introduce any breaking changes and that it is compatible with the rest of the codebase. - Reasoning:
The 'pyproject.toml' file has been updated to change the version of 'litellm' from '^1.34.0' to '^1.35.18'. This seems to be a minor version update. I need to check the codebase to confirm that this update does not introduce any breaking changes.
4. r2r/embeddings/openai/base.py:76
:
- Assessed confidence :
50%
- Comment:
The 'get_embedding' function in the 'OpenAIEmbeddingProvider' class has been updated. Please ensure that the updated function is functioning as expected and that it is compatible with the rest of the codebase. - Reasoning:
The 'base.py' file in the 'openai' directory under 'embeddings' has been updated to change the formatting of the 'get_embedding' function. The function now takes two arguments: 'text' and 'stage', and it raises a ValueError if 'stage' is not equal to 'PipelineStage.SEARCH'. This seems to be a minor change and there don't seem to be any logical bugs, performance bugs, or security bugs. However, I need to check the codebase to confirm this.
5. r2r/examples/clients/run_qna_client.py:3
:
- Assessed confidence :
50%
- Comment:
The 'json' module has been removed from the imports in the 'run_qna_client.py' file. Please ensure that this module is no longer needed and that its removal does not affect the functionality of the rest of the codebase. - Reasoning:
The 'run_qna_client.py' file has been updated. The 'json' module has been removed from the imports and there don't seem to be any other changes. This seems to be a minor change and there don't seem to be any logical bugs, performance bugs, or security bugs. However, I need to check the codebase to confirm this.
6. r2r/examples/servers/config_pipeline.py:30
:
- Assessed confidence :
50%
- Comment:
The 'config_pipeline.py' file has been updated to include the new 'HyDE' pipeline. Please ensure that the updated file is functioning as expected and that it is compatible with the rest of the codebase. - Reasoning:
The 'config_pipeline.py' file has been updated to include the new 'HyDE' pipeline. The 'HyDEPipeline' has been imported from 'hyde.rag' and it has been added to the 'PIPELINE_OPTIONS' dictionary. The 'create_app' function has been updated to use the 'PIPELINE_OPTIONS' dictionary to get the pipeline implementation. These changes seem to be consistent with the PR title and there don't seem to be any logical bugs, performance bugs, or security bugs. However, I need to check the codebase to confirm this.
7. r2r/pipelines/__init__.py:7
:
- Assessed confidence :
50%
- Comment:
The 'init.py' file in the 'pipelines' directory has been updated to import the 'HyDEPipeline' from 'hyde.rag'. Please ensure that this import is correct and that it does not introduce any circular dependencies. - Reasoning:
The 'init.py' file in the 'pipelines' directory has been updated to import the 'HyDEPipeline' from 'hyde.rag'. This seems to be a minor change and there don't seem to be any logical bugs, performance bugs, or security bugs. However, I need to check the codebase to confirm this.
Workflow ID: wflow_xD6P97C0z9KYjx8W
Not what you expected? You can customize the content of the reviews using rules. Learn more here.
emrgnt-cmplxty
added a commit
that referenced
this pull request
Apr 22, 2024
* Revampt client & server approach. * cleanups * tweak hyde prompt
emrgnt-cmplxty
added a commit
that referenced
this pull request
Apr 23, 2024
* Revampt client & server approach. * cleanups * tweak hyde prompt
emrgnt-cmplxty
added a commit
that referenced
this pull request
Apr 23, 2024
* Revampt client & server approach. * cleanups * tweak hyde prompt
emrgnt-cmplxty
added a commit
that referenced
this pull request
Apr 23, 2024
* Revampt client & server approach. * cleanups * tweak hyde prompt
emrgnt-cmplxty
added a commit
that referenced
this pull request
Apr 24, 2024
* update the default embd. (#310) * Feature/add jina reranker rebased (#312) * Add jina reranker * fix oai * Revampt client & server approach. (#316) * Revampt client & server approach. * cleanups * tweak hyde prompt * Feature/add agent provider (#317) * update pipeline (#315) * Update CONTRIBUTING.md * Delete CONTRIBUTOR.md * Adding agent provider * Feature/add agent provider rebased v2 (#319) * modify prompt provider workflow, add agent * fix run qna client * add provider abstraction * tweaks and cleans * move text splitter config locale * Feature/modify get all uniq values (#325) * refine * update * format * fix * Feature/dev merge rebased (#329) * Update local_rag.mdx * Update llms.mdx (#322) * update the default embd. (#310) * Feature/add agent provider (#317) * update pipeline (#315) * Update CONTRIBUTING.md * Delete CONTRIBUTOR.md * Adding agent provider * Feature/modify get all uniq values (#325) * refine * update * format * fix * dev merge * Feature/fix dev merge mistakes rebased (#330) * Feature/add agent provider (#317) * update pipeline (#315) * Update CONTRIBUTING.md * Delete CONTRIBUTOR.md * Adding agent provider * Feature/modify get all uniq values (#325) * refine * update * format * fix * dev merge * cleanup * Feature/dev cleanup (#331) * final pub * final pub * json clean * fix sentence transformer issue * include rerank * fix llama cpp * rebase * fix rerank * small tweaks * rollbk config * cleanup
Sign up for free
to join this conversation on GitHub.
Already have an account?
Sign in to comment
Add this suggestion to a batch that can be applied as a single commit.
This suggestion is invalid because no changes were made to the code.
Suggestions cannot be applied while the pull request is closed.
Suggestions cannot be applied while viewing a subset of changes.
Only one suggestion per line can be applied in a batch.
Add this suggestion to a batch that can be applied as a single commit.
Applying suggestions on deleted lines is not supported.
You must change the existing code in this line in order to create a valid suggestion.
Outdated suggestions cannot be applied.
This suggestion has been applied or marked resolved.
Suggestions cannot be applied from pending reviews.
Suggestions cannot be applied on multi-line comments.
Suggestions cannot be applied while the pull request is queued to merge.
Suggestion cannot be applied right now. Please check back later.
Summary:
This PR introduces a new pipeline
HyDEPipeline
for creating synthetic queries, updates various files to accommodate this change, and makes minor updates to other files.Key points:
HyDEPipeline
for creating synthetic queries.HyDEPipeline
toPIPELINE_OPTIONS
inconfig_pipeline.py
.README.md
with instructions forHyDEPipeline
.litellm
version inpyproject.toml
.run_synthetic_query_client.py
.get_embedding
function inOpenAIEmbeddingProvider
class inbase.py
to include type hints.run_qna_client.py
.QnARAGPipeline
class inrag.py
to include default values forsystem_prompt
andtask_prompt
parameters.Generated with ❤️ by ellipsis.dev