Skip to content

Conversation

jjmachan
Copy link
Member

No description provided.

Comment on lines 15 to 20
Additionally, you can use the RAG metrics with other Machine Learning Model (MLM) observability tools like
- [Langsmith](../howtos/integrations/langsmith.ipynb)
- [Phoenix (Arize)](https://github.com/Arize-ai/phoenix)
- [Langfuse](../howtos/integrations/langfuse.ipynb)
- [OpenLayer](https://openlayer.com/)

Copy link
Member Author

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

are there anymore we can add to this list - ideally we can point them to our integrations page

Copy link
Member

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

yes, pointing to the integration page would be ideal

@jjmachan jjmachan marked this pull request as ready for review February 16, 2024 02:43
@jjmachan jjmachan requested a review from shahules786 February 16, 2024 08:20
@jjmachan
Copy link
Member Author

added emojies
image

is that too much?

# Evaluating Your Test Set

Welcome to the ragas quickstart. We're going to get you up and running with ragas as quickly as you can so that you can go back to improving your Retrieval Augmented Generation pipelines while this library makes sure your changes are improving your entire pipeline.
Once your test set is ready (whether you've created your own or used the [synthetic test set generation module](get-started-testset-generation)), it's time to evaluate your RAG pipeline. Our aim is to help you set up with Ragas as quickly as possible so that you can focus on enhancing your Retrieval Augmented Generation pipelines while this library ensures your changes are improving the entire pipeline.
Copy link
Member

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

Is this a mistake?

while this library ensures your changes are improving the entire pipeline.

Copy link
Member Author

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

nope, its correct i think

@jjmachan jjmachan requested a review from shahules786 February 17, 2024 03:21
Comment on lines +28 to +37
async def fix_doc_with_llm(doc: File, llm: BaseChatModel) -> File:
prompt = """\
fix the following grammar and spelling mistakes in the following text.
Please keep the markdown format intact when reformating it.
Do not make any change to the parts of text that are for formating or additional metadata for the core text in markdown.
The target audience for this is developers so keep the tone serious and to the point without any marketing terms.
The output text should me in .md format.
text: {text}
"""
Copy link
Member Author

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

added a script that helps review docs too

Copy link
Member Author

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

I've noticed that gpt4 actually helps a lot in keeping the tone professional and consistent.

Copy link
Member Author

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

but I don't think the prompt is proper - can be improved

@shahules786 shahules786 merged commit 2235ee9 into explodinggradients:main Feb 17, 2024
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment

Labels

None yet

Projects

None yet

Development

Successfully merging this pull request may close these issues.

2 participants