issues Search Results · repo:explodinggradients/ragas language:Python
Filter by
1k results
(63 ms)1k results
inexplodinggradients/ragas (press backspace or delete to remove)[x] I checked the documentation and related resources and couldn t find an answer to my question.
Your Question How can I generate qa samples in parallel or concurrently to access them one by one when ...
module-testsetgen
question
tolgaerdonmez
- Opened yesterday
- #2105
Describe the Feature There is an issue where the evaluation set generation function generate_with_langchain_docs() and
the evaluation function evaluate() are both time-consuming and synchronous during ...
enhancement
lxhappy110
- Opened 7 days ago
- #2103
The output answer is the same as the reference answer, and the blue score has always been 0
demo:
if name == main : query = 今天天气怎么样
reference = 今天天气很不错
response = 今天天气很不错
metrics = [BleuScore()] ...
bug
module-metrics
question
LillyChen
- 1
- Opened 9 days ago
- #2101
Describe the Feature LlamaIndex and Langchain wrapped models are available for evaluation, Langchain contains a wrapper
for vLLM but it is not the most up-to-date and has some issues. So it would be interesting ...
enhancement
MaximeSongIdris
- Opened 9 days ago
- #2099
[ O ] I have checked the documentation and related resources and couldn t resolve my bug.
Describe the bug The answer_relevance value is coming out negative. ex. -0.001454476865077159
Ragas version: ...
bug
module-metrics
InhyeH
- 1
- Opened 19 days ago
- #2088
[x] I have checked the documentation and related resources and couldn t resolve my bug.
Summary
In recent versions of Langchain, llm.generate(...) is now a synchronous method, while llm.agenerate(...) ...
bug
nabilnaffar-sf
- Opened 23 days ago
- #2085
[ ] I have checked the documentation and related resources and couldn t resolve my bug.
Describe the bug A clear and concise description of what the bug is. ValueError Traceback (most recent call last) ...
bug
module-testsetgen
ananthanarayanan431
- 1
- Opened 24 days ago
- #2083
[x] I have checked the documentation and related resources and couldn t resolve my bug.
Describe the bug
When initializing HuggingfaceEmbeddings with sentence-transformers/all-mpnet-base-v2 I get the ...
bug
ryszardtuora
- Opened 25 days ago
- #2080
- [x] I have checked the documentation and related resources and couldn t resolve my bug.
Describe the bug If multiple tool calls match the reference call, the returned score can be higher than 1.0. ...
bug
module-metrics
mpanasiuk-suplari
- 1
- Opened 26 days ago
- #2079
[x] I checked the documentation and related resources and couldn t find an answer to my question.
Your Question I want to check if RAG chunks are relevant for the user input. I found LLMContextPrecisionWithoutReference ...
question
jonrosner
- 1
- Opened 27 days ago
- #2078

Learn how you can use GitHub Issues to plan and track your work.
Save views for sprints, backlogs, teams, or releases. Rank, sort, and filter issues to suit the occasion. The possibilities are endless.Learn more about GitHub IssuesProTip!
Press the /
key to activate the search input again and adjust your query.
Learn how you can use GitHub Issues to plan and track your work.
Save views for sprints, backlogs, teams, or releases. Rank, sort, and filter issues to suit the occasion. The possibilities are endless.Learn more about GitHub IssuesProTip!
Press the /
key to activate the search input again and adjust your query.