Skip to content

issues Search Results · repo:explodinggradients/ragas language:Python

Filter by

1k results
 (63 ms)

1k results

inexplodinggradients/ragas (press backspace or delete to remove)

[x] I checked the documentation and related resources and couldn t find an answer to my question. Your Question How can I generate qa samples in parallel or concurrently to access them one by one when ...
module-testsetgen
question
  • tolgaerdonmez
  • Opened 
    yesterday
  • #2105

Describe the Feature There is an issue where the evaluation set generation function generate_with_langchain_docs() and the evaluation function evaluate() are both time-consuming and synchronous during ...
enhancement
  • lxhappy110
  • Opened 
    7 days ago
  • #2103

The output answer is the same as the reference answer, and the blue score has always been 0 demo: if name == main : query = 今天天气怎么样 reference = 今天天气很不错 response = 今天天气很不错 metrics = [BleuScore()] ...
bug
module-metrics
question
  • LillyChen
  • 1
  • Opened 
    9 days ago
  • #2101

Describe the Feature LlamaIndex and Langchain wrapped models are available for evaluation, Langchain contains a wrapper for vLLM but it is not the most up-to-date and has some issues. So it would be interesting ...
enhancement
  • MaximeSongIdris
  • Opened 
    9 days ago
  • #2099

[ O ] I have checked the documentation and related resources and couldn t resolve my bug. Describe the bug The answer_relevance value is coming out negative. ex. -0.001454476865077159 Ragas version: ...
bug
module-metrics
  • InhyeH
  • 1
  • Opened 
    19 days ago
  • #2088

[x] I have checked the documentation and related resources and couldn t resolve my bug. Summary In recent versions of Langchain, llm.generate(...) is now a synchronous method, while llm.agenerate(...) ...
bug
  • nabilnaffar-sf
  • Opened 
    23 days ago
  • #2085

[ ] I have checked the documentation and related resources and couldn t resolve my bug. Describe the bug A clear and concise description of what the bug is. ValueError Traceback (most recent call last) ...
bug
module-testsetgen
  • ananthanarayanan431
  • 1
  • Opened 
    24 days ago
  • #2083

[x] I have checked the documentation and related resources and couldn t resolve my bug. Describe the bug When initializing HuggingfaceEmbeddings with sentence-transformers/all-mpnet-base-v2 I get the ...
bug
  • ryszardtuora
  • Opened 
    25 days ago
  • #2080

- [x] I have checked the documentation and related resources and couldn t resolve my bug. Describe the bug If multiple tool calls match the reference call, the returned score can be higher than 1.0. ...
bug
module-metrics
  • mpanasiuk-suplari
  • 1
  • Opened 
    26 days ago
  • #2079

[x] I checked the documentation and related resources and couldn t find an answer to my question. Your Question I want to check if RAG chunks are relevant for the user input. I found LLMContextPrecisionWithoutReference ...
question
  • jonrosner
  • 1
  • Opened 
    27 days ago
  • #2078
Issue origami icon

Learn how you can use GitHub Issues to plan and track your work.

Save views for sprints, backlogs, teams, or releases. Rank, sort, and filter issues to suit the occasion. The possibilities are endless.Learn more about GitHub Issues
ProTip! 
Press the
/
key to activate the search input again and adjust your query.
Issue origami icon

Learn how you can use GitHub Issues to plan and track your work.

Save views for sprints, backlogs, teams, or releases. Rank, sort, and filter issues to suit the occasion. The possibilities are endless.Learn more about GitHub Issues
ProTip! 
Press the
/
key to activate the search input again and adjust your query.
Issue search results · GitHub