Skip to content

Issues: explodinggradients/ragas

Beta
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

Sign up for GitHub

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

335 Open 746 Closed
335 Open 746 Closed
Author
Filter by author
Loading
Label
Filter by label
Loading
Use alt + click/return to exclude labels
or ⇧ + click/return for logical OR
Projects
Filter by project
Loading
Milestones
Filter by milestone
Loading
Assignee
Filter by who’s assigned
Assigned to nobody Loading
Sort
Sort by
Newest Oldest Most commented Least commented Recently updated Least recently updated Best match
Most reactions
👍 👎 😄 🎉 😕 ❤️ 🚀 👀

Issues list

Rate limit handling for api calls in evaluate() enhancement New feature or request
#2061 opened May 30, 2025 by AdarshSingh09
metadata argument is not passed to convert laggraph message bug Something isn't working
#2060 opened May 30, 2025 by amarmudrankit
How to accelerate evaluate when using vLLM engine module-metrics this is part of metrics module question Further information is requested
#2058 opened May 28, 2025 by MaximeSongIdris
Ubuntu bug，but everything is normal on Windows bug Something isn't working
#2056 opened May 23, 2025 by hznnnnnn
TestsetGenerator in local Ollama bug Something isn't working module-testsetgen Module testset generation
#2055 opened May 23, 2025 by hanifa2102
1
When we generate the Test set for evaluating RAG, how to add the source file name from which the QnA is generated. module-testsetgen Module testset generation question Further information is requested
#2054 opened May 23, 2025 by zaid1212
evaluate supporting replicates enhancement New feature or request module-metrics this is part of metrics module
#2052 opened May 21, 2025 by jamesbraza
1
question about src.ragas.metrics._nv_metrics.ContextRelevance._single_turn_ascore bug Something isn't working module-metrics this is part of metrics module question Further information is requested
#2051 opened May 20, 2025 by zjt148680
Evaluate a simple RAG system : RAG() does not initialize any instance bug Something isn't working
#2048 opened May 18, 2025 by amscosta
No persona found with name : Documentation example doesn't work with minimal changes bug Something isn't working
#2047 opened May 18, 2025 by codechanger0
Evaluation Errors: Output Parsing and Timeout Issues for Context/Faithfulness Metrics bug Something isn't working module-metrics this is part of metrics module openhands question Further information is requested
#2044 opened May 17, 2025 by WangAo-0
2
6
RAG Evaluation Metrics and Recommended Thresholds module-metrics this is part of metrics module question Further information is requested
#2043 opened May 17, 2025 by technqvi
how to make ragas test set generation to make query distribution even among all the files? module-testsetgen Module testset generation question Further information is requested
#2040 opened May 15, 2025 by rattipavan
evaluate() fails with *APIConnectionError(Connection error.)* when azure (AzureOpenAIEmbeddings, AzureChatOpenAI) langchain models are used bug Something isn't working module-metrics this is part of metrics module
#2038 opened May 14, 2025 by rajivchandrasekar
Knowledge Graph node IDs should be content hashes for idempotency enhancement New feature or request
#2036 opened May 11, 2025 by ahgraber
Context Precision Documentation documentation Improvements or additions to documentation question Further information is requested
#2035 opened May 10, 2025 by mentejoao
unable to apply transformation: Connection error bug Something isn't working module-testsetgen Module testset generation
#2034 opened May 9, 2025 by rattipavan
1
1
Skipping creating questions for documents in Testset Generation for RAG bug Something isn't working module-testsetgen Module testset generation
#2033 opened May 8, 2025 by AbdelrahmanZeidan5
Documentation: howto about Non-English Testset Generation is configured to generate query in Spanish but generates queries in French bug Something isn't working documentation Improvements or additions to documentation
#2032 opened May 8, 2025 by benqua
RAGAS metrics vs Traditional Metrics question Further information is requested
#2028 opened May 6, 2025 by iosuAbal
want to see integration with crewAI or autogen
#2025 opened Apr 29, 2025 by aggarwaln1
How can we integrate Ragas with WebdriverIO question Further information is requested
#2024 opened Apr 25, 2025 by hameeda2
1
[ERROR] Prompt xxx failed to parse output:The output parser failed to parse the output including retries. bug Something isn't working module-metrics this is part of metrics module question Further information is requested
#2022 opened Apr 22, 2025 by 674717172
@jjmachan
1
Context Precision score heavily influenced by position of relevant contexts in array bug Something isn't working module-metrics this is part of metrics module
#2013 opened Apr 15, 2025 by mshobana1990
5
Seperate Evaluation for Retrieval and Generation both question Further information is requested
#2010 opened Apr 14, 2025 by PrashantDixit0
3
ProTip! Follow long discussions with comments:>50.