Skip to content

Issues: explodinggradients/ragas

New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

Sign up for GitHub

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

305 Open 726 Closed
305 Open 726 Closed
Author
Filter by author
Loading
Label
Filter by label
Loading
Use alt + click/return to exclude labels
or ⇧ + click/return for logical OR
Projects
Filter by project
Loading
Milestones
Filter by milestone
Loading
Assignee
Filter by who’s assigned
Sort
Sort by
Newest Oldest Most commented Least commented Recently updated Least recently updated Best match
Most reactions
👍 👎 😄 🎉 😕 ❤️ 🚀 👀

Issues list

Testset(samples=[]) bug Something isn't working module-testsetgen Module testset generation question Further information is requested
#1963 opened Mar 13, 2025 by txygjx
error when apply_transformers bug Something isn't working
#1962 opened Mar 13, 2025 by godisboy0
1
Initializing FactualCorrectness metric has side effects on other metrics bug Something isn't working module-metrics this is part of metrics module
#1961 opened Mar 11, 2025 by jbraunsmann
ValidationError: 1 validation error for SingleTurnSample reference Input should be a valid string [type=string_type, input_value=['恐龙名字来源于...意为恐怖的蜥蜴'], input_type=list] For further information visit https://errors.pydantic.dev/2.9/v/string_type bug Something isn't working module-metrics this is part of metrics module
#1960 opened Mar 11, 2025 by 729973389
2
FactualCorrectness false negative calculation bug Something isn't working module-metrics this is part of metrics module
#1958 opened Mar 10, 2025 by alvaroalfaro612
Need a demo about deepseek. question Further information is requested
#1956 opened Mar 7, 2025 by Bernard203
Enforcing json format bug Something isn't working question Further information is requested
#1955 opened Mar 7, 2025 by Leahh02
1 task done
Can code similar to app.ragas.io dashboard be open sourced? question Further information is requested
#1954 opened Mar 6, 2025 by LillyChen
Why AnswerCorrectness & SemanticSimilarity need reference in dataset? bug Something isn't working module-metrics this is part of metrics module question Further information is requested
#1952 opened Mar 5, 2025 by landhu
How to evaluate rags in other language question Further information is requested
#1949 opened Mar 5, 2025 by landhu
2
LangchainLLMWrapper sets a default temperature even with models that don't support it (ex o3-mini) bug Something isn't working
#1945 opened Mar 4, 2025 by khalilacheche
1
3
SimpleCriteriaScore does not set definition correctly bug Something isn't working
#1944 opened Mar 3, 2025 by albertkklam
1 task done
Spanish implementation for ragas 0.1.21 with method adapt() that actually works well bug Something isn't working module-testsetgen Module testset generation
#1942 opened Feb 28, 2025 by igcossio
1 task done
Getting scores with llamaindex using custom model as bedrock or gemini enhancement New feature or request
#1941 opened Feb 28, 2025 by mdciri
why await no support from demo bug Something isn't working module-metrics this is part of metrics module
#1939 opened Feb 26, 2025 by landhu
1
Language of the Testset module-testsetgen Module testset generation question Further information is requested
#1938 opened Feb 25, 2025 by cmilanes93
Incorrect Temperature Reset in generate_text Method bug Something isn't working
#1937 opened Feb 25, 2025 by binhnq94
Can I generate multi-hop reference_contexts Only? (without the question and reference) module-testsetgen Module testset generation question Further information is requested
#1936 opened Feb 25, 2025 by GraderYuval
1
default_transforms() Missing cosine_similarity Transform for Docs with Token Count 101–500 bug Something isn't working module-testsetgen Module testset generation
#1932 opened Feb 20, 2025 by rgrizzo-linksmt
3
Unable to get scores for all the examples in the DataFrame. Instead getting the combined score for the Whole dataframe.Need help to get the individual scores as well. answered 🤖 The question has been answered. Will be closed automatically if no new comments bug Something isn't working module-metrics this is part of metrics module question Further information is requested
#1931 opened Feb 20, 2025 by Rohith-pamidimarri
2
How can I delete the record on dashboard question Further information is requested
#1930 opened Feb 19, 2025 by andwizard
4
problem with answer_relevance - all time NAN for local llm bug Something isn't working module-metrics this is part of metrics module question Further information is requested
#1928 opened Feb 18, 2025 by spynet-us
Issues with await for language adapt bug Something isn't working module-testsetgen Module testset generation
#1925 opened Feb 14, 2025 by shawn-maxiao
1
How to use TongYi's text-embedding-v1 embeddings model question Further information is requested
#1922 opened Feb 14, 2025 by LillyChen
3
Wrong cache hits for LlamaIndexEmbeddingsWrapper bug Something isn't working
#1915 opened Feb 11, 2025 by triedel42
ProTip! Mix and match filters to narrow down what you’re looking for.