Creating Testdataset from dictionary/json file

[almariscal]

Describe the Feature
In some cases I think it would be interesting to generate a testdataset variable from a json file or dictionary with the necessary keys (question, answer, context...) in order to also evaluate LLMs on human-generated Testdataset for specific topics.

Why is the feature important for you?
Because I am implementing RAGAS on a really specific topic and some tests have to be carried out on exames generated by specialists in the company.

Additional context
I would be able to generate the code and a Pull request. Maybe the feature is already implemented but I have not found any method "from_json" or similar.

[shahules786]

Hey, this is something we will be working on immediately after 0.2 release. I would love to know more about your request so that we can use this while adding the feature.
If you have some time, please book a slot https://cal.com/shahul-ragas/30min