Feat: prompt adaptation for test data generation

[shahules786]

• prompt adaptation for languages
• Minor bug fixes and assertions
• JSON safe loading

[gonznm]

Hi @shahules786, thank you for your nice work!
Does prompt adaptation also include being able to change the language? As in metrics

[shahules786]

@gonznm Hey there, Yes. I have been working hard on this feature. It's working now, would love to hear your feedback and if you have any suggested improvements feel free to raise a PR :)

[gonznm]

Awesome! I will def give it a try on monday!

[jjmachan]

we finally have this thanks to @shahules786

feel free to install from the latest and take it for a spin @gonznm 😉

[gonznm]

Hey there @jjmachan and @shahules786 :)
Adaptation seems to work well in my generation experiments with spanish and OpenAI API! Congrats and thank you!!

Note: I have other issues when trying to use open-source models, but they are not related to adaptation, I'll open an issue for that

[shahules786]

Great @gonznm , thanks. Please report the issues so that we can help :)

[jjmachan]

thanks a lot for sharing your feedback - really happy to hear its working for you :)

we'll get you sorted on the other issue as well but welcome to the community brother - we are happy to have you here 🙂 ❤️

[dketterer-enbw]

I had an issue with adapting a generator to german.

I got an AssertionError: Adapted output keys do not match with the original output keys on this line.

The problem was that one output_key was "verdit" instead of "verdict".

I ended up fixing the typo https://github.com/explodinggradients/ragas/blob/deded7096486f1b7616e8d11f7e9d6eac731bdd0/src/ragas/testset/prompts.py#L181 and now it works!

filter_question_prompt = Prompt(
    name="filter_question",
    instruction="""Given a question, classify it based on clarity and specificity. Use only 'Clear' (1) and 'Unclear' (0) as verdict.""",
    examples=[
        {
            "question": "What is the discovery about space?",
            "output": {
                "reason": "The question is too vague and does not specify which discovery about space it is referring to.",
                "verdit": "0",
            },
        },