GSOC AI_API_EVAL Poc submission

[GANGSTER0910]

PR Description

This Proof of Concept (PoC) showcases an AI API evaluation framework that evaluates AI models using industry-standard metrics like BLEU, ROUGE, BERTScore, and METEOR. It provides real-time performance insights, including latency and cost analysis. Future enhancements will include model comparisons for users and the ability to download detailed evaluation reports for comprehensive analysis.
Steps to run python backend
Clone AI API Evaluation Repository
git clone https://github.com/GANGSTER0910/AI_API_EVAL.git

pip install -r requirements.txt

Provide your Hugging Face API token in the FastAPI.py file

run python FastAPI.py

Related Issues

• Closes AI API Eval Framework #618 and initial idea_harsh_panchal_AI_API_EVAL.md #686

Checklist

• I have gone through the contributing guide

• I have updated my branch and synced it with project main branch before making this PR

• I am using the latest Flutter stable branch (run flutter upgrade and verify)

• I have run the tests (flutter test) and all tests are passing

• Yes

• No, and this is why: please replace this line with details on why tests have not been included

OS on which you have developed and tested the feature?

• Windows
• macOS
• Linux

[ashitaprasad]

code?

[GANGSTER0910]

@ashitaprasad I have integrated the code, please review it and open for feedback

[animator]

Thanks for submitting the PR. We have reviewed the PoC 👍