Adversarial Data using Gradio and EvalAI

[gchhablani]

Project Title: Adversarial Data using Gradio and EvalAI

Description: The aim of this project is to develop an infrastructure that enables the collection of adversarial data for models submitted to EvalAI. This will be achieved by integrating Gradio with EvalAI's code upload challenge pipeline and deploying the models as web services. The web services will record all user interactions, providing a dataset for each submission that can be used to evaluate the robustness of the model.

Deliverable:

• Build system design for EvalAI and Gradio integration
• Setup Gradio integration for a single VQA demo as a proof of concept
  • Create a Gradio interface wrapper that is modular for model inputs
  • Integrate the gradio interface with dockerized model for inference
• Setup auto launching of a worker service for deploying a Gradio app using a celery task from EvalAI django backend.
• Add frontend controls to deploy a Gradio web service for a single submission made by a participant to a code upload challenge.
• Add support to log interactions made by a user on the Gradio web service and push the interactions to a database table specific to a demo.
• Add API support to export the logged interactions for a demo.
• Implement frontend changes to allow users to download the logged interactions in a standard dataset format.

Mentor: Rishabh Jain, Ram Ramrakhya

Skills: Python, Django, AngularJS, AWS

Skill Level: Hard

Get started: Try to fix some issues in EvalAI (note that there are some issues labeled with GSOC-2023)

Important Links:

• EvalAI Website: eval.ai
• EvalAI Github repository: Cloud-CV/EvalAI
• EvalAI Docs: http://evalai.readthedocs.io/en/latest
• GSoC Proposal Template: Cloud-CV/GSoC-Ideas/wiki/GSOC-2020-Proposal-Template
• Gitter Channel: gitter.im/Cloud-CV
• Mailing list: groups.google.com/forum/#!forum/cloudcv

[ashutosh887]

I would like to work on this @Ram81 for GSOC

[thesakshidiggikar]

@Ram81 could you pleaser provide gitter channel the above given link is showing me an error

[marinicadenisandrei]

Hi,

I am very interested in participating for the "Adversarial Data using Gradio and EvalAI" program offered by GSOC 2023.

I am very passionate about this field, I currently work for companies that use the same technologies and I am also a master's student with a profile focused on these technologies. I would like to interact with a very well developed team, from which I can learn a lot of things and to be able to interact and implement all the knowledge to contribute to this project.

I am very passionate, I want to devote myself a lot to the project and to be able to participate in this GSOC 2023 program.

[danush754]

Hello CloudCv team,
I'm really interested in the "Adversarial Data using Gradio and EvalAI" program for GSOC 2023, and I'd love to represent CloudCV. Even though I don't have any previous experience with Flask, Gradio, or EvalAI, I'm eager to learn and contribute. I'm a quick learner, and I'm passionate about the project and the opportunity to work on cutting-edge research. If you're looking for someone who's motivated and ready to dive in, I'm your person. Thankyou!

[skat00sh]

Hi @gchhablani
Congratulations to the CLoud-CV team on getting selected for Gsco'23 once again :)
Little query: I tried searching for issues labelled gsoc-2023 in the Eval-AI/Issues but couldn't find any. Are they yet to be created? OR may be I'm searching incorrectly. Not sure!

[DhruvChaurasia3418]

Hello @gchhablani, I would like to work on this project, can you assign it to me

[gchhablani]

@skat00sh @danush754 @ashutosh887 @DhruvChaurasia3418 @thesakshidiggikar @marinicadenisandrei

Thank you for reaching out to us regarding the Google Summer of Code (GSoC) 2023 program. We appreciate your interest in our project and we are excited to have you as a potential participant.

As you may have seen, we have some open issues that we are looking into for both EvalAI and EvalAI-CLI. You can find them on our Github page at the following links:

• On EvalAI: https://github.com/Cloud-CV/EvalAI/issues?q=is%3Aissue+is%3Aopen+label%3AGSoC-2023
• On EvalAI-CLI: Fix error on get all challenges evalai-cli#342

We encourage you to experiment with EvalAI and report any issues that you come across. We will be posting more issues soon, so stay tuned for those.

We have a Slack workspace that you can join to connect with other interested participants. Here's the link to join: https://join.slack.com/t/cloudcv-community/shared_invite/zt-1rkm0m8pw-TBkjRjx~_GyIvMVlF5iDHg

Once you're in, you can join the #gsoc-23-interested-participants channel to stay up to date on the latest news and discuss the project with other potential participants.

In the meantime, we encourage you to set up EvalAI locally and continue revising your proposal before the final deadline. If you have any questions or concerns, don't hesitate to reach out to us.

Hi, and welcome to the CloudCV community!

Best regards,

Gunjan Chhablani

[ashutosh887]

Thanks a lot @gchhablani for considering
Have a great day 😊

[chiragbiradar]

Hello @gchhablani ,

I am very interested in participating in the “Adversarial Data using Gradio and EvalAI” program offered by GSOC 2023. I am a Bachelors student with a profile focused on techs like cloud ,AI, devops, etc. I would like to join the Cloud-CV team from which I can learn and contribute to this project.
I am eager to devote myself to the project and participate in GSOC 2023 program.

[gchhablani]

@chiragbiradar Please join our Community Slack: https://join.slack.com/t/evalai-gsoc/shared_invite/zt-1rkm0m8pw-TBkjRjx~_GyIvMVlF5iDHg

[manya954]

Hello @gchhablani
I am really interested in this project. I am a Bachelor's degree student with experience in web development, UX designing, C/C++, cloud, and Python please consider me for this opportunity.

[Manavkondagurle]

Hi,

I am very interested in participating for the "Adversarial Data using Gradio and EvalAI" program offered by GSOC 2023.

I am very passionate about this field, I currently work for companies that use the same technologies and I am also a master's student with a profile focused on these technologies. I would like to interact with a very well developed team, from which I can learn a lot of things and to be able to interact and implement all the knowledge to contribute to this project.

I am very passionate, I want to devote myself a lot to the project and to be able to participate in this GSOC 2023 program.

[Amitesh220]

Hello Mentors, I am Currently a pre final year student Working as a MERN stack developer intern , I am also learning DevOps to pursue my career in I am an open source enthusiast and looking forward to contribute to your projects Please guide me Further.
I truly want to devote myself in this project ,So please try to consider me for this project.