Robust test suite and infra optimization setup

[Ram81]

Project Title: Robust test suite and infra optimization setup

Description:

This project will focus on building a robust test suite for EvalAI's functionalities. As part of the project we will focus on making EvalAI robust and less error-prone by adding test cases for different frontend and backend component. It will involve adding unit tests for the API suite, prediction upload evaluation workers, code upload evaluation workers (on EKS) and integration tests for the end to end testing of all the components.

Deliverables:

• Add tests for GitHub-based challenge creation on EvalAI.
• Add tests for submission and remote submission workers.
• Add unit tests for individual components in submission and remote submission worker.
• Add integration tests for the worker.
• Add tests for code upload evaluation workers.
• Add unit tests for individual components in code upload worker.
• Add integration tests for the worker.
• Add tests for code-upload challenge evaluation and static code upload challenge evaluation pipeline.
• Unit testing kubernetes components using mock
• Add tests for frontend components:
  • Challenge page
  • Make submission page
  • My submissions and All submissions page
  • Settings tab
  • Dashboard - all challenges, hosted challenges, participated challenges tab

Mentors: - Ram Ramrakhya, Rishabh Jain

Skills Required: - Python, Django, AngularJS, AWS

Project size - 175 hours

Difficulty - Medium

Get started: Try to fix some issues in EvalAI (note that there are some issues labeled with GSOC-2022)

Important Links:

• EvalAI Website: eval.ai
• EvalAI Github repository: Cloud-CV/EvalAI
• EvalAI Docs: http://evalai.readthedocs.io/en/latest
• GSoC Proposal Template: Cloud-CV/GSoC-Ideas/wiki/GSOC-2020-Proposal-Template
• Gitter Channel: gitter.im/Cloud-CV
• Mailing list: groups.google.com/forum/#!forum/cloudcv