[Feature:Developer] Integrate Cypress Cloud

[IDzyre]

What is the current behavior?

Currently we just use the testing component of cypress.

What is the new behavior?

This will add the setup to have cypress link with cypress cloud, which will allow for easier parallelization, and it shows recordings of the tests in the cloud.

Other information?

The open source license allows for 100,000 runs (specific it('', ()=>{}) functions, not spec files) per month, so this is the testing period to see if this is enough, if not, it may be better to manually parallelize the tests and use cloud as a different feature, to see why cypress is failing in CI and not locally, but we will see. I have also communicated with some people at cypress, and they indicated that we may be able to get more runs, but I haven't communicated more about that.

This information is old. We now have an OSS cypress cloud 'organization', which allows for unlimited runs, not 100,000/month.

[codecov]

Codecov Report

Merging #9517 (edc452f) into main (8e6731f) will not change coverage.
The diff coverage is n/a.

@@            Coverage Diff            @@
##               main    #9517   +/-   ##
=========================================
  Coverage     23.20%   23.20%           
  Complexity     8176     8176           
=========================================
  Files           226      226           
  Lines         29210    29210           
  Branches         73       73           
=========================================
  Hits           6778     6778           
  Misses        22362    22362           
  Partials         70       70           

Flag	Coverage Δ
autograder	22.08% <ø> (ø)
js	27.51% <ø> (ø)
migrator	100.00% <ø> (ø)
php	20.08% <ø> (ø)
python_submitty_utils	71.65% <ø> (ø)
submitty_daemon_jobs	91.01% <ø> (ø)

Flags with carried forward coverage won't be shown. Click here to find out more.

[williamjallen]

Cypress Cloud looks interesting, but I believe that 100,000/month test runs is not enough to meet our demand at peak times. I need to take a deeper look later, but these changes seem to be heading down the right path.

[IDzyre]

This should be merged after (if) Submitty gets approved for an open source license, because apparently its different if you try to record, and don't have a valid key, and if you try and record, and don't have any runs left.

If you don't have any tests left, it doesn't run the cypress tests, a critical flaw that I am looking into.

[bmcutler]

@IDzyre please resolve merge conflicts