Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

[Karel] Remove karel_2_10 integration test #39026

Merged
merged 1 commit into from Feb 15, 2021
Merged

[Karel] Remove karel_2_10 integration test #39026

merged 1 commit into from Feb 15, 2021

Conversation

ajpal
Copy link
Contributor

@ajpal ajpal commented Feb 12, 2021

We've had some problems with this test being flaky. Most recently, we increased the timeout (PR), however that hasn't entirely fixed the issue.

The level being tested is https://studio.code.org/s/20-hour/stage/13/puzzle/10

Each karel level has its own integration test verifying that the solution passes the level. This way of writing and testing levels is deprecated. Now, all levels are managed through Levelbuilder, and owned by Curriculum, not engineering. We will not be making any changes to this level (other than potentially moving it to Levelbuilder someday, at which point we would definitely delete this test). Additionally, we rarely make changes to Karel/Maze, so chances of regressions are quite small, and we still have level solution tests for most of the levels. So it feels safe enough to remove this test to reduce noise in our test pipeline.

@ajpal ajpal requested a review from a team February 12, 2021 19:49
@ajpal ajpal merged commit 305f546 into staging Feb 15, 2021
@ajpal ajpal deleted the feb12-karel-test branch February 15, 2021 17:48
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
None yet
Projects
None yet
Development

Successfully merging this pull request may close these issues.

None yet

2 participants