Skip to content

Exercises potentially out of sync #875

Open
@BNAndras

Description

@BNAndras

Recently, we've established that some exercises' test suites are out of sync with the upstream problem specifications repo. Normally, configlet sync --tests would flag this inconsistency by comparing the contents of the ./.meta/tests.toml file for every implemented exercise against the upstream repo. Exercism-wide PRs were made a few years to create tests.toml files in bulk for the then-implemented track exercises. These files reflect the tests that were available upstream at the time, not necessarily what was implemented at the time.

Therefore, we should revisit the exercises whose associated tests.toml file hasn't been updated in the Git history within the last years. We should go through each of those test.toml files and compare the upstream problem-specifications tests with what's actually in the Common Lisp track test suite. We should add any missing tests, one PR per exercise. That can be done with ./bin/lisp_exercise_generator which will generate a test suite for all currently available upstream tests.

Some exercises are deprecated like beer-song which means they're not available on the Exercism website unless the student had already solved the exercise or was in the progress of solving it when it was deprecated. We should focus on the other exercises for now.

Tests don't get added very often, so it's possible that a good number of these tests.toml files are up-to-date. It might be that we have similar tests to what's in the problem-specifications repo, so no changes are necessarily needed. That'll be up to verdammelt if those tests should be kept or not.

Metadata

Metadata

Assignees

No one assigned

    Labels

    No labels
    No labels

    Type

    No type

    Projects

    No projects

    Milestone

    No milestone

    Relationships

    None yet

    Development

    No branches or pull requests

    Issue actions