A sample app that validates some basic CircleCI features in three parallel workflows.
NOTE: Please read the entirety of this README before continuing. There are some important prerequisites.
To run realitycheck, fork the repository and start building it on your installation of CircleCI. See Using realitycheck to validate your CircleCI installation, in the CircleCI Support Center, for details on forking the project and building it on your CircleCI installation.
Descriptions of the three workflows follow.
Tests all known resource_class options—queries the CircleCI API to verify that jobs ran with the requested resources.
- Your Nomad client instances must be large enough to accommodate these resource classes — see our Configuration Reference for details on the available resource classes and our server docs about sizing your Nomad client instances.
- The base URL of your CircleCI installation (e.g. https://circleci.com) must be specified via a
CIRCLE_HOSTNAMEproject environment variable - A personal API token (see
CIRCLE_HOSTNAME/account/apiURL endpoint) must be stored as aCIRCLE_TOKENproject environment variable
Tests the functionality of the machine executor, Remote Docker Environment, and Docker Layer Caching.
- Tests ability to save and restore caches
- Tests writing to and reading from workspaces
- Tests the default
org-globalcontext (NOTE: needs a key calledCONTEXT_END_TO_END_TEST_VARto exist in a context calledorg-global) - Tests multiple contexts (NOTE: needs a key called
MULTI_CONTEXT_END_TO_END_VARto exist in a context calledindividual-local) - Tests upload/storage of artifacts and test results
You will need to configure the following contexts and keys (their values can be anything). Docs on how to set up contexts can be found here.
| Context Name | Key Name |
|---|---|
| org-global | CONTEXT_END_TO_END_TEST_VAR |
| individual-local | MULTI_CONTEXT_END_TO_END_VAR |
If you have more ideas for things that should tested, please submit a PR against the open-source repository on GitHub where this project is maintained: https://github.com/circleci/realitycheck. See the current CI status of the main repo at https://circleci.com/gh/circleci/workflows/realitycheck. View the LICENSE file in this repository for licensing information.