Nightly Tests

Overview

Every night, a set of tests run as part of the TeamCity project Nightlies. These tests have a few common characteristics:

• They set up a temporary CockroachDB cluster and run load against it.
• Their runtime is too long for them to be included in CI.

All nightly tests, except for Jepsen, use Terraform to create and destroy their temporary cluster. It may be wise to remove Terraform in the future, given the cognitive overhead of using a tool that provides much more functionality than we need.

Test Entry Points

TeamCity jobs execute various bash scripts that, in turn, run the relevant tests. These files are named teamcity/build-*.sh. Key files include:

(to finish)

Key Source Files

• pkg/acceptance/terrafarm - terrafarm.(*Farmer) is our thin wrapper around Terraform. It's used by most nightlies to setup, interact with, and destroy the temporary cluster for the test.
• pkg/acceptance/terraform - Contains the Terraform config files. Reference: Terraform configuration docs.
• pkg/acceptance/allocator_test.go - Allocator tests, including the schema change test and test steady 6 nodes.
• pkg/acceptance/continuous_load_test.go - Continuous load tests.