Cassandra Distributed Tests
Python Shell
Latest commit 4670c98 Jul 27, 2016 @c-kodman c-kodman committed with ptnapoleon add known failure annotation (#1144)
* add known failure annotation

* remove print statements

* add white space
Failed to load latest commit information.
bin change os.environ so it's used in nose.main May 25, 2016
cassandra-thrift Restore thrift interface for slice test Aug 22, 2014
conf exclude utv upgrade tests from main Jul 19, 2016
cqlsh_tests Merge pull request #1142 from c-kodman/fix12316 Jul 27, 2016
doxygen Make doxygen html look nicer Jul 29, 2015
lib Add jolokia license to lib/ May 11, 2015
meta_tests Cstar 67 (#1012) Jun 29, 2016
plugins add plugin & runner for global configuration Feb 22, 2016
repair_tests add known failure annotation Jul 27, 2016
thrift_bindings bulk isort Mar 23, 2016
upgrade_tests default to env-relevant upgrade tests (#1095) Jul 22, 2016
utils Create ReusableClusterTester, use on thrift_tests.py Jun 28, 2016
.gitignore Add pycharm files to .gitignore Jul 14, 2016
.isort.cfg add isort config to know ccm and cassandra as non-local imports Mar 23, 2016
.travis.yml Ignore line length for json_test only Jun 15, 2016
CONTRIBUTING.md Improve readability of contribution doc Jul 26, 2016
INSTALL.md Mention jdk 8 in install docs, not 7 Apr 4, 2016
LICENSE Add Apache 2.0 License file Aug 10, 2015
README.md Add jdk switching Jun 25, 2015
assertions.py Tests to reproduce CASSANDRA-11848 Jul 18, 2016
auth_test.py change assert to self.assertIn (#1138) Jul 26, 2016
batch_test.py Cstar 67 (#1012) Jun 29, 2016
bootstrap_test.py Update consistent bootstrap tests to support non-vnodes case (CASSAND… Jul 20, 2016
cdc_test.py run autopep8 on cdc_test.py Jul 25, 2016
cfid_test.py bulk isort Mar 23, 2016
commitlog_test.py Change 12165 to 12213 in annotation Jul 19, 2016
compaction_test.py add known failure annotation (#1144) Jul 27, 2016
compression_test.py bulk isort Mar 23, 2016
concurrent_schema_changes_test.py some python format changes Jul 21, 2016
configuration_test.py Cstar 67 (#1012) Jun 29, 2016
consistency_test.py Merge pull request #1083 from stef1927/11950 Jul 21, 2016
consistent_bootstrap_test.py updated dtest to reflect changes in ccm Jun 1, 2016
counter_tests.py Remove 12161 annotation Jul 22, 2016
cql_prepared_test.py bulk isort Mar 23, 2016
cql_tests.py Merge pull request #1065 from thobbs/reusable-cluster Jul 6, 2016
cql_tracing_test.py Change 12159 annotation to 11465 Jul 25, 2016
datahelp.py bulk isort Mar 23, 2016
delete_insert_test.py fixed assert_equal Jul 14, 2016
deletion_test.py don't set unnecessary intermediate `result` values Mar 17, 2016
disk_balance_test.py Run autopep8 on all files Jun 23, 2016
dtest.py default to env-relevant upgrade tests (#1095) Jul 22, 2016
findlibjemalloc.sh Improve startup time by prelocating libjemalloc Jun 23, 2016
global_row_key_cache_test.py bulk isort Mar 23, 2016
hintedhandoff_test.py Put 11902 annotation on the correct test Jul 18, 2016
internode_ssl_test.py known failure for cassandra-11689 Apr 29, 2016
jmx_auth_test.py Update message text in jmx_auth_test following CASSANDRA-12076 Jul 12, 2016
jmx_test.py Add tests for connecting to JMX with SSL (#1099) Jul 20, 2016
jmxutils.py Add tests for connecting to JMX with SSL (#1099) Jul 20, 2016
json_test.py Remove 12291 annotation Jul 26, 2016
json_tools_test.py Change 11975 to 11952 Jul 5, 2016
largecolumn_test.py Cstar 67 (#1012) Jun 29, 2016
license.txt permissions May 30, 2014
linter_check.sh Ignore line length for json_test only Jun 15, 2016
materialized_views_test.py add known_failure annotation Jul 18, 2016
metadata_tests.py Move @known_failure annotations first Apr 5, 2016
mixed_version_test.py bulk isort Mar 23, 2016
multidc_putget_test.py Fix PEP-8 violations Jul 20, 2015
native_transport_ssl_test.py Cstar 67 (#1012) Jun 29, 2016
nodetool_test.py bulk isort Mar 23, 2016
offline_tools_test.py add debugging for level-getting code Jul 26, 2016
paging_test.py Set default consistency to CL.QUORUM, added wait_for_binary_proto and… Jul 11, 2016
paxos_tests.py Cstar 67 (#1012) Jun 29, 2016
pending_range_test.py bulk isort Mar 23, 2016
prepared_statements_test.py bulk isort Mar 23, 2016
pushed_notifications_test.py Expect extra notifications during restart on 2.1 (#1122) Jul 22, 2016
putget_test.py Cstar 67 (#1012) Jun 29, 2016
range_ghost_test.py Cstar 67 (#1012) Jun 29, 2016
read_repair_test.py Only check first two columns of result Jul 5, 2016
rebuild_test.py add ALTER KEYSPACE to make rebuild commands work (#1133) Jul 26, 2016
replace_address_test.py add known failure annotation Jul 27, 2016
replication_test.py add debug statement to murmur loop (#1101) Jul 15, 2016
requirements.txt add initial tests for CDC Jun 20, 2016
run_dtests.py remove confusing unused nose_argv .format arg Mar 29, 2016
schema_metadata_test.py bulk isort Mar 23, 2016
schema_test.py Cstar 67 (#1012) Jun 29, 2016
scrub_test.py disable minor compaction in scrub test Jul 11, 2016
secondary_indexes_test.py Block until index is finished before inserting data (#1135) Jul 26, 2016
snapshot_test.py Remove 12139 annotation Jul 6, 2016
snitch_test.py Remove 12099 annotation Jul 18, 2016
sslkeytool.py Add ssl node-to-node encryption test Feb 15, 2016
sslnodetonode_test.py Add known_failure for CASSANDRA-11506 Apr 5, 2016
sstable_generation_loading_test.py Pyclean Jul 22, 2016
sstablesplit_test.py added 'no-warmup' arg to stress calls Jun 10, 2016
sstableutil_test.py Cstar 67 (#1012) Jun 29, 2016
stress_tool_test.py added 'no-warmup' arg to stress calls Jun 10, 2016
super_column_cache_test.py bulk isort Mar 23, 2016
super_counter_test.py bulk isort Mar 23, 2016
thrift_hsha_test.py bulk isort Mar 23, 2016
thrift_tests.py Fix 12158 Jul 12, 2016
token_generator_test.py Fix no_vnode bug in token_generator_test.py Jul 27, 2016
tools.py corrected assert_length_equal to assertions.assert_length_equal Jun 30, 2016
topology_test.py Add 12260 annotation Jul 21, 2016
ttl_test.py bulk isort Mar 23, 2016
udtencoding_test.py bulk isort Mar 23, 2016
upgrade_crc_check_chance_test.py known failure for cassandra-11699 May 2, 2016
upgrade_internal_auth_test.py Move @known_failure annotations first Apr 5, 2016
upgrade_supercolumns_test.py add RerunTestException and enable for one test Apr 29, 2016
user_functions_test.py added known failure Jul 25, 2016
user_types_test.py Cstar 67 (#1012) Jun 29, 2016
wide_rows_test.py Style fixes in wide_rows_test Jul 12, 2016
write_failures_test.py Change 12261 annotation to bug Jul 21, 2016

README.md

Cassandra Distributed Tests

Tests for Apache Cassandra clusters.

Prerequisites

An up to date copy of ccm should be installed for starting and stopping Cassandra. The tests are run using nosetests. These tests require the datastax python driver. A few tests still require the deprecated python CQL over thrift driver.

Usage

The tests are run by nosetests. The only thing the framework needs to know is the location of the (compiled) sources for Cassandra. There are two options:

Use existing sources:

CASSANDRA_DIR=~/path/to/cassandra nosetests

Use ccm ability to download/compile released sources from archives.apache.org:

CASSANDRA_VERSION=1.0.0 nosetests

A convenient option if tests are regularly run against the same existing directory is to set a default_dir in ~/.cassandra-dtest. Create the file and set it to something like:

[main]
default_dir=~/path/to/cassandra

The tests will use this directory by default, avoiding the need for any environment variable (that still will have precedence if given though).

Existing tests are probably the best place to start to look at how to write tests.

Each test spawns a new fresh cluster and tears it down after the test, unless REUSE_CLUSTER is set to true. Then some tests will share cassandra instances. If a test fails, the logs for the node are saved in a logs/<timestamp> directory for analysis (it's not perfect but has been good enough so far, I'm open to better suggestions).

To run the upgrade tests, you have must both JDK7 and JDK8 installed. Paths to these installations should be defined in the environment variables JAVA7_HOME and JAVA8_HOME, respectively.

Installation Instructions

See more detailed instructions in the included INSTALL file.

Writing Tests

  • Most of the time when you start a cluster with cluster.start(), you'll want to pass in wait_for_binary_proto=True so the call blocks until the cluster is ready to accept CQL connections. We tried setting this to True by default once, but the problems caused there (e.g. when it waited the full timeout time on a node that was deliberately down) were more unpleasant and more difficult to debug than the problems caused by having it False by default.
  • If you're using JMX via the jmxutils module, make sure to call remove_perf_disable_shared_mem on the node or nodes you want to query with JMX before starting the nodes. remove_perf_disable_shared_mem disables a JVM option that's incompatible with JMX (see this JMX ticket). It works by performing a string replacement in the node's Cassandra startup script, so changes will only propagate to the node at startup time.

If you'd like to know what to expect during a code review, please see the included CONTRIBUTING file.