forked from scylladb/scylla-cluster-tests
-
Notifications
You must be signed in to change notification settings - Fork 0
Commit
This commit does not belong to any branch on this repository, and may belong to a fork outside of the repository.
refactor(test configuration): network interface configuration
We need to configure Scylla networking with multiple NIC/IP combinations. There are a few addresses to configure Scylla connections: rpc_address, listen_address, broadcast_address, broadcast_rpc_address. We want to be able to use different NIC/IP for addresses, at least, for rpc_address and listen_address: - rpc_address: ipv4, private, nic 0 - listen_address: ipv4, public, nic 1 This commit presents SCT configuration changes for support this. According to issue scylladb/scylla-manager#3411
- Loading branch information
1 parent
e798bb6
commit 1505d6f
Showing
52 changed files
with
1,010 additions
and
145 deletions.
There are no files selected for viewing
This file contains bidirectional Unicode text that may be interpreted or compiled differently than what appears below. To review, open the file in an editor that reveals hidden Unicode characters.
Learn more about bidirectional Unicode characters
Original file line number | Diff line number | Diff line change |
---|---|---|
@@ -0,0 +1,28 @@ | ||
scylla_network_config: | ||
- address: listen_address # Address Scylla listens for connections from other nodes. See storage_port and ssl_storage_ports. | ||
ip_type: ipv6 | ||
public: true | ||
listen_all: false # Should be True when multiple interfaces - Scylla should be listening on all interfaces | ||
use_dns: false | ||
nic: 0 | ||
- address: rpc_address # Address on which Scylla is going to expect Thrift and CQL client connections. | ||
ip_type: ipv6 | ||
public: true | ||
listen_all: false # Should be True when multiple interfaces - Scylla should be listening on all interfaces | ||
use_dns: false | ||
nic: 0 | ||
- address: broadcast_rpc_address # Address that is broadcasted to tell the clients to connect to. Related to rpc_address. | ||
ip_type: ipv6 | ||
public: true # Should be False when multiple interfaces | ||
use_dns: false | ||
nic: 0 | ||
- address: broadcast_address # Address that is broadcasted to tell other Scylla nodes to connect to. Related to listen_address above. | ||
ip_type: ipv6 | ||
public: true # Should be False when multiple interfaces | ||
use_dns: false | ||
nic: 0 # If ipv4 and public is True it has to be primary network interface (device index is 0) | ||
- address: test_communication # Type of IP used to connect to machine instances | ||
ip_type: ipv6 | ||
public: true | ||
use_dns: false | ||
nic: 0 # If ipv4 and public is True it has to be primary network interface (device index is 0) |
28 changes: 28 additions & 0 deletions
28
configurations/network_config/test_communication_public.yaml
This file contains bidirectional Unicode text that may be interpreted or compiled differently than what appears below. To review, open the file in an editor that reveals hidden Unicode characters.
Learn more about bidirectional Unicode characters
Original file line number | Diff line number | Diff line change |
---|---|---|
@@ -0,0 +1,28 @@ | ||
scylla_network_config: | ||
- address: listen_address # Address Scylla listens for connections from other nodes. See storage_port and ssl_storage_ports. | ||
ip_type: ipv4 | ||
public: false | ||
listen_all: false # Should be True when multiple interfaces - Scylla should be listening on all interfaces | ||
use_dns: false | ||
nic: 0 | ||
- address: rpc_address # Address on which Scylla is going to expect Thrift and CQL client connections. | ||
ip_type: ipv4 | ||
public: false | ||
listen_all: false # Should be True when multiple interfaces - Scylla should be listening on all interfaces | ||
use_dns: false | ||
nic: 0 | ||
- address: broadcast_rpc_address # Address that is broadcasted to tell the clients to connect to. Related to rpc_address. | ||
ip_type: ipv4 | ||
public: false # Should be False when multiple interfaces | ||
use_dns: false | ||
nic: 0 | ||
- address: broadcast_address # Address that is broadcasted to tell other Scylla nodes to connect to. Related to listen_address above. | ||
ip_type: ipv4 | ||
public: false # Should be False when multiple interfaces | ||
use_dns: false | ||
nic: 0 # If ipv4 and public is True it has to be primary network interface (device index is 0) | ||
- address: test_communication # Type of IP used to connect to machine instances | ||
ip_type: ipv4 | ||
public: true | ||
use_dns: false | ||
nic: 0 # If ipv4 and public is True it has to be primary network interface (device index is 0) |
This file contains bidirectional Unicode text that may be interpreted or compiled differently than what appears below. To review, open the file in an editor that reveals hidden Unicode characters.
Learn more about bidirectional Unicode characters
Original file line number | Diff line number | Diff line change |
---|---|---|
@@ -0,0 +1,28 @@ | ||
scylla_network_config: | ||
- address: listen_address # Address Scylla listens for connections from other nodes. See storage_port and ssl_storage_ports. | ||
ip_type: ipv4 | ||
public: false | ||
listen_all: true # Should be True when multiple interfaces - Scylla should be listening on all interfaces | ||
use_dns: false | ||
nic: 1 | ||
- address: rpc_address # Address on which Scylla is going to expect Thrift and CQL client connections. | ||
ip_type: ipv4 | ||
public: false | ||
listen_all: true # Should be True when multiple interfaces - Scylla should be listening on all interfaces | ||
use_dns: false | ||
nic: 1 | ||
- address: broadcast_rpc_address # Address that is broadcasted to tell the clients to connect to. Related to rpc_address. | ||
ip_type: ipv4 | ||
public: false # Should be False when multiple interfaces | ||
use_dns: false | ||
nic: 1 | ||
- address: broadcast_address # Address that is broadcasted to tell other Scylla nodes to connect to. Related to listen_address above. | ||
ip_type: ipv4 | ||
public: false # Should be False when multiple interfaces | ||
use_dns: false | ||
nic: 1 # If ipv4 and public is True it has to be primary network interface (device index is 0) | ||
- address: test_communication # Type of IP used to connect to machine instances | ||
ip_type: ipv4 | ||
public: true | ||
use_dns: false | ||
nic: 0 # If ipv4 and public is True it has to be primary network interface (device index is 0) |
This file contains bidirectional Unicode text that may be interpreted or compiled differently than what appears below. To review, open the file in an editor that reveals hidden Unicode characters.
Learn more about bidirectional Unicode characters
24 changes: 24 additions & 0 deletions
24
internal_test_data/network_config_interface_not_defined.yaml
This file contains bidirectional Unicode text that may be interpreted or compiled differently than what appears below. To review, open the file in an editor that reveals hidden Unicode characters.
Learn more about bidirectional Unicode characters
Original file line number | Diff line number | Diff line change |
---|---|---|
@@ -0,0 +1,24 @@ | ||
test_duration: 5 | ||
|
||
n_db_nodes: 3 | ||
n_loaders: 1 | ||
n_monitor_nodes: 1 | ||
user_prefix: 'fruch-testing' | ||
|
||
stress_cmd: ["cassandra-stress mixed cl=QUORUM duration=10m -schema 'replication(strategy=NetworkTopologyStrategy,replication_factor=3) compaction(strategy=SizeTieredCompactionStrategy)' -mode cql3 native -rate threads=2 -pop seq=1..3000 -log interval=5" ] | ||
|
||
stress_read_cmd: ["cassandra-stress user profile=/tmp/c-s_profile_4mv_5queries.yaml ops'(insert=15,read1=1,read2=1,read3=1,read4=1,read5=1)' cl=QUORUM duration=5760m -mode cql3 native -rate threads=10", | ||
"cassandra-stress user profile=/tmp/c-s_profile_2mv_2queries.yaml ops'(insert=6,mv_p_read1=1,mv_p_read2=1)' cl=QUORUM duration=5760m -mode cql3 native -rate threads=10", | ||
"cassandra-stress user profile=/tmp/c-s_profile_3si_5queries.yaml ops'(insert=25,si_read1=1,si_read2=1,si_read3=1,si_read4=1,si_read5=1)' cl=QUORUM duration=5760m -mode cql3 native -rate threads=10", | ||
"cassandra-stress user profile=/tmp/c-s_profile_2si_2queries.yaml ops'(insert=10,si_p_read1=1,si_p_read2=1)' cl=QUORUM duration=5760m -mode cql3 native -rate threads=10" | ||
] | ||
|
||
db_type: scylla | ||
instance_type_db: 'i4i.large' | ||
|
||
scylla_network_config: | ||
- address: "listen_address" | ||
ip_type: “ipv4” | ||
public: false | ||
use_dns: false | ||
nic: 0 |
28 changes: 28 additions & 0 deletions
28
internal_test_data/network_config_interface_param_not_defined.yaml
This file contains bidirectional Unicode text that may be interpreted or compiled differently than what appears below. To review, open the file in an editor that reveals hidden Unicode characters.
Learn more about bidirectional Unicode characters
Original file line number | Diff line number | Diff line change |
---|---|---|
@@ -0,0 +1,28 @@ | ||
test_duration: 5 | ||
|
||
n_db_nodes: 3 | ||
n_loaders: 1 | ||
n_monitor_nodes: 1 | ||
user_prefix: 'fruch-testing' | ||
|
||
stress_cmd: ["cassandra-stress mixed cl=QUORUM duration=10m -schema 'replication(strategy=NetworkTopologyStrategy,replication_factor=3) compaction(strategy=SizeTieredCompactionStrategy)' -mode cql3 native -rate threads=2 -pop seq=1..3000 -log interval=5" ] | ||
|
||
stress_read_cmd: ["cassandra-stress user profile=/tmp/c-s_profile_4mv_5queries.yaml ops'(insert=15,read1=1,read2=1,read3=1,read4=1,read5=1)' cl=QUORUM duration=5760m -mode cql3 native -rate threads=10", | ||
"cassandra-stress user profile=/tmp/c-s_profile_2mv_2queries.yaml ops'(insert=6,mv_p_read1=1,mv_p_read2=1)' cl=QUORUM duration=5760m -mode cql3 native -rate threads=10", | ||
"cassandra-stress user profile=/tmp/c-s_profile_3si_5queries.yaml ops'(insert=25,si_read1=1,si_read2=1,si_read3=1,si_read4=1,si_read5=1)' cl=QUORUM duration=5760m -mode cql3 native -rate threads=10", | ||
"cassandra-stress user profile=/tmp/c-s_profile_2si_2queries.yaml ops'(insert=10,si_p_read1=1,si_p_read2=1)' cl=QUORUM duration=5760m -mode cql3 native -rate threads=10" | ||
] | ||
|
||
db_type: scylla | ||
instance_type_db: 'i4i.large' | ||
|
||
scylla_network_config: | ||
- address: "listen_address" | ||
ip_type: “ipv4” | ||
use_dns: false | ||
nic: 0 | ||
- address: "rpc_address" | ||
ip_type: “ipv6” | ||
public: true | ||
use_dns: false | ||
nic: 0 |
This file contains bidirectional Unicode text that may be interpreted or compiled differently than what appears below. To review, open the file in an editor that reveals hidden Unicode characters.
Learn more about bidirectional Unicode characters
This file contains bidirectional Unicode text that may be interpreted or compiled differently than what appears below. To review, open the file in an editor that reveals hidden Unicode characters.
Learn more about bidirectional Unicode characters
This file contains bidirectional Unicode text that may be interpreted or compiled differently than what appears below. To review, open the file in an editor that reveals hidden Unicode characters.
Learn more about bidirectional Unicode characters
This file contains bidirectional Unicode text that may be interpreted or compiled differently than what appears below. To review, open the file in an editor that reveals hidden Unicode characters.
Learn more about bidirectional Unicode characters
This file contains bidirectional Unicode text that may be interpreted or compiled differently than what appears below. To review, open the file in an editor that reveals hidden Unicode characters.
Learn more about bidirectional Unicode characters
Oops, something went wrong.