forked from scylladb/scylla-cluster-tests
-
Notifications
You must be signed in to change notification settings - Fork 0
Commit
This commit does not belong to any branch on this repository, and may belong to a fork outside of the repository.
refactor(test configuration): network interface configuration
We need to configure Scylla networking with multiple NIC/IP combinations. There are a few addresses to configure Scylla connections: rpc_address, listen_address, broadcast_address, broadcast_rpc_address. We want to be able to use different NIC/IP for addresses, at least, for rpc_address and listen_address: - rpc_address: ipv4, private, nic 0 - listen_address: ipv4, public, nic 1 This commit presents SCT configuration changes for support this. According to issue scylladb/scylla-manager#3411
- Loading branch information
1 parent
9016c20
commit 58a2460
Showing
59 changed files
with
1,158 additions
and
172 deletions.
There are no files selected for viewing
28 changes: 28 additions & 0 deletions
28
configurations/network_config/all_addresses_ipv6_public.yaml
This file contains bidirectional Unicode text that may be interpreted or compiled differently than what appears below. To review, open the file in an editor that reveals hidden Unicode characters.
Learn more about bidirectional Unicode characters
Original file line number | Diff line number | Diff line change |
---|---|---|
@@ -0,0 +1,28 @@ | ||
scylla_network_config: | ||
- address: listen_address # Address Scylla listens for connections from other nodes. See storage_port and ssl_storage_ports. | ||
ip_type: ipv6 | ||
public: true | ||
listen_all: false # Should be True when multiple interfaces - Scylla should be listening on all interfaces | ||
use_dns: false | ||
nic: 0 | ||
- address: rpc_address # Address on which Scylla is going to expect Thrift and CQL client connections. | ||
ip_type: ipv6 | ||
public: true | ||
listen_all: false # Should be True when multiple interfaces - Scylla should be listening on all interfaces | ||
use_dns: false | ||
nic: 0 | ||
- address: broadcast_rpc_address # Address that is broadcasted to tell the clients to connect to. Related to rpc_address. | ||
ip_type: ipv6 | ||
public: true # Should be False when multiple interfaces | ||
use_dns: false | ||
nic: 0 | ||
- address: broadcast_address # Address that is broadcasted to tell other Scylla nodes to connect to. Related to listen_address above. | ||
ip_type: ipv6 | ||
public: true # Should be False when multiple interfaces | ||
use_dns: false | ||
nic: 0 # If ipv4 and public is True it has to be primary network interface (device index is 0) | ||
- address: test_communication # Type of IP used to connect to machine instances | ||
ip_type: ipv6 | ||
public: true | ||
use_dns: false | ||
nic: 0 # If ipv4 and public is True it has to be primary network interface (device index is 0) |
28 changes: 28 additions & 0 deletions
28
configurations/network_config/test_communication_public.yaml
This file contains bidirectional Unicode text that may be interpreted or compiled differently than what appears below. To review, open the file in an editor that reveals hidden Unicode characters.
Learn more about bidirectional Unicode characters
Original file line number | Diff line number | Diff line change |
---|---|---|
@@ -0,0 +1,28 @@ | ||
scylla_network_config: | ||
- address: listen_address # Address Scylla listens for connections from other nodes. See storage_port and ssl_storage_ports. | ||
ip_type: ipv4 | ||
public: false | ||
listen_all: false # Should be True when multiple interfaces - Scylla should be listening on all interfaces | ||
use_dns: false | ||
nic: 0 | ||
- address: rpc_address # Address on which Scylla is going to expect Thrift and CQL client connections. | ||
ip_type: ipv4 | ||
public: false | ||
listen_all: false # Should be True when multiple interfaces - Scylla should be listening on all interfaces | ||
use_dns: false | ||
nic: 0 | ||
- address: broadcast_rpc_address # Address that is broadcasted to tell the clients to connect to. Related to rpc_address. | ||
ip_type: ipv4 | ||
public: false # Should be False when multiple interfaces | ||
use_dns: false | ||
nic: 0 | ||
- address: broadcast_address # Address that is broadcasted to tell other Scylla nodes to connect to. Related to listen_address above. | ||
ip_type: ipv4 | ||
public: false # Should be False when multiple interfaces | ||
use_dns: false | ||
nic: 0 # If ipv4 and public is True it has to be primary network interface (device index is 0) | ||
- address: test_communication # Type of IP used to connect to machine instances | ||
ip_type: ipv4 | ||
public: true | ||
use_dns: false | ||
nic: 0 # If ipv4 and public is True it has to be primary network interface (device index is 0) |
This file contains bidirectional Unicode text that may be interpreted or compiled differently than what appears below. To review, open the file in an editor that reveals hidden Unicode characters.
Learn more about bidirectional Unicode characters
Original file line number | Diff line number | Diff line change |
---|---|---|
@@ -0,0 +1,28 @@ | ||
scylla_network_config: | ||
- address: listen_address # Address Scylla listens for connections from other nodes. See storage_port and ssl_storage_ports. | ||
ip_type: ipv4 | ||
public: false | ||
listen_all: true # Should be True when multiple interfaces - Scylla should be listening on all interfaces | ||
use_dns: false | ||
nic: 1 | ||
- address: rpc_address # Address on which Scylla is going to expect Thrift and CQL client connections. | ||
ip_type: ipv4 | ||
public: false | ||
listen_all: true # Should be True when multiple interfaces - Scylla should be listening on all interfaces | ||
use_dns: false | ||
nic: 1 | ||
- address: broadcast_rpc_address # Address that is broadcasted to tell the clients to connect to. Related to rpc_address. | ||
ip_type: ipv4 | ||
public: false # Should be False when multiple interfaces | ||
use_dns: false | ||
nic: 1 | ||
- address: broadcast_address # Address that is broadcasted to tell other Scylla nodes to connect to. Related to listen_address above. | ||
ip_type: ipv4 | ||
public: false # Should be False when multiple interfaces | ||
use_dns: false | ||
nic: 1 # If ipv4 and public is True it has to be primary network interface (device index is 0) | ||
- address: test_communication # Type of IP used to connect from test to DB/monitor instances | ||
ip_type: ipv4 | ||
public: true | ||
use_dns: false | ||
nic: 0 # If ipv4 and public is True it has to be primary network interface (device index is 0) |
This file contains bidirectional Unicode text that may be interpreted or compiled differently than what appears below. To review, open the file in an editor that reveals hidden Unicode characters.
Learn more about bidirectional Unicode characters
39 changes: 39 additions & 0 deletions
39
internal_test_data/network_config_interface_not_defined.yaml
This file contains bidirectional Unicode text that may be interpreted or compiled differently than what appears below. To review, open the file in an editor that reveals hidden Unicode characters.
Learn more about bidirectional Unicode characters
Original file line number | Diff line number | Diff line change |
---|---|---|
@@ -0,0 +1,39 @@ | ||
test_duration: 5 | ||
|
||
n_db_nodes: 3 | ||
n_loaders: 1 | ||
n_monitor_nodes: 1 | ||
user_prefix: 'fruch-testing' | ||
|
||
stress_cmd: ["cassandra-stress mixed cl=QUORUM duration=10m -schema 'replication(strategy=NetworkTopologyStrategy,replication_factor=3) compaction(strategy=SizeTieredCompactionStrategy)' -mode cql3 native -rate threads=2 -pop seq=1..3000 -log interval=5" ] | ||
|
||
stress_read_cmd: ["cassandra-stress user profile=/tmp/c-s_profile_4mv_5queries.yaml ops'(insert=15,read1=1,read2=1,read3=1,read4=1,read5=1)' cl=QUORUM duration=5760m -mode cql3 native -rate threads=10", | ||
"cassandra-stress user profile=/tmp/c-s_profile_2mv_2queries.yaml ops'(insert=6,mv_p_read1=1,mv_p_read2=1)' cl=QUORUM duration=5760m -mode cql3 native -rate threads=10", | ||
"cassandra-stress user profile=/tmp/c-s_profile_3si_5queries.yaml ops'(insert=25,si_read1=1,si_read2=1,si_read3=1,si_read4=1,si_read5=1)' cl=QUORUM duration=5760m -mode cql3 native -rate threads=10", | ||
"cassandra-stress user profile=/tmp/c-s_profile_2si_2queries.yaml ops'(insert=10,si_p_read1=1,si_p_read2=1)' cl=QUORUM duration=5760m -mode cql3 native -rate threads=10" | ||
] | ||
|
||
db_type: scylla | ||
instance_type_db: 'i4i.large' | ||
|
||
scylla_network_config: | ||
- address: "listen_address" | ||
ip_type: “ipv4” | ||
public: false | ||
use_dns: false | ||
nic: 0 | ||
- address: broadcast_rpc_address # Address that is broadcasted to tell the clients to connect to. Related to rpc_address. | ||
ip_type: ipv4 | ||
public: false # Should be False when multiple interfaces; Only public IPv6 is supported by AWS | ||
use_dns: false | ||
nic: 0 | ||
- address: broadcast_address # Address that is broadcasted to tell other Scylla nodes to connect to. Related to listen_address above. | ||
ip_type: ipv4 | ||
public: false # Should be False when multiple interfaces; Only public IPv6 is supported by AWS | ||
use_dns: false | ||
nic: 0 | ||
- address: test_communication # Type of IP used to connect from test to DB/monitor instances | ||
ip_type: ipv4 | ||
public: false | ||
use_dns: false | ||
nic: 0 # If ipv4 and public is True it has to be primary network interface (device index is 0) |
28 changes: 28 additions & 0 deletions
28
internal_test_data/network_config_interface_param_not_defined.yaml
This file contains bidirectional Unicode text that may be interpreted or compiled differently than what appears below. To review, open the file in an editor that reveals hidden Unicode characters.
Learn more about bidirectional Unicode characters
Original file line number | Diff line number | Diff line change |
---|---|---|
@@ -0,0 +1,28 @@ | ||
test_duration: 5 | ||
|
||
n_db_nodes: 3 | ||
n_loaders: 1 | ||
n_monitor_nodes: 1 | ||
user_prefix: 'fruch-testing' | ||
|
||
stress_cmd: ["cassandra-stress mixed cl=QUORUM duration=10m -schema 'replication(strategy=NetworkTopologyStrategy,replication_factor=3) compaction(strategy=SizeTieredCompactionStrategy)' -mode cql3 native -rate threads=2 -pop seq=1..3000 -log interval=5" ] | ||
|
||
stress_read_cmd: ["cassandra-stress user profile=/tmp/c-s_profile_4mv_5queries.yaml ops'(insert=15,read1=1,read2=1,read3=1,read4=1,read5=1)' cl=QUORUM duration=5760m -mode cql3 native -rate threads=10", | ||
"cassandra-stress user profile=/tmp/c-s_profile_2mv_2queries.yaml ops'(insert=6,mv_p_read1=1,mv_p_read2=1)' cl=QUORUM duration=5760m -mode cql3 native -rate threads=10", | ||
"cassandra-stress user profile=/tmp/c-s_profile_3si_5queries.yaml ops'(insert=25,si_read1=1,si_read2=1,si_read3=1,si_read4=1,si_read5=1)' cl=QUORUM duration=5760m -mode cql3 native -rate threads=10", | ||
"cassandra-stress user profile=/tmp/c-s_profile_2si_2queries.yaml ops'(insert=10,si_p_read1=1,si_p_read2=1)' cl=QUORUM duration=5760m -mode cql3 native -rate threads=10" | ||
] | ||
|
||
db_type: scylla | ||
instance_type_db: 'i4i.large' | ||
|
||
scylla_network_config: | ||
- address: "listen_address" | ||
ip_type: “ipv4” | ||
use_dns: false | ||
nic: 0 | ||
- address: "rpc_address" | ||
ip_type: “ipv6” | ||
public: true | ||
use_dns: false | ||
nic: 0 |
46 changes: 46 additions & 0 deletions
46
internal_test_data/network_config_interface_param_public_not_primary.yaml
This file contains bidirectional Unicode text that may be interpreted or compiled differently than what appears below. To review, open the file in an editor that reveals hidden Unicode characters.
Learn more about bidirectional Unicode characters
Original file line number | Diff line number | Diff line change |
---|---|---|
@@ -0,0 +1,46 @@ | ||
test_duration: 5 | ||
|
||
n_db_nodes: 3 | ||
n_loaders: 1 | ||
n_monitor_nodes: 1 | ||
user_prefix: 'fruch-testing' | ||
|
||
stress_cmd: ["cassandra-stress mixed cl=QUORUM duration=10m -schema 'replication(strategy=NetworkTopologyStrategy,replication_factor=3) compaction(strategy=SizeTieredCompactionStrategy)' -mode cql3 native -rate threads=2 -pop seq=1..3000 -log interval=5" ] | ||
|
||
stress_read_cmd: ["cassandra-stress user profile=/tmp/c-s_profile_4mv_5queries.yaml ops'(insert=15,read1=1,read2=1,read3=1,read4=1,read5=1)' cl=QUORUM duration=5760m -mode cql3 native -rate threads=10", | ||
"cassandra-stress user profile=/tmp/c-s_profile_2mv_2queries.yaml ops'(insert=6,mv_p_read1=1,mv_p_read2=1)' cl=QUORUM duration=5760m -mode cql3 native -rate threads=10", | ||
"cassandra-stress user profile=/tmp/c-s_profile_3si_5queries.yaml ops'(insert=25,si_read1=1,si_read2=1,si_read3=1,si_read4=1,si_read5=1)' cl=QUORUM duration=5760m -mode cql3 native -rate threads=10", | ||
"cassandra-stress user profile=/tmp/c-s_profile_2si_2queries.yaml ops'(insert=10,si_p_read1=1,si_p_read2=1)' cl=QUORUM duration=5760m -mode cql3 native -rate threads=10" | ||
] | ||
|
||
db_type: scylla | ||
instance_type_db: 'i4i.large' | ||
|
||
scylla_network_config: | ||
- address: listen_address # Address Scylla listens for connections from other nodes. See storage_port and ssl_storage_ports. | ||
ip_type: ipv4 | ||
public: false | ||
listen_all: true # Should be True when multiple interfaces - Scylla should be listening on all interfaces | ||
use_dns: false | ||
nic: 1 | ||
- address: rpc_address # Address on which Scylla is going to expect Thrift and CQL client connections. | ||
ip_type: ipv4 | ||
public: false | ||
listen_all: true # Should be True when multiple interfaces - Scylla should be listening on all interfaces | ||
use_dns: false | ||
nic: 1 | ||
- address: broadcast_rpc_address # Address that is broadcasted to tell the clients to connect to. Related to rpc_address. | ||
ip_type: ipv4 | ||
public: false # Should be False when multiple interfaces | ||
use_dns: false | ||
nic: 1 | ||
- address: broadcast_address # Address that is broadcasted to tell other Scylla nodes to connect to. Related to listen_address above. | ||
ip_type: ipv4 | ||
public: false # Should be False when multiple interfaces | ||
use_dns: false | ||
nic: 1 # If ipv4 and public is True it has to be primary network interface (device index is 0) | ||
- address: test_communication # Type of IP used to connect from test to DB/monitor instances | ||
ip_type: ipv4 | ||
public: true | ||
use_dns: false | ||
nic: 1 # If ipv4 and public is True it has to be primary network interface (device index is 0) |
This file contains bidirectional Unicode text that may be interpreted or compiled differently than what appears below. To review, open the file in an editor that reveals hidden Unicode characters.
Learn more about bidirectional Unicode characters
This file contains bidirectional Unicode text that may be interpreted or compiled differently than what appears below. To review, open the file in an editor that reveals hidden Unicode characters.
Learn more about bidirectional Unicode characters
This file contains bidirectional Unicode text that may be interpreted or compiled differently than what appears below. To review, open the file in an editor that reveals hidden Unicode characters.
Learn more about bidirectional Unicode characters
This file contains bidirectional Unicode text that may be interpreted or compiled differently than what appears below. To review, open the file in an editor that reveals hidden Unicode characters.
Learn more about bidirectional Unicode characters
This file contains bidirectional Unicode text that may be interpreted or compiled differently than what appears below. To review, open the file in an editor that reveals hidden Unicode characters.
Learn more about bidirectional Unicode characters
This file contains bidirectional Unicode text that may be interpreted or compiled differently than what appears below. To review, open the file in an editor that reveals hidden Unicode characters.
Learn more about bidirectional Unicode characters
This file contains bidirectional Unicode text that may be interpreted or compiled differently than what appears below. To review, open the file in an editor that reveals hidden Unicode characters.
Learn more about bidirectional Unicode characters
Oops, something went wrong.