Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

nixos/tests: add check mariadb galera cluster #84136

Merged
merged 4 commits into from May 7, 2020

Conversation

@Izorkin
Copy link
Contributor

Izorkin commented Apr 2, 2020

Motivation for this change

Moved mysql tests to subfolder.
Added check mariadb galera cluster.

cc @flokli @aanderse @worldofpeace @disassembler.

Things done
  • Tested using sandboxing (nix.useSandbox on NixOS, or option sandbox in nix.conf on non-NixOS linux)
  • Built on platform(s)
    • NixOS
    • macOS
    • other Linux distributions
  • Tested via one or more NixOS test(s) if existing and applicable for the change (look inside nixos/tests)
  • Tested compilation of all pkgs that depend on this change using nix-shell -p nixpkgs-review --run "nixpkgs-review wip"
  • Tested execution of all binary files (usually in ./result/bin/)
  • Determined the impact on package closure size (by running nix path-info -S before and after)
  • Ensured that relevant documentation is up to date
  • Fits CONTRIBUTING.md.
@Izorkin
Copy link
Contributor Author

Izorkin commented Apr 2, 2020

@GrahamcOfBorg test mariadbGalera

@Izorkin
Copy link
Contributor Author

Izorkin commented Apr 2, 2020

@GrahamcOfBorg test mariadbGalera

@Izorkin Izorkin force-pushed the Izorkin:mariadb-galera-test branch 2 times, most recently from d864405 to 0da8331 Apr 3, 2020
@Izorkin
Copy link
Contributor Author

Izorkin commented Apr 3, 2020

@GrahamcOfBorg test mariadbGalera

nixos/tests/all-tests.nix Outdated Show resolved Hide resolved
nixos/tests/all-tests.nix Outdated Show resolved Hide resolved
nixos/tests/all-tests.nix Outdated Show resolved Hide resolved
nixos/tests/mysql/mariadb-galera.nix Outdated Show resolved Hide resolved
nixos/tests/mysql/mariadb-galera.nix Outdated Show resolved Hide resolved
nixos/tests/mysql/mariadb-galera.nix Outdated Show resolved Hide resolved
@Izorkin Izorkin force-pushed the Izorkin:mariadb-galera-test branch from 0da8331 to 80722c8 Apr 3, 2020
@Izorkin
Copy link
Contributor Author

Izorkin commented Apr 3, 2020

@GrahamcOfBorg test mariadbGalera

@Izorkin
Copy link
Contributor Author

Izorkin commented Apr 3, 2020

@GrahamcOfBorg test mariadb-galera

@Izorkin Izorkin force-pushed the Izorkin:mariadb-galera-test branch from 80722c8 to 1e0a6c7 Apr 4, 2020
@Izorkin
Copy link
Contributor Author

Izorkin commented Apr 4, 2020

@GrahamcOfBorg test mariadb-galera

@Izorkin
Copy link
Contributor Author

Izorkin commented Apr 4, 2020

@flokli
Copy link
Contributor

flokli commented Apr 4, 2020

@Izorkin Ran the test locally, it seems it's stuck at

galera_03_rsync # [  201.426407] mysqld[893]: 2020-04-04 22:46:55 0 [Note] WSREP: resuming provider at 10
galera_03_rsync # [  201.429545] mysqld[893]: 2020-04-04 22:46:55 0 [Note] WSREP: Provider resumed.
galera_04_rsync # [  142.918417] rsyncd[1436]: name lookup failed for 192.168.2.1: Temporary failure in name resolution
galera_04_rsync # [  142.920801] rsyncd[1436]: connect from UNKNOWN (192.168.2.1)
galera_04_rsync # [  142.924294] rsyncd[1436]: rsync to rsync_sst/ from UNKNOWN (192.168.2.1)
galera_04_rsync # [  142.925897] rsyncd[1436]: receiving file list
galera_04_rsync # [  142.972423] rsyncd[1436]: sent 48 bytes  received 193 bytes  total size 41
galera_03_rsync # [  216.515459] mysqld[893]: 2020-04-04 22:47:10 0 [Note] WSREP: 0.0 (galera_03): State transfer to 1.0 (galera_04) complete.
galera_04_rsync # [  142.978348] mysqld[903]: 2020-04-04 22:47:10 0 [Note] WSREP: 0.0 (galera_03): State transfer to 1.0 (galera_04) complete.
galera_03_rsync # [  216.517765] mysqld[893]: 2020-04-04 22:47:10 0 [Note] WSREP: Shifting DONOR/DESYNCED -> JOINED (TO: 5)
galera_03_rsync # [  216.521805] mysqld[893]: 2020-04-04 22:47:10 0 [Note] WSREP: Member 0.0 (galera_03) synced with group.
galera_03_rsync # [  216.523508] mysqld[893]: 2020-04-04 22:47:10 0 [Note] WSREP: Shifting JOINED -> SYNCED (TO: 5)
galera_04_rsync # [  142.983994] mysqld[903]: 2020-04-04 22:47:10 0 [Note] WSREP: Member 0.0 (galera_03) synced with group.
galera_03_rsync # [  216.525931] mysqld[893]: 2020-04-04 22:47:10 1 [Note] WSREP: Synchronized with group, ready for connections
galera_03_rsync # [  216.527844] mysqld[893]: 2020-04-04 22:47:10 1 [Note] WSREP: wsrep_notify_cmd is not defined, skipping notification.
galera_04_rsync # [  143.125731] mysqld[903]: WSREP_SST: [INFO] Joiner cleanup. rsync PID: 961 (20200404 22:47:10.567)
galera_04_rsync # [  143.528222] rsyncd[961]: sent 0 bytes  received 0 bytes  total size 0
galera_04_rsync # [  143.670738] mysqld[903]: WSREP_SST: [INFO] Joiner cleanup done. (20200404 22:47:11.112)
galera_04_rsync # [  143.678394] mysqld[903]: 2020-04-04 22:47:11 0 [Note] WSREP: SST complete, seqno: 5
galera_04_rsync # [  143.703722] mysqld[903]: 2020-04-04 22:47:11 0 [Note] InnoDB: Using Linux native AIO
galera_04_rsync # [  143.705639] mysqld[903]: 2020-04-04 22:47:11 0 [Note] InnoDB: Mutexes and rw_locks use GCC atomic builtins
galera_04_rsync # [  143.707979] mysqld[903]: 2020-04-04 22:47:11 0 [Note] InnoDB: Uses event mutexes
galera_04_rsync # [  143.709711] mysqld[903]: 2020-04-04 22:47:11 0 [Note] InnoDB: Compressed tables use zlib 1.2.11
galera_04_rsync # [  143.711215] mysqld[903]: 2020-04-04 22:47:11 0 [Note] InnoDB: Number of pools: 1
galera_04_rsync # [  143.712594] mysqld[903]: 2020-04-04 22:47:11 0 [Note] InnoDB: Using SSE2 crc32 instructions
galera_04_rsync # [  143.718026] mysqld[903]: 2020-04-04 22:47:11 0 [Note] InnoDB: Initializing buffer pool, total size = 128M, instances = 1, chunk size = 128M
galera_04_rsync # [  143.721941] mysqld[903]: 2020-04-04 22:47:11 0 [Note] InnoDB: Completed initialization of buffer pool
galera_04_rsync # [  143.724946] mysqld[903]: 2020-04-04 22:47:11 0 [Note] InnoDB: If the mysqld execution user is authorized, page cleaner thread priority can be changed. See the man page of setpriority().
galera_04_rsync # [  143.730072] mysqld[903]: 2020-04-04 22:47:11 0 [Note] InnoDB: Starting crash recovery from checkpoint LSN=1635075
galera_04_rsync # [  143.838651] mysqld[903]: 2020-04-04 22:47:11 0 [Note] InnoDB: 128 out of 128 rollback segments are active.
galera_04_rsync # [  143.841085] mysqld[903]: 2020-04-04 22:47:11 0 [Note] InnoDB: Creating shared tablespace for temporary tables
galera_04_rsync # [  143.844787] mysqld[903]: 2020-04-04 22:47:11 0 [Note] InnoDB: Setting file './ibtmp1' size to 12 MB. Physically writing the file full; Please wait ...
galera_04_rsync # [  143.849868] mysqld[903]: 2020-04-04 22:47:11 0 [Note] InnoDB: File './ibtmp1' size is now 12 MB.
galera_04_rsync # [  143.852109] mysqld[903]: 2020-04-04 22:47:11 0 [Note] InnoDB: Waiting for purge to start
galera_04_rsync # [  143.904178] mysqld[903]: 2020-04-04 22:47:11 0 [Note] InnoDB: 10.3.22 started; log sequence number 1635084; transaction id 33
galera_04_rsync # [  143.907945] mysqld[903]: 2020-04-04 22:47:11 0 [Note] Plugin 'FEEDBACK' is disabled.
galera_03_rsync # [  217.454788] mysqld[893]: 2020-04-04 22:47:11 0 [Note] WSREP: 1.0 (galera_04): State transfer from 0.0 (galera_03) complete.
galera_04_rsync # [  143.914193] mysqld[903]: 2020-04-04 22:47:11 0 [Note] InnoDB: Loading buffer pool(s) from /var/lib/mysql/ib_buffer_pool
galera_03_rsync # [  217.456750] mysqld[893]: 2020-04-04 22:47:11 0 [Note] WSREP: Member 1.0 (galera_04) synced with group.
galera_04_rsync # [  143.919824] mysqld[903]: 2020-04-04 22:47:11 0 [Note] InnoDB: Buffer pool(s) load completed at 200404 22:47:11
galera_04_rsync # [  143.922910] mysqld[903]: 2020-04-04 22:47:11 0 [Note] Server socket created on IP: '0.0.0.0'.
galera_04_rsync # [  143.925181] mysqld[903]: 2020-04-04 22:47:11 0 [Note] WSREP: Signalling provider to continue.
galera_04_rsync # [  143.927311] mysqld[903]: 2020-04-04 22:47:11 0 [Note] WSREP: SST received: c2866648-76c5-11ea-af3c-e751edcdf91b:5
galera_04_rsync # [  143.929547] mysqld[903]: 2020-04-04 22:47:11 0 [Note] WSREP: 1.0 (galera_04): State transfer from 0.0 (galera_03) complete.
galera_04_rsync # [  143.931665] mysqld[903]: 2020-04-04 22:47:11 0 [Note] WSREP: Shifting JOINER -> JOINED (TO: 5)
galera_04_rsync # [  143.933587] mysqld[903]: 2020-04-04 22:47:11 0 [Note] WSREP: Member 1.0 (galera_04) synced with group.
galera_04_rsync # [  143.935348] mysqld[903]: 2020-04-04 22:47:11 0 [Note] WSREP: Shifting JOINED -> SYNCED (TO: 5)
galera_04_rsync # [  143.937376] mysqld[903]: 2020-04-04 22:47:11 1 [Note] WSREP: Synchronized with group, ready for connections
galera_04_rsync # [  143.939631] mysqld[903]: 2020-04-04 22:47:11 1 [Note] WSREP: wsrep_notify_cmd is not defined, skipping notification.
galera_04_rsync # [  143.942303] mysqld[903]: 2020-04-04 22:47:11 0 [Note] Reading of all Master_info entries succeeded
galera_04_rsync # [  143.944319] mysqld[903]: 2020-04-04 22:47:11 0 [Note] Added new Master_info '' to hash table
galera_04_rsync # [  143.946434] mysqld[903]: 2020-04-04 22:47:11 0 [Note] /nix/store/kfiajz1r1cwxf5j9kmx2ma5cm42bf1l1-mariadb-server-10.3.22/bin/mysqld: ready for connections.
galera_04_rsync # [  143.949073] mysqld[903]: Version: '10.3.22-MariaDB'  socket: '/run/mysqld/mysqld.sock'  port: 3306  MariaDB Server
galera_04_rsync # [  143.988935] systemd[1]: Started MySQL Server.
galera_04_rsync # [  143.991279] systemd[1]: Reached target Multi-User System.
galera_04_rsync # [  143.992629] systemd[1]: Startup finished in 5.027s (kernel) + 2min 18.960s (userspace) = 2min 23.988s.

did you run it via nixosTests.mariadb-galera?

Also, I noticed a lot of spam about temporary failure in name resolution, while trying to do a reverse lookup of the internal IPs.

Could this be improved it we add the IPs and names to /etc/hosts, like it's done in nixos/tests/nfs/kerberos.nix?

Also, doing that, we might be able to switch some of the IPs to hostnames.

@Izorkin Izorkin force-pushed the Izorkin:mariadb-galera-test branch from 1e0a6c7 to 67a7e39 Apr 5, 2020
@Izorkin
Copy link
Contributor Author

Izorkin commented Apr 5, 2020

did you run it via nixosTests.mariadb-galera?

Yes, it works for me

Added hostnames.

@Izorkin
Copy link
Contributor Author

Izorkin commented Apr 5, 2020

@GrahamcOfBorg test mariadb-galera

nixos/tests/all-tests.nix Show resolved Hide resolved
nixos/tests/mysql/mariadb-galera.nix Outdated Show resolved Hide resolved
@Izorkin Izorkin force-pushed the Izorkin:mariadb-galera-test branch from 67a7e39 to 551c3b0 Apr 5, 2020
@Izorkin
Copy link
Contributor Author

Izorkin commented Apr 5, 2020

@GrahamcOfBorg test mariadb-galera-mariabackup
@GrahamcOfBorg test mariadb-galera-rsync

@flokli flokli requested review from florianjacob and dasJ Apr 6, 2020
@flokli
Copy link
Contributor

flokli commented Apr 6, 2020

Pinging some more people contributing to mysql for some more feedback.

@Izorkin Izorkin force-pushed the Izorkin:mariadb-galera-test branch from 551c3b0 to 9574b20 May 6, 2020
@Izorkin Izorkin force-pushed the Izorkin:mariadb-galera-test branch from 9574b20 to e080090 May 6, 2020
@Izorkin Izorkin force-pushed the Izorkin:mariadb-galera-test branch from e080090 to 585bbc5 May 6, 2020
@Izorkin
Copy link
Contributor Author

Izorkin commented May 6, 2020

@GrahamcOfBorg test mariadb-galera-mariabackup
@GrahamcOfBorg test mariadb-galera-rsync
@GrahamcOfBorg test mysql
@GrahamcOfBorg test mysql-autobackup
@GrahamcOfBorg test mysql-backup
@GrahamcOfBorg test mysql-replication

@Mic92 Mic92 merged commit c880c7b into NixOS:master May 7, 2020
28 of 29 checks passed
28 of 29 checks passed
mariadb, mariadb.passthru.tests on x86_64-darwin
Details
mariadb, mariadb.passthru.tests on aarch64-linux Failure
Details
mariadb.passthru.tests on x86_64-darwin No attempt
Details
tests.mysql on aarch64-linux Failure
Details
Evaluation Performance Report Evaluator Performance Report
Details
grahamcofborg-eval ^.^!
Details
grahamcofborg-eval-check-meta config.nix: checkMeta = true
Details
grahamcofborg-eval-darwin nix-instantiate --arg nixpkgs { outPath=./.; revCount=999999; shortRev="585bbc5"; rev="585bbc598c1787090fd8e144339dff77d10d02cf"; } ./pkgs/t
Details
grahamcofborg-eval-lib-tests nix-build --arg pkgs import ./. {} ./lib/tests/release.nix
Details
grahamcofborg-eval-nixos nix-instantiate --arg nixpkgs { outPath=./.; revCount=999999; shortRev="585bbc5"; rev="585bbc598c1787090fd8e144339dff77d10d02cf"; } ./nixos/
Details
grahamcofborg-eval-nixos-manual nix-instantiate --arg nixpkgs { outPath=./.; revCount=999999; shortRev="585bbc5"; rev="585bbc598c1787090fd8e144339dff77d10d02cf"; } ./nixos/
Details
grahamcofborg-eval-nixos-options nix-instantiate --arg nixpkgs { outPath=./.; revCount=999999; shortRev="585bbc5"; rev="585bbc598c1787090fd8e144339dff77d10d02cf"; } ./nixos/
Details
grahamcofborg-eval-nixpkgs-manual nix-instantiate --arg nixpkgs { outPath=./.; revCount=999999; shortRev="585bbc5"; rev="585bbc598c1787090fd8e144339dff77d10d02cf"; } ./pkgs/t
Details
grahamcofborg-eval-nixpkgs-tarball nix-instantiate --arg nixpkgs { outPath=./.; revCount=999999; shortRev="585bbc5"; rev="585bbc598c1787090fd8e144339dff77d10d02cf"; } ./pkgs/t
Details
grahamcofborg-eval-nixpkgs-unstable-jobset nix-instantiate --arg nixpkgs { outPath=./.; revCount=999999; shortRev="585bbc5"; rev="585bbc598c1787090fd8e144339dff77d10d02cf"; } ./pkgs/t
Details
grahamcofborg-eval-package-list nix-env -qa --json --file .
Details
grahamcofborg-eval-package-list-no-aliases nix-env -qa --json --file . --arg config { allowAliases = false; }
Details
mariadb, mariadb.passthru.tests on x86_64-linux Success
Details
tests.mariadb-galera-mariabackup on aarch64-linux Success
Details
tests.mariadb-galera-mariabackup on x86_64-linux Success
Details
tests.mariadb-galera-rsync on aarch64-linux Success
Details
tests.mariadb-galera-rsync on x86_64-linux Success
Details
tests.mysql on x86_64-linux Success
Details
tests.mysql-autobackup on aarch64-linux Success
Details
tests.mysql-autobackup on x86_64-linux Success
Details
tests.mysql-backup on aarch64-linux Success
Details
tests.mysql-backup on x86_64-linux Success
Details
tests.mysql-replication on aarch64-linux Success
Details
tests.mysql-replication on x86_64-linux Success
Details
@Izorkin Izorkin deleted the Izorkin:mariadb-galera-test branch May 7, 2020
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Projects
None yet
Linked issues

Successfully merging this pull request may close these issues.

None yet

4 participants
You can’t perform that action at this time.