ytkit

• This is Yoku-san no Tool KIT scripts.

tool overview

tool	works
yt-alter-progress	Observe ALTER TABLE progress
yt-binlog-groupby	Aggregate mysqlbinlog output
yt-bulk-delete	DELETE all rows in the table
yt-collect	Collect SHOW STATUS and more data source
yt-healthcheck	Nagios compatible observe script
yt-print-information	Dump information for diagnostic
yt-repl-topology	Show replication topology by human-readable or JSON
yt-wait-replication	Wait until Seconds_Behind_Source < threshold

yt-alter-progress

• You need to launch this before starting ALTER TABLE, or a progress is not shown (this maybe performance_schema's limitation)
• Display progress InnoDB ALTER TABLE (need >= 5.7.6)

option_name	default	text
--host=value, -h=value	"localhost"	MySQL host
--port=value, -P=value	3306	MySQL port
--user=value, -u=value	(as same as OS user)	MySQL account using for connection and checking (need REPLICATION CLIENT, PROCESSLIST and global SELECT priv)
--password=value, -p=value	""	Password for the user specified by --user
--ask_pass, --ask_password, --askpass	false	Ask --password by prompt
--socket=value, -S=value	(depends on libmysqlclient.so)	Path to mysql.sock (this parameter is used when --host=localhost)
--interval=value, -i=value	10	Sleeping duration for each SELECT
--quiet, --silent, -q, -s	false	No output any messages
--verbose, -v	false	Verbose output mode
--help, --usage	false	print help message
--version, -V	false	Show ytkit version
--timeout=value	1	Seconds before timeout (Set into read_timeout, write_timeout, connect_timeout)
--debug	false	Set debug output

Example

• Values are percentage of work_completed / work_estimated, estimated time calculated by percentage, elapsed time from starting ALTER TABLE, stage information, ALTER TABLE statement .

$ yt-alter-progress -h127.0.0.1 -uroot -p'password' -i 100
..
[ 38.31% ( 1610 sec | 1000 sec) ] stage/innodb/alter table (read PK and internal sort) : OPTIMIZE TABLE t1
[ 61.58% ( 1248 sec | 2000 sec) ] stage/innodb/alter table (merge sort) : OPTIMIZE TABLE t1
[ 100.00% ( 0 sec | 2410 sec) ] stage/innodb/alter table (insert) : OPTIMIZE TABLE t1
[ 100.00% ( 0 sec | 2420 sec) ] stage/innodb/alter table (flush) : OPTIMIZE TABLE t1
[ 100.00% ( 0 sec | 2440 sec) ] stage/innodb/alter table (log apply table) : OPTIMIZE TABLE t1
[ 100.00% ( 0 sec | 2450 sec) ] stage/innodb/alter table (log apply table) : OPTIMIZE TABLE t1
[ 100.00% ( 0 sec | 2460 sec) ] stage/innodb/alter table (log apply table) : OPTIMIZE TABLE t1
[ 100.00% ( 0 sec | 2470 sec) ] stage/innodb/alter table (log apply table) : OPTIMIZE TABLE t1

yt-binlog-groupby

• mysqlbinlog summerize tool.

$ mysqlbinlog -vv /path/to/binlog | yt-binlog-groupby --cell=10m --group-by=time,table
binlog entries between 170720 15:10 and 170817 17:40
170720 15:10    d1.t1   2
170720 15:20    d1.t1   1
170724 14:20    mysqlslap.t1    644
170724 14:50    t1      644
170724 15:40    t1      644
170724 20:00    d1.t1   2
170724 20:00    t2      1
170814 18:20    d1.t1   1

yt-healthcheck

• Healthcheck script for Nagios compatibility interface.

$ yt-healthcheck -h 172.17.0.1 -u user_name -p'password' -P 3306

yt-wait-replication

• Wait for Seconds_Behind_Master < --seconds-behind-master during --timeout secs.

$ yt-wait-replication -h 172.17.0.1 -u user_name -p'password' -P 3306 --seconds-behind-master=5 --timeout=3600

yt-collect

• Getting statistics and write some formats.

$ yt-collect -h 172.17.0.1 -u user_name -p'password' -P 3306 --iteration=60 --interval=60 --table_size-enable=1 --output=sql

yt-repl-topology

• Display topology of Asynchronous replication

  • Search replica and source recursively.

$ yt-repl-topology -h127.0.0.1 -uroot -p'passwd'
Base_source:3306 => Replica1:3306
Base_source:3306 => Replica2:3306
Base_source:3306 => Intermidiate:3306
Circular:3306 => Base_source:3306
Intermidiate:3306 => Cascade_Replica1:3306
Intermidiate:3306 => Cascade_Replica2:3306
Intermidiate:3306 => Cascade_Replica3:3306

Installation

Install by rpm

• Download from Releases page.
  • rpm will be provided only when tag is updated.

$ sudo yum install -y https://github.com/yoku0825/ytkit/releases/download/0.0.10/ytkit-0.0.10-1.noarch.rpm

Install as is

• Clone this repository and setup modules from cpanfile.

$ git clone https://github.com/yoku0825/ytkit.git
$ cd ytkit
$ cpanm --installdeps .
$ sudo make install

Using without installation

• Clone this repository and setup modules from cpanfile, run script under bin directory.

$ git clone https://github.com/yoku0825/ytkit.git
$ cd ytkit
$ cpanm --installdeps .

Install as fatpacked script

• Clone this repository and use make fatinstall

$ git clone https://github.com/yoku0825/ytkit.git
$ cd ytkit
$ make fatpack
$ sudo make fatinstall

License

• GPLv2.