Skip to content
This repository has been archived by the owner on May 9, 2023. It is now read-only.

Add Size, BackupStartTime, BackupCompletionTime columns as part of --tag option #210

Closed
ShahriyarR opened this issue Nov 28, 2017 · 5 comments

Comments

@ShahriyarR
Copy link
Owner

Again RMAN like output:

RMAN> LIST BACKUP SUMMARY;

Oracle 
List of Backups
===============
Key     TY LV S Device Type Completion Time #Pieces #Copies Compressed Tag
------- -- -- - ----------- --------------- ------- ------- ---------- ---
1       B  A  A SBT_TAPE    21-OCT-07       1       1       NO         TAG20071021T094505
2       B  F  A SBT_TAPE    21-OCT-07       1       1       NO         TAG20071021T094513
3       B  A  A SBT_TAPE    21-OCT-07       1       1       NO         TAG20071021T094624
4       B  F  A SBT_TAPE    21-OCT-07       1       1       NO         TAG20071021T094639
5       B  F  A DISK        04-NOV-07       1       1       YES        TAG20071104T195949

From here, --show_tags option can show several useful info, such as:
Size, BackupStartTime, BackupCompletionTime, Encrypted, Compressed

During the process will figure out how to implement those.
Size -> can be added to backup_tags.txt after backup completion
Encrypted -> after backup
Compressed -> after backup
BackupStartTime -> with start(or keep track for both start and end, then calculate total wasted time)

@ShahriyarR
Copy link
Owner Author

For autoxtrabackup tool the backup folder actually created with timestamp which is equal to start time of backup itself.

ShahriyarR added a commit that referenced this issue Nov 29, 2017
@ShahriyarR
Copy link
Owner Author

Added completion time as:

$ autoxtrabackup -v -lf /home/shahriyar.rzaev/XB_TEST/autoxtrabackup_2_4_5_7.log --defaults_file=/home/shahriyar.rzaev/XB_TEST/server_dir/xb_2_4_ps_5_7.conf --show_tags
Backup             	Type	Status	Completion time    	TAG
----------------------------------------------------------------------
2017-11-29_15-39-22	Full	FAILED	2017-11-29_15-39-25	'Full Backup'

@ShahriyarR
Copy link
Owner Author

Added size:

$ autoxtrabackup -v -lf /home/shahriyar.rzaev/XB_TEST/autoxtrabackup_2_4_5_7.log --defaults_file=/home/shahriyar.rzaev/XB_TEST/server_dir/xb_2_4_ps_5_7.conf --show_tags
Backup             	Type	Status	Completion_time    	Size	TAG
----------------------------------------------------------------------------------
2017-11-29_16-27-35	Full	FAILED	2017-11-29_16-27-38	5,0M	'Full Backup'

@ShahriyarR
Copy link
Owner Author

The xtrabackup_info file includes all sort of information about backup:

uuid = fdbe0afc-d5b3-11e7-9b15-002590e9b448
name = 
tool_name = xtrabackup
tool_command = --defaults-file= --user=root --password=... --target-dir=/home/shahriyar.rzaev/XB_TEST/backup_dir/ps_5_7_x_2_4/full/2017-11-30_09-50-55 --backup --socket=/home/shahriyar.rzaev/XB_TEST/server_dir/PS291117-percona-server-5.7.20-18-linux-x86_64-debug/socket.sock --compress=quicklz --compress-chunk-size=65536 --compress-threads=4 --encrypt=AES256 --encrypt-key=... --encrypt-threads=4 --encrypt-chunk-size=65536 --slave-info --no-version-check --core-file --parallel=10 --throttle=40 --check-privileges --keyring-file-data=/home/shahriyar.rzaev/XB_TEST/server_dir/PS291117-percona-server-5.7.20-18-linux-x86_64-debug/mysql-keyring/keyring --stream=xbstream
tool_version = 2.4.8
ibbackup_version = 2.4.8
server_version = 5.7.20-18-debug
start_time = 2017-11-30 09:50:55
end_time = 2017-11-30 09:51:09
lock_time = 0
binlog_pos = 
innodb_from_lsn = 0
innodb_to_lsn = 2573994
partial = N
incremental = N
format = xbstream
compact = N
compressed = compressed
encrypted = Y

@ShahriyarR
Copy link
Owner Author

ShahriyarR commented Nov 30, 2017

I can parse this file but it is somehow impossible when the backup streaming is enabled.
And this requires some code changes as well in backup side.
I am going to separate the task to add compressed/encrypted part of info in another branch where, I will change backup process.

And now this issue can be closed and changes can be merged to release_v1.5.1

ShahriyarR pushed a commit that referenced this issue Nov 30, 2017
* Preliminary fix for issue #210

* Trying to fix --show_tags output

* adjusting the output

* again trying to adjust the output

* nearly done

* Added completion time

* Adding backup size to backup_tags.txt

* Showing tags + size

* Added more padding

* adjusting output

* adjusting output again

* fixing some things

* Fixing the issue with staticmethod
ShahriyarR pushed a commit that referenced this issue Dec 14, 2017
* Bugfix issue195 (#198)

* Preliminary fix for issue #195

* Changed the user name

* Finalizing the feature

* Bugfix issue196 (#200)

* Preliminary fix for issue #196

* Fixing failed sql syntax

* Added sleep() statement

* Increasing sleep()

* Increased sleep to 30 again.

* Changed check uptime

* Added sleep again

* Raised --server-id random range

* changing random server id choice

* Changed values a bit

* Added --no-check-slave-tables for pt-table-checksum

* Finalizing the bug fix

* Bugfix issue199 (#201)

* Passing the xtra_options to copy-back action

* logging the copy-back action output

* Bugfix issue197 (#202)

* Preliminary fix for issue #197

* Added statement to alter table column collation

* Added config file generation for PS 5.5

* fixing build script for PS 5.5

* Renaming basedirs

* added new assert

* fixing basedir passing here

* Logging the failed sql statement

* Fixed alter statement

* Doing some new staff for PS 5.5

* Adding quotes

* Dropping blank users for 5.5 PS as well.

* Adding changes for generating config for PS 5.5

* Added static method for parsing xtrabackup_slave_info

* Finalizing the feature implementation

* Bugfix issue194 (#203)

* Preliminary fix for issue #194

* Added some code to take stream=tar incremental backup

* Fixing tar command to extract to backup folder

* Doing some sanity checks for disabling taking incremental backups with --stream=tar

* Added extracting from tar archive for full backup prepare

* Trying to figure out recent fail

* Preliminary fix for issue #204 (#207)

* Bugfix issue206 (#208)

* Adding general tablespace creation and altering tables

* Fixing failed thing

* Removing table encryption for general tablespace

* Bugfix issue205 (#211)

* Preliminary fix for issue #205

* Fixing sql error

* temporarily disabling the feature

* Finalizing the feature implementation

* Bugfix issue209 (#212)

* Implemented cloning pxbs  from repo for issue #209

* Added few files to build pxb locally

* Changed file permissions

* Finalizing the feature implementation for issue #209

* Trying to fix the issue with PS 5.5 cloning

* Removed unneeded test from prepare_env.bats

* Fixing config generator

* Bugfix issue213 (#214)

* Preliminary fix for issue #213

* adding BIN variable

* Added bats test also

* Bugfix issue210 (#216)

* Preliminary fix for issue #210

* Trying to fix --show_tags output

* adjusting the output

* again trying to adjust the output

* nearly done

* Added completion time

* Adding backup size to backup_tags.txt

* Showing tags + size

* Added more padding

* adjusting output

* adjusting output again

* fixing some things

* Fixing the issue with staticmethod

* Bugfix issue217 (#218)

* Preliminary fix for issue #217

* Fixing the package data to include .sh files

* Added some dependency package installation

* Bugfix issue219 (#221)

* Preliminary fix for issue #219

* Added new for loop

* removing generalt tablespace file outside the datadir each time before backup and after backup actions.

* Making slave2 to remove general tablespace then to copy-back

* creating general tablespace with relative path

* Fixing the simple code issue

* Disabled due to -> https://bugs.launchpad.net/percona-xtrabackup/+bug/1736380

* Bugfix issue220 (#224)

* Preliminary fix for issue #220

* Adding sleep queries to be executed

* fixin max_workers size

* trying to run sleep queries concurrently

* added u+x for file

* Changed to run prior taking the backup

* changed the place of runner for creating sleep queries

* killing select queries immediately

* Adding some new things for tests.

* Trying to spof the reason of the fail

* trying to spot is sqls are run properly

* Do not redirect to /dev/null for now

* added some more options

* changed the position of parallel query run

* increased the value of benchmark

* changed a bit benchmark time

* Added "--ftwrl-wait-timeout=0 " options

* added all kind of options for checking locking

* playing with option values

* Now it should work

* Added --no-backup-locks

* Changed execution a bit

* increasing query size

* Finalizing the feature implementation

* Testing backup lock killing queries

* Trying to enable backup locks

* Added options to PS 5.6 as well

* Finalizing the feature implementation

* Preliminary fix for issue #225 (#226)

* Preliminary fix for issue #229 (#230)

* Bugfix issue222 (#232)

* Preliminary fix for issue #222

* fixing syntax error N1

* Removing the folder prior creating table

* Finalizing the feature implementation for issue #222

* Bugfix issue231 (#234)

* Preliminary fix for issue #231

* Fixing test

* Missed split()

* Preliminary fix for issue #233 (#236)

* Fixed #228 (#237)

* Preliminary fix for issue #223 (#238)

* Preliminary fix for issue #215 (#239)

* Version Bump
Sign up for free to subscribe to this conversation on GitHub. Already have an account? Sign in.
Projects
None yet
Development

No branches or pull requests

1 participant