Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

--rows does not take effect in CSV format #737

Closed
ronylei opened this issue Jun 21, 2022 · 0 comments · Fixed by #740
Closed

--rows does not take effect in CSV format #737

ronylei opened this issue Jun 21, 2022 · 0 comments · Fixed by #740
Labels

Comments

@ronylei
Copy link

ronylei commented Jun 21, 2022

  1. mydumer's version
# mydumper --version
mydumper 0.12.3-3, built against MySQL 5.7.37-40
  1. Data information
mysql> select count(*) from sbtest1;
+----------+
| count(*) |
+----------+
|  5000000 |
+----------+
1 row in set (6.97 sec)

3.start backup

# mydumper -u xxx -h xxx -p xxx --skip-tz-utc --outputdir=/data/csv/ -T test.sbtest1  --no-schemas -v 3 -t 4 --no-locks -r 500000 -F 10 --csv

** (mydumper:1999): WARNING **: 09:30:43.130: We are going to chunk by row and by filesize
** Message: 09:30:43.134: MyDumper backup version: 0.12.3-3
** Message: 09:30:43.172: Server version reported as: 8.0.29
** Message: 09:30:43.176: Connected to a MySQL server

** (mydumper:1999): WARNING **: 09:30:43.187: Executing in no-locks mode, snapshot will not be consistent
** Message: 09:30:43.198: Started dump at: 2022-06-21 09:30:43
** Message: 09:30:43.200: Written master status
** Message: 09:30:43.235: Thread 1 connected using MySQL connection ID 171
** Message: 09:30:43.243: Thread 2 connected using MySQL connection ID 172
** Message: 09:30:43.250: Thread 3 connected using MySQL connection ID 173
** Message: 09:30:43.255: Thread 4 connected using MySQL connection ID 174
** Message: 09:30:43.272: Thread 1 dumping schema create for `test`
** Message: 09:30:43.300: Thread 4 dumping data for `test`.`sbtest1` WHERE (`id` >= 1000001 AND `id` < 2000001) | Remaining jobs: 1
** Message: 09:30:43.300: Thread 1 dumping data for `test`.`sbtest1` WHERE (`id` >= 3000001 AND `id` < 4000001) | Remaining jobs: 1
** Message: 09:30:43.300: Thread 2 dumping data for `test`.`sbtest1` WHERE (`id` >= 2000001 AND `id` < 3000001) | Remaining jobs: -1
** Message: 09:30:43.300: Thread 3 dumping data for `test`.`sbtest1` WHERE `id` IS NULL OR (`id` >= 1 AND `id` < 1000001) | Remaining jobs: -1
** Message: 09:30:43.300: Shutdown jobs enqueued
** Message: 09:30:43.301: Waiting jobs to complete
** Message: 09:30:54.999: Thread 3 dumping data for `test`.`sbtest1` WHERE (`id` >= 4000001 AND `id` < 5000001) | Remaining jobs: 4
** Message: 09:30:56.862: Thread 4 shutting down
** Message: 09:30:57.418: Thread 1 shutting down
** Message: 09:30:57.525: Thread 2 shutting down
** Message: 09:31:05.394: Thread 3 shutting down
** Message: 09:31:05.394: Main connection closed
** Message: 09:31:05.395: Finished dump at: 2022-06-21 09:31:05

4.Check the backup information and find that the sql file information is consistent, and the CSV file is not split

# ls -lh
total 953M
-rw-r--r-- 1 root root  230 Jun 21 10:02 metadata
-rw-r--r-- 1 root root 953M Jun 21 10:02 test.sbtest1.00000.dat
-rw-r--r-- 1 root root  261 Jun 21 10:01 test.sbtest1.00000.sql
-rw-r--r-- 1 root root  261 Jun 21 10:01 test.sbtest1.00001.sql
-rw-r--r-- 1 root root  261 Jun 21 10:01 test.sbtest1.00002.sql
-rw-r--r-- 1 root root  261 Jun 21 10:01 test.sbtest1.00003.sql
-rw-r--r-- 1 root root  261 Jun 21 10:01 test.sbtest1.00004.sql
-rw-r--r-- 1 root root  146 Jun 21 10:01 test-schema-create.sql

# cat test.sbtest1.00000.sql
/*!40101 SET NAMES binary*/;
/*!40014 SET FOREIGN_KEY_CHECKS=0*/;
LOAD DATA LOCAL INFILE 'test.sbtest1.00000.dat' REPLACE INTO TABLE `sbtest1` FIELDS TERMINATED BY ',' ENCLOSED BY '"' ESCAPED BY '\\' LINES STARTING BY '' TERMINATED BY '
' (`id`,`k`,`c`,`pad`);

# cat test.sbtest1.00001.sql
/*!40101 SET NAMES binary*/;
/*!40014 SET FOREIGN_KEY_CHECKS=0*/;
LOAD DATA LOCAL INFILE 'test.sbtest1.00000.dat' REPLACE INTO TABLE `sbtest1` FIELDS TERMINATED BY ',' ENCLOSED BY '"' ESCAPED BY '\\' LINES STARTING BY '' TERMINATED BY '
' (`id`,`k`,`c`,`pad`);
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
Projects
None yet
Development

Successfully merging a pull request may close this issue.

2 participants