Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

Sign up for GitHub

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Jump to bottom

blocked for more than 120 seconds on 0.6.5.2 in KVM VM #3955

Closed
poiuty opened this issue Oct 26, 2015 · 4 comments
Closed

blocked for more than 120 seconds on 0.6.5.2 in KVM VM #3955

poiuty opened this issue Oct 26, 2015 · 4 comments

Comments

@poiuty
Copy link

poiuty commented Oct 26, 2015

Debian 8, 3.16.0-4-amd64, qemu-kvm, zfs v0.6.5.2-2, VM in zvol with lz4
VM use ext4 and lvm for increase disk space (if it need).
This two VM have very low disk IO and CPU/ RAM use.
All this logs from VMs. And I dont find any bad logs in host node.

Fist VM get freeze mysqld. Whit this log in /var/log/messages

Oct 20 15:52:27 debian kernel: [13800.260468] jbd2/dm-0-8     D ffff88007a734040     0   161      2 0x00000000
Oct 20 15:52:27 debian kernel: [13800.260471]  ffff88007a734040 0000000000000046 00000000003d8d76 ffff88007a77e880
Oct 20 15:52:27 debian kernel: [13800.260473]  00000000000127c0 ffff8800372b7fd8 ffff8800372b7fd8 ffff88007a734040
Oct 20 15:52:27 debian kernel: [13800.260474]  ffff8800372b6000 ffffffff81066439 ffff88007d333910 ffff88007fc13010
Oct 20 15:52:27 debian kernel: [13800.260476] Call Trace:
Oct 20 15:52:27 debian kernel: [13800.260481]  [<ffffffff81066439>] ? timekeeping_get_ns+0xd/0x2a
Oct 20 15:52:27 debian kernel: [13800.260485]  [<ffffffff8111e309>] ? wait_on_buffer+0x28/0x28
Oct 20 15:52:27 debian kernel: [13800.260488]  [<ffffffff8134fff1>] ? io_schedule+0x59/0x71
Oct 20 15:52:27 debian kernel: [13800.260489]  [<ffffffff8111e30f>] ? sleep_on_buffer+0x6/0xa
Oct 20 15:52:27 debian kernel: [13800.260491]  [<ffffffff81350434>] ? __wait_on_bit+0x3e/0x71
Oct 20 15:52:27 debian kernel: [13800.260492]  [<ffffffff813504d6>] ? out_of_line_wait_on_bit+0x6f/0x78
Oct 20 15:52:27 debian kernel: [13800.260494]  [<ffffffff8111e309>] ? wait_on_buffer+0x28/0x28
Oct 20 15:52:27 debian kernel: [13800.260497]  [<ffffffff8105fea5>] ? autoremove_wake_function+0x2a/0x2a
Oct 20 15:52:27 debian kernel: [13800.260504]  [<ffffffffa00f18a3>] ? jbd2_journal_commit_transaction+0xa32/0x10bf [jbd2]
Oct 20 15:52:27 debian kernel: [13800.260507]  [<ffffffff8100d02f>] ? load_TLS+0x7/0xa
Oct 20 15:52:27 debian kernel: [13800.260509]  [<ffffffff8100d66c>] ? __switch_to+0x101/0x265
Oct 20 15:52:27 debian kernel: [13800.260512]  [<ffffffffa00f5166>] ? kjournald2+0xc0/0x20a [jbd2]
Oct 20 15:52:27 debian kernel: [13800.260514]  [<ffffffff8105fe7b>] ? add_wait_queue+0x3c/0x3c
Oct 20 15:52:27 debian kernel: [13800.260516]  [<ffffffffa00f50a6>] ? commit_timeout+0x5/0x5 [jbd2]
Oct 20 15:52:27 debian kernel: [13800.260518]  [<ffffffff8105f829>] ? kthread+0x76/0x7e
Oct 20 15:52:27 debian kernel: [13800.260521]  [<ffffffff813582f4>] ? kernel_thread_helper+0x4/0x10
Oct 20 15:52:27 debian kernel: [13800.260523]  [<ffffffff8105f7b3>] ? kthread_worker_fn+0x139/0x139
Oct 20 15:52:27 debian kernel: [13800.260524]  [<ffffffff813582f0>] ? gs_change+0x13/0x13
Oct 20 15:52:27 debian kernel: [13800.260695] rs:main Q:Reg   D ffff8800371a1780     0  1847      1 0x00000000
Oct 20 15:52:27 debian kernel: [13800.260697]  ffff8800371a1780 0000000000000086 00000000003dce4e ffff88007ab41080
Oct 20 15:52:27 debian kernel: [13800.260698]  00000000000127c0 ffff880037479fd8 ffff880037479fd8 ffff8800371a1780
Oct 20 15:52:27 debian kernel: [13800.260700]  ffff880037479908 ffff880037479908 ffff8800377e96e0 ffff88007fc13010
Oct 20 15:52:27 debian kernel: [13800.260701] Call Trace:
Oct 20 15:52:27 debian kernel: [13800.260703]  [<ffffffff8111e309>] ? wait_on_buffer+0x28/0x28
Oct 20 15:52:27 debian kernel: [13800.260704]  [<ffffffff8134fff1>] ? io_schedule+0x59/0x71
Oct 20 15:52:27 debian kernel: [13800.260706]  [<ffffffff8111e30f>] ? sleep_on_buffer+0x6/0xa
Oct 20 15:52:27 debian kernel: [13800.260707]  [<ffffffff81350335>] ? __wait_on_bit_lock+0x3c/0x85
Oct 20 15:52:27 debian kernel: [13800.260709]  [<ffffffff813503ed>] ? out_of_line_wait_on_bit_lock+0x6f/0x78
Oct 20 15:52:27 debian kernel: [13800.260710]  [<ffffffff8111e309>] ? wait_on_buffer+0x28/0x28
Oct 20 15:52:27 debian kernel: [13800.260712]  [<ffffffff8105fea5>] ? autoremove_wake_function+0x2a/0x2a
Oct 20 15:52:27 debian kernel: [13800.260715]  [<ffffffffa00f0521>] ? do_get_write_access+0x5c/0x36a [jbd2]
Oct 20 15:52:27 debian kernel: [13800.260716]  [<ffffffff8111ec23>] ? __getblk+0x24/0x238
Oct 20 15:52:27 debian kernel: [13800.260722]  [<ffffffffa010963b>] ? ext4_dirty_inode+0x2a/0x45 [ext4]
Oct 20 15:52:27 debian kernel: [13800.260724]  [<ffffffffa00f0923>] ? jbd2_journal_get_write_access+0x21/0x38 [jbd2]
Oct 20 15:52:27 debian kernel: [13800.260730]  [<ffffffffa012939b>] ? __ext4_journal_get_write_access+0x4f/0x5e [ext4]
Oct 20 15:52:27 debian kernel: [13800.260734]  [<ffffffffa0107bee>] ? ext4_reserve_inode_write+0x37/0x7a [ext4]
Oct 20 15:52:27 debian kernel: [13800.260737]  [<ffffffff8102bb5c>] ? pvclock_clocksource_read+0x42/0xb2
Oct 20 15:52:27 debian kernel: [13800.260740]  [<ffffffffa0107c99>] ? ext4_mark_inode_dirty+0x68/0x1da [ext4]
Oct 20 15:52:27 debian kernel: [13800.260743]  [<ffffffffa0109625>] ? ext4_dirty_inode+0x14/0x45 [ext4]
Oct 20 15:52:27 debian kernel: [13800.260748]  [<ffffffffa011e791>] ? ext4_journal_start_sb+0x139/0x14f [ext4]
Oct 20 15:52:27 debian kernel: [13800.260751]  [<ffffffffa010963b>] ? ext4_dirty_inode+0x2a/0x45 [ext4]
Oct 20 15:52:27 debian kernel: [13800.260754]  [<ffffffffa0109611>] ? ext4_evict_inode+0x2a6/0x2a6 [ext4]
Oct 20 15:52:27 debian kernel: [13800.260757]  [<ffffffff8111811f>] ? __mark_inode_dirty+0x22/0x17a
Oct 20 15:52:27 debian kernel: [13800.260759]  [<ffffffff8110d6f9>] ? file_update_time+0xda/0x105
Oct 20 15:52:27 debian kernel: [13800.260763]  [<ffffffff810b6554>] ? __generic_file_aio_write+0x160/0x278
Oct 20 15:52:27 debian kernel: [13800.260765]  [<ffffffff8106d776>] ? futex_wait_queue_me+0xba/0xd5
Oct 20 15:52:27 debian kernel: [13800.260767]  [<ffffffff8103665c>] ? should_resched+0x5/0x23
Oct 20 15:52:27 debian kernel: [13800.260769]  [<ffffffff810b66c9>] ? generic_file_aio_write+0x5d/0xb5
Oct 20 15:52:27 debian kernel: [13800.260772]  [<ffffffffa0101bd4>] ? ext4_file_write+0x1e1/0x235 [ext4]
Oct 20 15:52:27 debian kernel: [13800.260773]  [<ffffffff8106e5a7>] ? futex_wake+0xe9/0xfb
Oct 20 15:52:27 debian kernel: [13800.260776]  [<ffffffff810fae8c>] ? do_sync_write+0xb4/0xec
Oct 20 15:52:27 debian kernel: [13800.260777]  [<ffffffff8106f6ce>] ? do_futex+0xd7/0x80c
Oct 20 15:52:27 debian kernel: [13800.260779]  [<ffffffff8102bb5c>] ? pvclock_clocksource_read+0x42/0xb2
Oct 20 15:52:27 debian kernel: [13800.260781]  [<ffffffff811656f5>] ? security_file_permission+0x16/0x2d
Oct 20 15:52:27 debian kernel: [13800.260782]  [<ffffffff810fb57d>] ? vfs_write+0xa2/0xe9
Oct 20 15:52:27 debian kernel: [13800.260784]  [<ffffffff810fb75a>] ? sys_write+0x45/0x6b
Oct 20 15:52:27 debian kernel: [13800.260785]  [<ffffffff813561b2>] ? system_call_fastpath+0x16/0x1b
Oct 20 15:52:27 debian kernel: [13800.260951] mysqld          D ffff88007fc127c0     0  2373   2041 0x00000000
Oct 20 15:52:27 debian kernel: [13800.260953]  ffff88007c1fe880 0000000000000082 ffff88007b26de78 ffff88007a734040
Oct 20 15:52:27 debian kernel: [13800.260954]  00000000000127c0 ffff88007b26dfd8 ffff88007b26dfd8 ffff88007c1fe880
Oct 20 15:52:27 debian kernel: [13800.260956]  0000000000000246 ffffffff81351129 ffff880036c3a898 ffff880036c3a800
Oct 20 15:52:27 debian kernel: [13800.260957] Call Trace:
Oct 20 15:52:27 debian kernel: [13800.260959]  [<ffffffff81351129>] ? _raw_spin_lock_irqsave+0x9/0x25
Oct 20 15:52:27 debian kernel: [13800.260962]  [<ffffffffa00f504b>] ? jbd2_log_wait_commit+0xc0/0x116 [jbd2]
Oct 20 15:52:27 debian kernel: [13800.260964]  [<ffffffff8105fe7b>] ? add_wait_queue+0x3c/0x3c
Oct 20 15:52:27 debian kernel: [13800.260967]  [<ffffffffa0101fff>] ? ext4_sync_file+0x2e2/0x34b [ext4]
Oct 20 15:52:27 debian kernel: [13800.260969]  [<ffffffff8111cca7>] ? sys_fsync+0x20/0x31
Oct 20 15:52:27 debian kernel: [13800.260970]  [<ffffffff813561b2>] ? system_call_fastpath+0x16/0x1b
Oct 20 15:52:27 debian kernel: [13800.261133] mysqld          D ffff88007a8ba740     0  3530   2041 0x00000000
Oct 20 15:52:27 debian kernel: [13800.261135]  ffff88007a8ba740 0000000000000082 00000000003d998e ffff88007a77e180
Oct 20 15:52:27 debian kernel: [13800.261136]  00000000000127c0 ffff88007b0f3fd8 ffff88007b0f3fd8 ffff88007a8ba740
Oct 20 15:52:27 debian kernel: [13800.261138]  ffff88007b0f39b8 ffff88007b0f39b8 ffff88007a743210 ffff88007fc13010
Oct 20 15:52:27 debian kernel: [13800.261139] Call Trace:
Oct 20 15:52:27 debian kernel: [13800.261141]  [<ffffffff810b536f>] ? lock_page+0x20/0x20
Oct 20 15:52:27 debian kernel: [13800.261142]  [<ffffffff8134fff1>] ? io_schedule+0x59/0x71
Oct 20 15:52:27 debian kernel: [13800.261144]  [<ffffffff810b5375>] ? sleep_on_page+0x6/0xa
Oct 20 15:52:27 debian kernel: [13800.261145]  [<ffffffff81350434>] ? __wait_on_bit+0x3e/0x71
Oct 20 15:52:27 debian kernel: [13800.261147]  [<ffffffff810b54b1>] ? wait_on_page_bit+0x6e/0x73
Oct 20 15:52:27 debian kernel: [13800.261148]  [<ffffffff8103665c>] ? should_resched+0x5/0x23
Oct 20 15:52:27 debian kernel: [13800.261150]  [<ffffffff8105fea5>] ? autoremove_wake_function+0x2a/0x2a
Oct 20 15:52:27 debian kernel: [13800.261152]  [<ffffffff810b5d2e>] ? grab_cache_page_write_begin+0x9c/0xae
Oct 20 15:52:27 debian kernel: [13800.261156]  [<ffffffffa0106982>] ? ext4_da_write_begin+0x11a/0x1e0 [ext4]
Oct 20 15:52:27 debian kernel: [13800.261159]  [<ffffffffa010883c>] ? ext4_da_write_end+0x1f1/0x232 [ext4]
Oct 20 15:52:27 debian kernel: [13800.261161]  [<ffffffff810b57ff>] ? generic_file_buffered_write+0x10f/0x259
Oct 20 15:52:27 debian kernel: [13800.261163]  [<ffffffff810b663c>] ? __generic_file_aio_write+0x248/0x278
Oct 20 15:52:27 debian kernel: [13800.261166]  [<ffffffff8104b3d8>] ? current_fs_time+0x31/0x37
Oct 20 15:52:27 debian kernel: [13800.261167]  [<ffffffff8103665c>] ? should_resched+0x5/0x23
Oct 20 15:52:27 debian kernel: [13800.261169]  [<ffffffff810b66c9>] ? generic_file_aio_write+0x5d/0xb5
Oct 20 15:52:27 debian kernel: [13800.261171]  [<ffffffffa0101bd4>] ? ext4_file_write+0x1e1/0x235 [ext4]
Oct 20 15:52:27 debian kernel: [13800.261173]  [<ffffffff810fae8c>] ? do_sync_write+0xb4/0xec
Oct 20 15:52:27 debian kernel: [13800.261174]  [<ffffffff8106f707>] ? do_futex+0x110/0x80c
Oct 20 15:52:27 debian kernel: [13800.261176]  [<ffffffff811656f5>] ? security_file_permission+0x16/0x2d
Oct 20 15:52:27 debian kernel: [13800.261177]  [<ffffffff810fb57d>] ? vfs_write+0xa2/0xe9
Oct 20 15:52:27 debian kernel: [13800.261179]  [<ffffffff810fb841>] ? sys_pwrite64+0x53/0x6e
Oct 20 15:52:27 debian kernel: [13800.261180]  [<ffffffff813561b2>] ? system_call_fastpath+0x16/0x1b
Oct 20 15:52:27 debian kernel: [13800.261342] mysqld          D ffff88007b23d7c0     0  3536   2041 0x00000000
Oct 20 15:52:27 debian kernel: [13800.261343]  ffff88007b23d7c0 0000000000000082 ffff880036c3a800 ffff88007a77e180
Oct 20 15:52:27 debian kernel: [13800.261345]  00000000000127c0 ffff880037523fd8 ffff880037523fd8 ffff88007b23d7c0
Oct 20 15:52:27 debian kernel: [13800.261346]  0000000000000246 ffffffff81351129 ffff88007ffb6c48 ffff880052f975f8
Oct 20 15:52:27 debian kernel: [13800.261347] Call Trace:
Oct 20 15:52:27 debian kernel: [13800.261349]  [<ffffffff81351129>] ? _raw_spin_lock_irqsave+0x9/0x25
Oct 20 15:52:27 debian kernel: [13800.261351]  [<ffffffffa00f0672>] ? do_get_write_access+0x1ad/0x36a [jbd2]
Oct 20 15:52:27 debian kernel: [13800.261353]  [<ffffffff8105fea5>] ? autoremove_wake_function+0x2a/0x2a
Oct 20 15:52:27 debian kernel: [13800.261356]  [<ffffffffa010963b>] ? ext4_dirty_inode+0x2a/0x45 [ext4]
Oct 20 15:52:27 debian kernel: [13800.261358]  [<ffffffffa00f0923>] ? jbd2_journal_get_write_access+0x21/0x38 [jbd2]
Oct 20 15:52:27 debian kernel: [13800.261363]  [<ffffffffa012939b>] ? __ext4_journal_get_write_access+0x4f/0x5e [ext4]
Oct 20 15:52:27 debian kernel: [13800.261366]  [<ffffffffa0107bee>] ? ext4_reserve_inode_write+0x37/0x7a [ext4]
Oct 20 15:52:27 debian kernel: [13800.261368]  [<ffffffff8102bb5c>] ? pvclock_clocksource_read+0x42/0xb2
Oct 20 15:52:27 debian kernel: [13800.261371]  [<ffffffffa0107c99>] ? ext4_mark_inode_dirty+0x68/0x1da [ext4]
Oct 20 15:52:27 debian kernel: [13800.261374]  [<ffffffffa0109625>] ? ext4_dirty_inode+0x14/0x45 [ext4]
Oct 20 15:52:27 debian kernel: [13800.261377]  [<ffffffffa011e791>] ? ext4_journal_start_sb+0x139/0x14f [ext4]
Oct 20 15:52:27 debian kernel: [13800.261379]  [<ffffffff8100d025>] ? paravirt_write_msr+0xb/0xe
Oct 20 15:52:27 debian kernel: [13800.261382]  [<ffffffffa010963b>] ? ext4_dirty_inode+0x2a/0x45 [ext4]
Oct 20 15:52:27 debian kernel: [13800.261385]  [<ffffffffa0109611>] ? ext4_evict_inode+0x2a6/0x2a6 [ext4]
Oct 20 15:52:27 debian kernel: [13800.261387]  [<ffffffff8111811f>] ? __mark_inode_dirty+0x22/0x17a
Oct 20 15:52:27 debian kernel: [13800.261389]  [<ffffffff8110d6f9>] ? file_update_time+0xda/0x105
Oct 20 15:52:27 debian kernel: [13800.261391]  [<ffffffff810b6554>] ? __generic_file_aio_write+0x160/0x278
Oct 20 15:52:27 debian kernel: [13800.261392]  [<ffffffff81351167>] ? _raw_spin_unlock_irqrestore+0xe/0xf
Oct 20 15:52:27 debian kernel: [13800.261394]  [<ffffffff81062923>] ? hrtimer_try_to_cancel+0x7d/0x89
Oct 20 15:52:27 debian kernel: [13800.261395]  [<ffffffff8106293b>] ? hrtimer_cancel+0xc/0x16
Oct 20 15:52:27 debian kernel: [13800.261397]  [<ffffffff8103665c>] ? should_resched+0x5/0x23
Oct 20 15:52:27 debian kernel: [13800.261398]  [<ffffffff810b66c9>] ? generic_file_aio_write+0x5d/0xb5
Oct 20 15:52:27 debian kernel: [13800.261401]  [<ffffffffa0101bd4>] ? ext4_file_write+0x1e1/0x235 [ext4]
Oct 20 15:52:27 debian kernel: [13800.261403]  [<ffffffff8106e5a7>] ? futex_wake+0xe9/0xfb
Oct 20 15:52:27 debian kernel: [13800.261405]  [<ffffffff810fae8c>] ? do_sync_write+0xb4/0xec
Oct 20 15:52:27 debian kernel: [13800.261406]  [<ffffffff8106f6ce>] ? do_futex+0xd7/0x80c
Oct 20 15:52:27 debian kernel: [13800.261408]  [<ffffffff8102bb5c>] ? pvclock_clocksource_read+0x42/0xb2
Oct 20 15:52:27 debian kernel: [13800.261409]  [<ffffffff811656f5>] ? security_file_permission+0x16/0x2d
Oct 20 15:52:27 debian kernel: [13800.261410]  [<ffffffff810fb57d>] ? vfs_write+0xa2/0xe9
Oct 20 15:52:27 debian kernel: [13800.261412]  [<ffffffff810fb75a>] ? sys_write+0x45/0x6b
Oct 20 15:52:27 debian kernel: [13800.261413]  [<ffffffff813561b2>] ? system_call_fastpath+0x16/0x1b
Oct 20 15:52:27 debian kernel: [13800.261576] mysqld          D ffff88003710c880     0  4036   2041 0x00000000
Oct 20 15:52:27 debian kernel: [13800.261577]  ffff88003710c880 0000000000000082 ffff880036c3a800 ffff8800375c07c0
Oct 20 15:52:27 debian kernel: [13800.261579]  00000000000127c0 ffff8800373b9fd8 ffff8800373b9fd8 ffff88003710c880
Oct 20 15:52:27 debian kernel: [13800.261580]  0000000000000246 ffffffff81351129 ffff88007ffc1448 ffff88004a171cf8
Oct 20 15:52:27 debian kernel: [13800.261582] Call Trace:
Oct 20 15:52:27 debian kernel: [13800.261583]  [<ffffffff81351129>] ? _raw_spin_lock_irqsave+0x9/0x25
Oct 20 15:52:27 debian kernel: [13800.261586]  [<ffffffffa00f0672>] ? do_get_write_access+0x1ad/0x36a [jbd2]
Oct 20 15:52:27 debian kernel: [13800.261588]  [<ffffffff8105fea5>] ? autoremove_wake_function+0x2a/0x2a
Oct 20 15:52:27 debian kernel: [13800.261592]  [<ffffffffa010963b>] ? ext4_dirty_inode+0x2a/0x45 [ext4]
Oct 20 15:52:27 debian kernel: [13800.261595]  [<ffffffffa00f0923>] ? jbd2_journal_get_write_access+0x21/0x38 [jbd2]
Oct 20 15:52:27 debian kernel: [13800.261599]  [<ffffffffa012939b>] ? __ext4_journal_get_write_access+0x4f/0x5e [ext4]
Oct 20 15:52:27 debian kernel: [13800.261603]  [<ffffffffa0107bee>] ? ext4_reserve_inode_write+0x37/0x7a [ext4]
Oct 20 15:52:27 debian kernel: [13800.261605]  [<ffffffff8102bb5c>] ? pvclock_clocksource_read+0x42/0xb2
Oct 20 15:52:27 debian kernel: [13800.261609]  [<ffffffffa0107c99>] ? ext4_mark_inode_dirty+0x68/0x1da [ext4]
Oct 20 15:52:27 debian kernel: [13800.261612]  [<ffffffffa0109625>] ? ext4_dirty_inode+0x14/0x45 [ext4]
Oct 20 15:52:27 debian kernel: [13800.261617]  [<ffffffffa011e791>] ? ext4_journal_start_sb+0x139/0x14f [ext4]
Oct 20 15:52:27 debian kernel: [13800.261619]  [<ffffffff8100d025>] ? paravirt_write_msr+0xb/0xe
Oct 20 15:52:27 debian kernel: [13800.261623]  [<ffffffffa010963b>] ? ext4_dirty_inode+0x2a/0x45 [ext4]
Oct 20 15:52:27 debian kernel: [13800.261626]  [<ffffffffa0109611>] ? ext4_evict_inode+0x2a6/0x2a6 [ext4]
Oct 20 15:52:27 debian kernel: [13800.261628]  [<ffffffff8111811f>] ? __mark_inode_dirty+0x22/0x17a
Oct 20 15:52:27 debian kernel: [13800.261630]  [<ffffffff8110d6f9>] ? file_update_time+0xda/0x105
Oct 20 15:52:27 debian kernel: [13800.261632]  [<ffffffff810b6554>] ? __generic_file_aio_write+0x160/0x278
Oct 20 15:52:27 debian kernel: [13800.261634]  [<ffffffff81351167>] ? _raw_spin_unlock_irqrestore+0xe/0xf
Oct 20 15:52:27 debian kernel: [13800.261636]  [<ffffffff81062923>] ? hrtimer_try_to_cancel+0x7d/0x89
Oct 20 15:52:27 debian kernel: [13800.261637]  [<ffffffff8106293b>] ? hrtimer_cancel+0xc/0x16
Oct 20 15:52:27 debian kernel: [13800.261639]  [<ffffffff8103665c>] ? should_resched+0x5/0x23
Oct 20 15:52:27 debian kernel: [13800.261641]  [<ffffffff810b66c9>] ? generic_file_aio_write+0x5d/0xb5
Oct 20 15:52:27 debian kernel: [13800.261644]  [<ffffffffa0101bd4>] ? ext4_file_write+0x1e1/0x235 [ext4]
Oct 20 15:52:27 debian kernel: [13800.261646]  [<ffffffff8106e5a7>] ? futex_wake+0xe9/0xfb
Oct 20 15:52:27 debian kernel: [13800.261648]  [<ffffffff810fae8c>] ? do_sync_write+0xb4/0xec
Oct 20 15:52:27 debian kernel: [13800.261649]  [<ffffffff8106f6ce>] ? do_futex+0xd7/0x80c
Oct 20 15:52:27 debian kernel: [13800.261651]  [<ffffffff8102bb5c>] ? pvclock_clocksource_read+0x42/0xb2
Oct 20 15:52:27 debian kernel: [13800.261652]  [<ffffffff811656f5>] ? security_file_permission+0x16/0x2d
Oct 20 15:52:27 debian kernel: [13800.261654]  [<ffffffff810fb57d>] ? vfs_write+0xa2/0xe9
Oct 20 15:52:27 debian kernel: [13800.261656]  [<ffffffff810fb75a>] ? sys_write+0x45/0x6b
Oct 20 15:52:27 debian kernel: [13800.261657]  [<ffffffff813561b2>] ? system_call_fastpath+0x16/0x1b
Oct 20 15:52:27 debian kernel: [13800.261905] mysqld          D ffff880037585800     0  4292   2041 0x00000000
Oct 20 15:52:27 debian kernel: [13800.261907]  ffff880037585800 0000000000000082 ffff880036c3a800 ffff88007a77e180
Oct 20 15:52:27 debian kernel: [13800.261909]  00000000000127c0 ffff88007c6dffd8 ffff88007c6dffd8 ffff880037585800
Oct 20 15:52:27 debian kernel: [13800.261910]  0000000000000246 ffffffff81351129 ffff88007ffb6c48 ffff880052f975f8
Oct 20 15:52:27 debian kernel: [13800.261912] Call Trace:
Oct 20 15:52:27 debian kernel: [13800.261914]  [<ffffffff81351129>] ? _raw_spin_lock_irqsave+0x9/0x25
Oct 20 15:52:27 debian kernel: [13800.261917]  [<ffffffffa00f0672>] ? do_get_write_access+0x1ad/0x36a [jbd2]
Oct 20 15:52:27 debian kernel: [13800.261919]  [<ffffffff8105fea5>] ? autoremove_wake_function+0x2a/0x2a
Oct 20 15:52:27 debian kernel: [13800.261923]  [<ffffffffa010963b>] ? ext4_dirty_inode+0x2a/0x45 [ext4]
Oct 20 15:52:27 debian kernel: [13800.261925]  [<ffffffffa00f0923>] ? jbd2_journal_get_write_access+0x21/0x38 [jbd2]
Oct 20 15:52:27 debian kernel: [13800.261930]  [<ffffffffa012939b>] ? __ext4_journal_get_write_access+0x4f/0x5e [ext4]
Oct 20 15:52:27 debian kernel: [13800.261934]  [<ffffffffa0107bee>] ? ext4_reserve_inode_write+0x37/0x7a [ext4]
Oct 20 15:52:27 debian kernel: [13800.261935]  [<ffffffff8102bb5c>] ? pvclock_clocksource_read+0x42/0xb2
Oct 20 15:52:27 debian kernel: [13800.261939]  [<ffffffffa0107c99>] ? ext4_mark_inode_dirty+0x68/0x1da [ext4]
Oct 20 15:52:27 debian kernel: [13800.261943]  [<ffffffffa0109625>] ? ext4_dirty_inode+0x14/0x45 [ext4]
Oct 20 15:52:27 debian kernel: [13800.261947]  [<ffffffffa011e791>] ? ext4_journal_start_sb+0x139/0x14f [ext4]
Oct 20 15:52:27 debian kernel: [13800.261951]  [<ffffffffa010963b>] ? ext4_dirty_inode+0x2a/0x45 [ext4]
Oct 20 15:52:27 debian kernel: [13800.261955]  [<ffffffffa0109611>] ? ext4_evict_inode+0x2a6/0x2a6 [ext4]
Oct 20 15:52:27 debian kernel: [13800.261957]  [<ffffffff8111811f>] ? __mark_inode_dirty+0x22/0x17a
Oct 20 15:52:27 debian kernel: [13800.261958]  [<ffffffff8110d6f9>] ? file_update_time+0xda/0x105
Oct 20 15:52:27 debian kernel: [13800.261960]  [<ffffffff810b6554>] ? __generic_file_aio_write+0x160/0x278
Oct 20 15:52:27 debian kernel: [13800.261962]  [<ffffffff81351167>] ? _raw_spin_unlock_irqrestore+0xe/0xf
Oct 20 15:52:27 debian kernel: [13800.261964]  [<ffffffff81062923>] ? hrtimer_try_to_cancel+0x7d/0x89
Oct 20 15:52:27 debian kernel: [13800.261965]  [<ffffffff8106293b>] ? hrtimer_cancel+0xc/0x16
Oct 20 15:52:27 debian kernel: [13800.261967]  [<ffffffff8103665c>] ? should_resched+0x5/0x23
Oct 20 15:52:27 debian kernel: [13800.261969]  [<ffffffff810b66c9>] ? generic_file_aio_write+0x5d/0xb5
Oct 20 15:52:27 debian kernel: [13800.261972]  [<ffffffffa0101bd4>] ? ext4_file_write+0x1e1/0x235 [ext4]
Oct 20 15:52:27 debian kernel: [13800.261974]  [<ffffffff8106e5a7>] ? futex_wake+0xe9/0xfb
Oct 20 15:52:27 debian kernel: [13800.261976]  [<ffffffff810fae8c>] ? do_sync_write+0xb4/0xec
Oct 20 15:52:27 debian kernel: [13800.261977]  [<ffffffff8106f6ce>] ? do_futex+0xd7/0x80c
Oct 20 15:52:27 debian kernel: [13800.261979]  [<ffffffff8102bb5c>] ? pvclock_clocksource_read+0x42/0xb2
Oct 20 15:52:27 debian kernel: [13800.261980]  [<ffffffff811656f5>] ? security_file_permission+0x16/0x2d
Oct 20 15:52:27 debian kernel: [13800.261982]  [<ffffffff810fb57d>] ? vfs_write+0xa2/0xe9
Oct 20 15:52:27 debian kernel: [13800.261983]  [<ffffffff810fb75a>] ? sys_write+0x45/0x6b
Oct 20 15:52:27 debian kernel: [13800.261985]  [<ffffffff813561b2>] ? system_call_fastpath+0x16/0x1b
Oct 20 15:52:27 debian kernel: [13800.262399] flush-253:0     D ffff88007fc127c0     0  2751      2 0x00000000
Oct 20 15:52:27 debian kernel: [13800.262401]  ffff88007a828880 0000000000000046 0000000000000000 ffffffff8160d020
Oct 20 15:52:27 debian kernel: [13800.262403]  00000000000127c0 ffff88007b21dfd8 ffff88007b21dfd8 ffff88007a828880
Oct 20 15:52:27 debian kernel: [13800.262404]  ffff88007b21d5b0 ffff88007b21d5b0 ffff88007a743670 ffff88007fc13010
Oct 20 15:52:27 debian kernel: [13800.262406] Call Trace:
Oct 20 15:52:27 debian kernel: [13800.262408]  [<ffffffff8111e309>] ? wait_on_buffer+0x28/0x28
Oct 20 15:52:27 debian kernel: [13800.262410]  [<ffffffff8134fff1>] ? io_schedule+0x59/0x71
Oct 20 15:52:27 debian kernel: [13800.262411]  [<ffffffff8111e30f>] ? sleep_on_buffer+0x6/0xa
Oct 20 15:52:27 debian kernel: [13800.262413]  [<ffffffff81350335>] ? __wait_on_bit_lock+0x3c/0x85
Oct 20 15:52:27 debian kernel: [13800.262416]  [<ffffffff810bed01>] ? put_page+0x18/0x27
Oct 20 15:52:27 debian kernel: [13800.262417]  [<ffffffff813503ed>] ? out_of_line_wait_on_bit_lock+0x6f/0x78
Oct 20 15:52:27 debian kernel: [13800.262419]  [<ffffffff8111e309>] ? wait_on_buffer+0x28/0x28
Oct 20 15:52:27 debian kernel: [13800.262421]  [<ffffffff8105fea5>] ? autoremove_wake_function+0x2a/0x2a
Oct 20 15:52:27 debian kernel: [13800.262424]  [<ffffffffa00f0521>] ? do_get_write_access+0x5c/0x36a [jbd2]
Oct 20 15:52:27 debian kernel: [13800.262425]  [<ffffffff8103665c>] ? should_resched+0x5/0x23
Oct 20 15:52:27 debian kernel: [13800.262427]  [<ffffffff8134fd9c>] ? _cond_resched+0x7/0x1c
Oct 20 15:52:27 debian kernel: [13800.262428]  [<ffffffff8111ec23>] ? __getblk+0x24/0x238
Oct 20 15:52:27 debian kernel: [13800.262432]  [<ffffffff810ebc08>] ? kmem_getpages+0x8f/0xd9
Oct 20 15:52:27 debian kernel: [13800.262435]  [<ffffffffa00f0923>] ? jbd2_journal_get_write_access+0x21/0x38 [jbd2]
Oct 20 15:52:27 debian kernel: [13800.262438]  [<ffffffffa01007d2>] ? ext4_read_block_bitmap+0x4c/0x2f8 [ext4]
Oct 20 15:52:27 debian kernel: [13800.262442]  [<ffffffffa012939b>] ? __ext4_journal_get_write_access+0x4f/0x5e [ext4]
Oct 20 15:52:27 debian kernel: [13800.262447]  [<ffffffffa012dc47>] ? ext4_mb_mark_diskspace_used+0x66/0x2b7 [ext4]
Oct 20 15:52:27 debian kernel: [13800.262451]  [<ffffffffa012a508>] ? ext4_mb_use_preallocated+0xba/0x21b [ext4]
Oct 20 15:52:27 debian kernel: [13800.262456]  [<ffffffffa012ec48>] ? ext4_mb_new_blocks+0x209/0x47e [ext4]
Oct 20 15:52:27 debian kernel: [13800.262460]  [<ffffffffa01254c3>] ? ext4_ext_find_extent+0x121/0x30c [ext4]
Oct 20 15:52:27 debian kernel: [13800.262465]  [<ffffffffa01283a2>] ? ext4_ext_map_blocks+0x13a6/0x172d [ext4]
Oct 20 15:52:27 debian kernel: [13800.262467]  [<ffffffff811afeca>] ? __lookup_tag+0x6f/0x120
Oct 20 15:52:27 debian kernel: [13800.262469]  [<ffffffff811b0682>] ? radix_tree_gang_lookup_tag_slot+0x77/0x98
Oct 20 15:52:27 debian kernel: [13800.262473]  [<ffffffffa010590e>] ? ext4_map_blocks+0x11a/0x200 [ext4]
Oct 20 15:52:27 debian kernel: [13800.262476]  [<ffffffffa010890b>] ? mpage_da_map_and_submit+0x8e/0x2f9 [ext4]
Oct 20 15:52:27 debian kernel: [13800.262480]  [<ffffffffa0109147>] ? ext4_da_writepages+0x239/0x45d [ext4]
Oct 20 15:52:27 debian kernel: [13800.262484]  [<ffffffffa011e791>] ? ext4_journal_start_sb+0x139/0x14f [ext4]
Oct 20 15:52:27 debian kernel: [13800.262486]  [<ffffffff81351129>] ? _raw_spin_lock_irqsave+0x9/0x25
Oct 20 15:52:27 debian kernel: [13800.262490]  [<ffffffffa01091d2>] ? ext4_da_writepages+0x2c4/0x45d [ext4]
Oct 20 15:52:27 debian kernel: [13800.262493]  [<ffffffff8119b1e5>] ? queue_unplugged+0x71/0x84
Oct 20 15:52:27 debian kernel: [13800.262495]  [<ffffffff8111937f>] ? writeback_single_inode+0x119/0x2d9
Oct 20 15:52:27 debian kernel: [13800.262497]  [<ffffffff81119810>] ? writeback_sb_inodes+0x16b/0x204
Oct 20 15:52:27 debian kernel: [13800.262499]  [<ffffffff81119916>] ? __writeback_inodes_wb+0x6d/0xab
Oct 20 15:52:27 debian kernel: [13800.262501]  [<ffffffff81119a7c>] ? wb_writeback+0x128/0x21f
Oct 20 15:52:27 debian kernel: [13800.262502]  [<ffffffff810713ed>] ? arch_local_irq_save+0x11/0x17
Oct 20 15:52:27 debian kernel: [13800.262504]  [<ffffffff81119f33>] ? wb_do_writeback+0x146/0x1a8
Oct 20 15:52:27 debian kernel: [13800.262506]  [<ffffffff8111a01a>] ? bdi_writeback_thread+0x85/0x1e6
Oct 20 15:52:27 debian kernel: [13800.262508]  [<ffffffff81119f95>] ? wb_do_writeback+0x1a8/0x1a8
Oct 20 15:52:27 debian kernel: [13800.262510]  [<ffffffff8105f829>] ? kthread+0x76/0x7e
Oct 20 15:52:27 debian kernel: [13800.262512]  [<ffffffff813582f4>] ? kernel_thread_helper+0x4/0x10
Oct 20 15:52:27 debian kernel: [13800.262514]  [<ffffffff8105f7b3>] ? kthread_worker_fn+0x139/0x139
Oct 20 15:52:27 debian kernel: [13800.262515]  [<ffffffff813582f0>] ? gs_change+0x13/0x13

Second VM get MySQL freeze too. And I cant ssh connect. I get in VNC this screenshot.

After reboot, I check logs and find => in /var/log/messages

Oct 26 15:10:52 debian kernel: [161880.072305] kworker/u8:0    D ffff88013af444a8     0     6      2 0x00000000
Oct 26 15:10:52 debian kernel: [161880.072310] Workqueue: writeback bdi_writeback_workfn (flush-253:0)
Oct 26 15:10:52 debian kernel: [161880.072311]  ffff88013af44050 0000000000000046 0000000000012f00 ffff88013af5ffd8
Oct 26 15:10:52 debian kernel: [161880.072313]  0000000000012f00 ffff88013af44050 ffff88013a8ee000 ffff88013a8ee070
Oct 26 15:10:52 debian kernel: [161880.072314]  000000000004a720 000000000000000e 0000000000000000 ffff880128cb5e38
Oct 26 15:10:52 debian kernel: [161880.072315] Call Trace:
Oct 26 15:10:52 debian kernel: [161880.072324]  [<ffffffffa00f0074>] ? wait_transaction_locked+0x74/0xa0 [jbd2]
Oct 26 15:10:52 debian kernel: [161880.072327]  [<ffffffff810a7a40>] ? prepare_to_wait_event+0xf0/0xf0
Oct 26 15:10:52 debian kernel: [161880.072329]  [<ffffffffa00f03a1>] ? start_this_handle+0x281/0x5a0 [jbd2]
Oct 26 15:10:52 debian kernel: [161880.072331]  [<ffffffffa00f08b4>] ? jbd2__journal_start+0xf4/0x1e0 [jbd2]
Oct 26 15:10:52 debian kernel: [161880.072336]  [<ffffffffa011192c>] ? ext4_writepages+0x3ac/0xd00 [ext4]
Oct 26 15:10:52 debian kernel: [161880.072338]  [<ffffffff811ce539>] ? __writeback_single_inode+0x39/0x220
Oct 26 15:10:52 debian kernel: [161880.072339]  [<ffffffff811cf1a4>] ? writeback_sb_inodes+0x1a4/0x3e0
Oct 26 15:10:52 debian kernel: [161880.072340]  [<ffffffff811cf476>] ? __writeback_inodes_wb+0x96/0xc0
Oct 26 15:10:52 debian kernel: [161880.072342]  [<ffffffff811cf6e3>] ? wb_writeback+0x243/0x2d0
Oct 26 15:10:52 debian kernel: [161880.072343]  [<ffffffff811d1a21>] ? bdi_writeback_workfn+0x2a1/0x420
Oct 26 15:10:52 debian kernel: [161880.072345]  [<ffffffff81081662>] ? process_one_work+0x172/0x420
Oct 26 15:10:52 debian kernel: [161880.072346]  [<ffffffff81081cf3>] ? worker_thread+0x113/0x4f0
Oct 26 15:10:52 debian kernel: [161880.072347]  [<ffffffff81081be0>] ? rescuer_thread+0x2d0/0x2d0
Oct 26 15:10:52 debian kernel: [161880.072349]  [<ffffffff81087f7d>] ? kthread+0xbd/0xe0
Oct 26 15:10:52 debian kernel: [161880.072351]  [<ffffffff81087ec0>] ? kthread_create_on_node+0x180/0x180
Oct 26 15:10:52 debian kernel: [161880.072353]  [<ffffffff815115d8>] ? ret_from_fork+0x58/0x90
Oct 26 15:10:52 debian kernel: [161880.072355]  [<ffffffff81087ec0>] ? kthread_create_on_node+0x180/0x180
Oct 26 15:10:52 debian kernel: [161880.072578] jbd2/dm-0-8     D ffff880139817808     0   129      2 0x00000000
Oct 26 15:10:52 debian kernel: [161880.072580]  ffff8801398173b0 0000000000000046 0000000000012f00 ffff88013994bfd8
Oct 26 15:10:52 debian kernel: [161880.072581]  0000000000012f00 ffff8801398173b0 ffff88013994bdc8 ffff88013994be60
Oct 26 15:10:52 debian kernel: [161880.072582]  ffff88013a8ee0b8 ffff8801398173b0 ffff88007bc13d00 ffff88013994bdb0
Oct 26 15:10:52 debian kernel: [161880.072583] Call Trace:
Oct 26 15:10:52 debian kernel: [161880.072586]  [<ffffffffa00f3010>] ? jbd2_journal_commit_transaction+0x260/0x1950 [jbd2]
Oct 26 15:10:52 debian kernel: [161880.072589]  [<ffffffff8105195b>] ? kvm_clock_read+0x1b/0x20
Oct 26 15:10:52 debian kernel: [161880.072591]  [<ffffffff8101baf5>] ? sched_clock+0x5/0x10
Oct 26 15:10:52 debian kernel: [161880.072594]  [<ffffffff810a2803>] ? pick_next_task_fair+0x3e3/0x820
Oct 26 15:10:52 debian kernel: [161880.072595]  [<ffffffff810a7a40>] ? prepare_to_wait_event+0xf0/0xf0
Oct 26 15:10:52 debian kernel: [161880.072598]  [<ffffffff81072c86>] ? lock_timer_base.isra.35+0x26/0x50
Oct 26 15:10:52 debian kernel: [161880.072600]  [<ffffffffa00f7bc2>] ? kjournald2+0xb2/0x240 [jbd2]
Oct 26 15:10:52 debian kernel: [161880.072602]  [<ffffffff810a7a40>] ? prepare_to_wait_event+0xf0/0xf0
Oct 26 15:10:52 debian kernel: [161880.072604]  [<ffffffffa00f7b10>] ? commit_timeout+0x10/0x10 [jbd2]
Oct 26 15:10:52 debian kernel: [161880.072605]  [<ffffffff81087f7d>] ? kthread+0xbd/0xe0
Oct 26 15:10:52 debian kernel: [161880.072607]  [<ffffffff81087ec0>] ? kthread_create_on_node+0x180/0x180
Oct 26 15:10:52 debian kernel: [161880.072608]  [<ffffffff815115d8>] ? ret_from_fork+0x58/0x90
Oct 26 15:10:52 debian kernel: [161880.072609]  [<ffffffff81087ec0>] ? kthread_create_on_node+0x180/0x180
Oct 26 15:10:52 debian kernel: [161880.072829] mysqld          D ffff8800bade04e8     0  3478   2865 0x00000000
Oct 26 15:10:52 debian kernel: [161880.072830]  ffff8800bade0090 0000000000000082 0000000000012f00 ffff8801399a3fd8
Oct 26 15:10:52 debian kernel: [161880.072831]  0000000000012f00 ffff8800bade0090 ffff8800bade0090 ffff8801399a3e88
Oct 26 15:10:52 debian kernel: [161880.072832]  ffff8800bb115bf8 ffff8800bb115be0 ffffffff00000000 ffff8800bb115be8
Oct 26 15:10:52 debian kernel: [161880.072833] Call Trace:
Oct 26 15:10:52 debian kernel: [161880.072835]  [<ffffffff815106b5>] ? rwsem_down_write_failed+0x1d5/0x320
Oct 26 15:10:52 debian kernel: [161880.072837]  [<ffffffff812b7253>] ? call_rwsem_down_write_failed+0x13/0x20
Oct 26 15:10:52 debian kernel: [161880.072840]  [<ffffffff81231be0>] ? proc_keys_show+0x3f0/0x3f0
Oct 26 15:10:52 debian kernel: [161880.072841]  [<ffffffff81510029>] ? down_write+0x29/0x40
Oct 26 15:10:52 debian kernel: [161880.072843]  [<ffffffff81158f2c>] ? vm_mmap_pgoff+0x6c/0xc0
Oct 26 15:10:52 debian kernel: [161880.072845]  [<ffffffff8116e6ce>] ? SyS_mmap_pgoff+0x10e/0x250
Oct 26 15:10:52 debian kernel: [161880.072847]  [<ffffffff8151168d>] ? system_call_fast_compare_end+0x10/0x15
Oct 26 15:10:52 debian kernel: [161880.073071] mysqld          D ffff880139ea8e38     0  3830   2865 0x00000000
Oct 26 15:10:52 debian kernel: [161880.073072]  ffff880139ea89e0 0000000000000082 0000000000012f00 ffff8800ba87ffd8
Oct 26 15:10:52 debian kernel: [161880.073073]  0000000000012f00 ffff880139ea89e0 ffff88013a8ee000 ffff88013a8ee070
Oct 26 15:10:52 debian kernel: [161880.073074]  000000000004a720 0000000000000002 0000000000000000 ffff880128cb5c88
Oct 26 15:10:52 debian kernel: [161880.073075] Call Trace:
Oct 26 15:10:52 debian kernel: [161880.073077]  [<ffffffffa00f0074>] ? wait_transaction_locked+0x74/0xa0 [jbd2]
Oct 26 15:10:52 debian kernel: [161880.073078]  [<ffffffff810a7a40>] ? prepare_to_wait_event+0xf0/0xf0
Oct 26 15:10:52 debian kernel: [161880.073080]  [<ffffffffa00f03a1>] ? start_this_handle+0x281/0x5a0 [jbd2]
Oct 26 15:10:52 debian kernel: [161880.073082]  [<ffffffffa00f08b4>] ? jbd2__journal_start+0xf4/0x1e0 [jbd2]
Oct 26 15:10:52 debian kernel: [161880.073085]  [<ffffffffa01145b5>] ? ext4_dirty_inode+0x25/0x60 [ext4]
Oct 26 15:10:52 debian kernel: [161880.073087]  [<ffffffff811cebc2>] ? __mark_inode_dirty+0x172/0x270
Oct 26 15:10:52 debian kernel: [161880.073089]  [<ffffffff811c1771>] ? update_time+0x81/0xc0
Oct 26 15:10:52 debian kernel: [161880.073092]  [<ffffffff8106b3a2>] ? current_fs_time+0x12/0x60
Oct 26 15:10:52 debian kernel: [161880.073093]  [<ffffffff811c1970>] ? file_update_time+0x80/0xd0
Oct 26 15:10:52 debian kernel: [161880.073096]  [<ffffffff8113ecd2>] ? __generic_file_write_iter+0x132/0x340
Oct 26 15:10:52 debian kernel: [161880.073098]  [<ffffffff810d1bdd>] ? wake_futex+0x5d/0x80
Oct 26 15:10:52 debian kernel: [161880.073101]  [<ffffffffa0108b10>] ? ext4_file_write_iter+0xf0/0x3a0 [ext4]
Oct 26 15:10:52 debian kernel: [161880.073104]  [<ffffffff811a7ad4>] ? new_sync_write+0x74/0xa0
Oct 26 15:10:52 debian kernel: [161880.073106]  [<ffffffff811a8212>] ? vfs_write+0xb2/0x1f0
Oct 26 15:10:52 debian kernel: [161880.073107]  [<ffffffff811a8eb3>] ? SyS_pwrite64+0x63/0xa0
Oct 26 15:10:52 debian kernel: [161880.073108]  [<ffffffff8151168d>] ? system_call_fast_compare_end+0x10/0x15
Oct 26 15:10:52 debian kernel: [161880.073329] mysqld          D ffff8800ba87aef8     0  4201   2865 0x00000000
Oct 26 15:10:52 debian kernel: [161880.073331]  ffff8800ba87aaa0 0000000000000082 0000000000012f00 ffff880139883fd8
Oct 26 15:10:52 debian kernel: [161880.073332]  0000000000012f00 ffff8800ba87aaa0 ffff88013a8ee000 ffff88013a8ee070
Oct 26 15:10:52 debian kernel: [161880.073333]  000000000004a720 0000000000000002 0000000000000000 ffff880128cb5e68
Oct 26 15:10:52 debian kernel: [161880.073334] Call Trace:
Oct 26 15:10:52 debian kernel: [161880.073336]  [<ffffffffa00f0074>] ? wait_transaction_locked+0x74/0xa0 [jbd2]
Oct 26 15:10:52 debian kernel: [161880.073338]  [<ffffffff810a7a40>] ? prepare_to_wait_event+0xf0/0xf0
Oct 26 15:10:52 debian kernel: [161880.073339]  [<ffffffffa00f03a1>] ? start_this_handle+0x281/0x5a0 [jbd2]
Oct 26 15:10:52 debian kernel: [161880.073341]  [<ffffffffa00f08b4>] ? jbd2__journal_start+0xf4/0x1e0 [jbd2]
Oct 26 15:10:52 debian kernel: [161880.073344]  [<ffffffffa01145b5>] ? ext4_dirty_inode+0x25/0x60 [ext4]
Oct 26 15:10:52 debian kernel: [161880.073345]  [<ffffffff811cebc2>] ? __mark_inode_dirty+0x172/0x270
Oct 26 15:10:52 debian kernel: [161880.073347]  [<ffffffff811c1771>] ? update_time+0x81/0xc0
Oct 26 15:10:52 debian kernel: [161880.073348]  [<ffffffff8106b3a2>] ? current_fs_time+0x12/0x60
Oct 26 15:10:52 debian kernel: [161880.073350]  [<ffffffff811c1970>] ? file_update_time+0x80/0xd0
Oct 26 15:10:52 debian kernel: [161880.073351]  [<ffffffff8113ecd2>] ? __generic_file_write_iter+0x132/0x340
Oct 26 15:10:52 debian kernel: [161880.073353]  [<ffffffff8106b3a2>] ? current_fs_time+0x12/0x60
Oct 26 15:10:52 debian kernel: [161880.073355]  [<ffffffffa0108b10>] ? ext4_file_write_iter+0xf0/0x3a0 [ext4]
Oct 26 15:10:52 debian kernel: [161880.073357]  [<ffffffff811a7ad4>] ? new_sync_write+0x74/0xa0
Oct 26 15:10:52 debian kernel: [161880.073359]  [<ffffffff811a8212>] ? vfs_write+0xb2/0x1f0
Oct 26 15:10:52 debian kernel: [161880.073360]  [<ffffffff811a80dd>] ? vfs_read+0xed/0x170
Oct 26 15:10:52 debian kernel: [161880.073361]  [<ffffffff811a8eb3>] ? SyS_pwrite64+0x63/0xa0
Oct 26 15:10:52 debian kernel: [161880.073363]  [<ffffffff8151168d>] ? system_call_fast_compare_end+0x10/0x15
Oct 26 15:10:52 debian kernel: [161880.073922] mysqld          D ffff8800bade0e38     0  4202   2865 0x00000000
Oct 26 15:10:52 debian kernel: [161880.073924]  ffff8800bade09e0 0000000000000082 0000000000012f00 ffff88013aba3fd8
Oct 26 15:10:52 debian kernel: [161880.073925]  0000000000012f00 ffff8800bade09e0 ffff88013fc137b0 ffff88013ffd1958
Oct 26 15:10:52 debian kernel: [161880.073927]  ffff88013aba3ab0 0000000000000002 ffffffff811d6b10 ffff8800b954dcc0
Oct 26 15:10:52 debian kernel: [161880.073928] Call Trace:
Oct 26 15:10:52 debian kernel: [161880.073930]  [<ffffffff811d6b10>] ? generic_block_bmap+0x50/0x50
Oct 26 15:10:52 debian kernel: [161880.073931]  [<ffffffff8150e139>] ? io_schedule+0x99/0x120
Oct 26 15:10:52 debian kernel: [161880.073932]  [<ffffffff811d6b1a>] ? sleep_on_buffer+0xa/0x10
Oct 26 15:10:52 debian kernel: [161880.073933]  [<ffffffff8150e5c1>] ? __wait_on_bit_lock+0x41/0xa0
Oct 26 15:10:52 debian kernel: [161880.073934]  [<ffffffff811d6b10>] ? generic_block_bmap+0x50/0x50
Oct 26 15:10:52 debian kernel: [161880.073935]  [<ffffffff8150e697>] ? out_of_line_wait_on_bit_lock+0x77/0x90
Oct 26 15:10:52 debian kernel: [161880.073937]  [<ffffffff810a7a70>] ? autoremove_wake_function+0x30/0x30
Oct 26 15:10:52 debian kernel: [161880.073940]  [<ffffffffa00f1a20>] ? do_get_write_access+0x260/0x4e0 [jbd2]
Oct 26 15:10:52 debian kernel: [161880.073941]  [<ffffffff811d830a>] ? __getblk+0x2a/0x2d0
Oct 26 15:10:52 debian kernel: [161880.073943]  [<ffffffffa00f1cc2>] ? jbd2_journal_get_write_access+0x22/0x40 [jbd2]
Oct 26 15:10:52 debian kernel: [161880.073948]  [<ffffffffa013b066>] ? __ext4_journal_get_write_access+0x36/0x80 [ext4]
Oct 26 15:10:52 debian kernel: [161880.073950]  [<ffffffffa0111388>] ? ext4_reserve_inode_write+0x68/0x90 [ext4]
Oct 26 15:10:52 debian kernel: [161880.073953]  [<ffffffffa01145cb>] ? ext4_dirty_inode+0x3b/0x60 [ext4]
Oct 26 15:10:52 debian kernel: [161880.073956]  [<ffffffffa01113ef>] ? ext4_mark_inode_dirty+0x3f/0x1d0 [ext4]
Oct 26 15:10:52 debian kernel: [161880.073958]  [<ffffffffa01145cb>] ? ext4_dirty_inode+0x3b/0x60 [ext4]
Oct 26 15:10:52 debian kernel: [161880.073960]  [<ffffffff811cebc2>] ? __mark_inode_dirty+0x172/0x270
Oct 26 15:10:52 debian kernel: [161880.073961]  [<ffffffff811c1771>] ? update_time+0x81/0xc0
Oct 26 15:10:52 debian kernel: [161880.073963]  [<ffffffff8106b3a2>] ? current_fs_time+0x12/0x60
Oct 26 15:10:52 debian kernel: [161880.073965]  [<ffffffff811c1970>] ? file_update_time+0x80/0xd0
Oct 26 15:10:52 debian kernel: [161880.073967]  [<ffffffffa01147a4>] ? ext4_page_mkwrite+0x54/0x410 [ext4]
Oct 26 15:10:52 debian kernel: [161880.073969]  [<ffffffff811651ae>] ? do_page_mkwrite+0x3e/0x80
Oct 26 15:10:52 debian kernel: [161880.073970]  [<ffffffff81167340>] ? do_wp_page+0x650/0x7c0
Oct 26 15:10:52 debian kernel: [161880.073971]  [<ffffffff8116970d>] ? handle_mm_fault+0x84d/0x11c0
Oct 26 15:10:52 debian kernel: [161880.073973]  [<ffffffff810572b7>] ? __do_page_fault+0x177/0x4f0
Oct 26 15:10:52 debian kernel: [161880.073976]  [<ffffffff81408e06>] ? release_sock+0xe6/0x170
Oct 26 15:10:52 debian kernel: [161880.073978]  [<ffffffff81409cd0>] ? sock_setsockopt+0x1a0/0x940
Oct 26 15:10:52 debian kernel: [161880.073979]  [<ffffffff8105197b>] ? kvm_clock_get_cycles+0x1b/0x20
Oct 26 15:10:52 debian kernel: [161880.073982]  [<ffffffff810c7754>] ? __getnstimeofday+0x34/0xc0
Oct 26 15:10:52 debian kernel: [161880.073984]  [<ffffffff815136d8>] ? async_page_fault+0x28/0x30
Oct 26 15:10:52 debian kernel: [161880.074525] mysqld          D ffff8800ba818df8     0  4661   2865 0x00000000
Oct 26 15:10:52 debian kernel: [161880.074526]  ffff8800ba8189a0 0000000000000082 0000000000012f00 ffff88013ab77fd8
Oct 26 15:10:52 debian kernel: [161880.074527]  0000000000012f00 ffff8800ba8189a0 ffff88013fd937b0 ffff88013ffce958
Oct 26 15:10:52 debian kernel: [161880.074528]  ffff88013ab77b40 0000000000000002 ffffffff811d6b10 ffff8800b95303d0
Oct 26 15:10:52 debian kernel: [161880.074530] Call Trace:
Oct 26 15:10:52 debian kernel: [161880.074531]  [<ffffffff811d6b10>] ? generic_block_bmap+0x50/0x50
Oct 26 15:10:52 debian kernel: [161880.074532]  [<ffffffff8150e139>] ? io_schedule+0x99/0x120
Oct 26 15:10:52 debian kernel: [161880.074533]  [<ffffffff811d6b1a>] ? sleep_on_buffer+0xa/0x10
Oct 26 15:10:52 debian kernel: [161880.074534]  [<ffffffff8150e5c1>] ? __wait_on_bit_lock+0x41/0xa0
Oct 26 15:10:52 debian kernel: [161880.074535]  [<ffffffff811d6b10>] ? generic_block_bmap+0x50/0x50
Oct 26 15:10:52 debian kernel: [161880.074536]  [<ffffffff8150e697>] ? out_of_line_wait_on_bit_lock+0x77/0x90
Oct 26 15:10:52 debian kernel: [161880.074537]  [<ffffffff810a7a70>] ? autoremove_wake_function+0x30/0x30
Oct 26 15:10:52 debian kernel: [161880.074540]  [<ffffffffa00f1a20>] ? do_get_write_access+0x260/0x4e0 [jbd2]
Oct 26 15:10:52 debian kernel: [161880.074541]  [<ffffffff811d830a>] ? __getblk+0x2a/0x2d0
Oct 26 15:10:52 debian kernel: [161880.074543]  [<ffffffffa00f1cc2>] ? jbd2_journal_get_write_access+0x22/0x40 [jbd2]
Oct 26 15:10:52 debian kernel: [161880.074546]  [<ffffffffa013b066>] ? __ext4_journal_get_write_access+0x36/0x80 [ext4]
Oct 26 15:10:52 debian kernel: [161880.074549]  [<ffffffffa0111388>] ? ext4_reserve_inode_write+0x68/0x90 [ext4]
Oct 26 15:10:52 debian kernel: [161880.074551]  [<ffffffffa01145cb>] ? ext4_dirty_inode+0x3b/0x60 [ext4]
Oct 26 15:10:52 debian kernel: [161880.074554]  [<ffffffffa01113ef>] ? ext4_mark_inode_dirty+0x3f/0x1d0 [ext4]
Oct 26 15:10:52 debian kernel: [161880.074556]  [<ffffffffa01145cb>] ? ext4_dirty_inode+0x3b/0x60 [ext4]
Oct 26 15:10:52 debian kernel: [161880.074557]  [<ffffffff811cebc2>] ? __mark_inode_dirty+0x172/0x270
Oct 26 15:10:52 debian kernel: [161880.074559]  [<ffffffff811c1771>] ? update_time+0x81/0xc0
Oct 26 15:10:52 debian kernel: [161880.074561]  [<ffffffff8106b3a2>] ? current_fs_time+0x12/0x60
Oct 26 15:10:52 debian kernel: [161880.074562]  [<ffffffff811c1970>] ? file_update_time+0x80/0xd0
Oct 26 15:10:52 debian kernel: [161880.074564]  [<ffffffff8113ecd2>] ? __generic_file_write_iter+0x132/0x340
Oct 26 15:10:52 debian kernel: [161880.074566]  [<ffffffffa0108b10>] ? ext4_file_write_iter+0xf0/0x3a0 [ext4]
Oct 26 15:10:52 debian kernel: [161880.074568]  [<ffffffff810d1c6f>] ? futex_wake+0x6f/0x120
Oct 26 15:10:52 debian kernel: [161880.074570]  [<ffffffff811a7ad4>] ? new_sync_write+0x74/0xa0
Oct 26 15:10:52 debian kernel: [161880.074571]  [<ffffffff811a8212>] ? vfs_write+0xb2/0x1f0
Oct 26 15:10:52 debian kernel: [161880.074573]  [<ffffffff810d469e>] ? SyS_futex+0x6e/0x150
Oct 26 15:10:52 debian kernel: [161880.074574]  [<ffffffff811a8d52>] ? SyS_write+0x42/0xa0
Oct 26 15:10:52 debian kernel: [161880.074575]  [<ffffffff811a7d33>] ? SyS_lseek+0x43/0xa0
Oct 26 15:10:52 debian kernel: [161880.074577]  [<ffffffff8151168d>] ? system_call_fast_compare_end+0x10/0x15
Oct 26 15:10:52 debian kernel: [161880.075126] mysqld          D ffff880036c178c8     0  5402   2865 0x00000000
Oct 26 15:10:52 debian kernel: [161880.075127]  ffff880036c17470 0000000000000082 0000000000012f00 ffff8800bb6f3fd8
Oct 26 15:10:52 debian kernel: [161880.075128]  0000000000012f00 ffff880036c17470 ffff88013a8ee000 ffff88013a8ee070
Oct 26 15:10:52 debian kernel: [161880.075129]  000000000004a720 0000000000000002 0000000000000000 ffff880128cb5a48
Oct 26 15:10:52 debian kernel: [161880.075130] Call Trace:
Oct 26 15:10:52 debian kernel: [161880.075133]  [<ffffffffa00f0074>] ? wait_transaction_locked+0x74/0xa0 [jbd2]
Oct 26 15:10:52 debian kernel: [161880.075134]  [<ffffffff810a7a40>] ? prepare_to_wait_event+0xf0/0xf0
Oct 26 15:10:52 debian kernel: [161880.075136]  [<ffffffffa00f03a1>] ? start_this_handle+0x281/0x5a0 [jbd2]
Oct 26 15:10:52 debian kernel: [161880.075138]  [<ffffffffa00f08b4>] ? jbd2__journal_start+0xf4/0x1e0 [jbd2]
Oct 26 15:10:52 debian kernel: [161880.075140]  [<ffffffffa01145b5>] ? ext4_dirty_inode+0x25/0x60 [ext4]
Oct 26 15:10:52 debian kernel: [161880.075142]  [<ffffffff811cebc2>] ? __mark_inode_dirty+0x172/0x270
Oct 26 15:10:52 debian kernel: [161880.075143]  [<ffffffff811c1771>] ? update_time+0x81/0xc0
Oct 26 15:10:52 debian kernel: [161880.075145]  [<ffffffff8106b3a2>] ? current_fs_time+0x12/0x60
Oct 26 15:10:52 debian kernel: [161880.075146]  [<ffffffff811c1970>] ? file_update_time+0x80/0xd0
Oct 26 15:10:52 debian kernel: [161880.075148]  [<ffffffff8113ecd2>] ? __generic_file_write_iter+0x132/0x340
Oct 26 15:10:52 debian kernel: [161880.075150]  [<ffffffffa0108b10>] ? ext4_file_write_iter+0xf0/0x3a0 [ext4]
Oct 26 15:10:52 debian kernel: [161880.075152]  [<ffffffff810d1c6f>] ? futex_wake+0x6f/0x120
Oct 26 15:10:52 debian kernel: [161880.075154]  [<ffffffff811a7ad4>] ? new_sync_write+0x74/0xa0
Oct 26 15:10:52 debian kernel: [161880.075155]  [<ffffffff811a8212>] ? vfs_write+0xb2/0x1f0
Oct 26 15:10:52 debian kernel: [161880.075157]  [<ffffffff810d469e>] ? SyS_futex+0x6e/0x150
Oct 26 15:10:52 debian kernel: [161880.075158]  [<ffffffff811a8d52>] ? SyS_write+0x42/0xa0
Oct 26 15:10:52 debian kernel: [161880.075159]  [<ffffffff811a7d33>] ? SyS_lseek+0x43/0xa0
Oct 26 15:10:52 debian kernel: [161880.075161]  [<ffffffff8151168d>] ? system_call_fast_compare_end+0x10/0x15
Oct 26 15:10:52 debian kernel: [161880.075718] mysqld          D ffff88013a146eb8     0  2449   2865 0x00000000
Oct 26 15:10:52 debian kernel: [161880.075719]  ffff88013a146a60 0000000000000082 0000000000012f00 ffff880036ca3fd8
Oct 26 15:10:52 debian kernel: [161880.075720]  0000000000012f00 ffff88013a146a60 ffff88013a8ee000 ffff88013a8ee070
Oct 26 15:10:52 debian kernel: [161880.075721]  000000000004a720 0000000000000002 0000000000000000 ffff880128cb5dd8
Oct 26 15:10:52 debian kernel: [161880.075723] Call Trace:
Oct 26 15:10:52 debian kernel: [161880.075725]  [<ffffffffa00f0074>] ? wait_transaction_locked+0x74/0xa0 [jbd2]
Oct 26 15:10:52 debian kernel: [161880.075727]  [<ffffffff810a7a40>] ? prepare_to_wait_event+0xf0/0xf0
Oct 26 15:10:52 debian kernel: [161880.075728]  [<ffffffffa00f03a1>] ? start_this_handle+0x281/0x5a0 [jbd2]
Oct 26 15:10:52 debian kernel: [161880.075730]  [<ffffffffa00f08b4>] ? jbd2__journal_start+0xf4/0x1e0 [jbd2]
Oct 26 15:10:52 debian kernel: [161880.075733]  [<ffffffffa01145b5>] ? ext4_dirty_inode+0x25/0x60 [ext4]
Oct 26 15:10:52 debian kernel: [161880.075734]  [<ffffffff811cebc2>] ? __mark_inode_dirty+0x172/0x270
Oct 26 15:10:52 debian kernel: [161880.075736]  [<ffffffff811c1771>] ? update_time+0x81/0xc0
Oct 26 15:10:52 debian kernel: [161880.075738]  [<ffffffff8106b3a2>] ? current_fs_time+0x12/0x60
Oct 26 15:10:52 debian kernel: [161880.075739]  [<ffffffff811c1970>] ? file_update_time+0x80/0xd0
Oct 26 15:10:52 debian kernel: [161880.075741]  [<ffffffff8113ecd2>] ? __generic_file_write_iter+0x132/0x340
Oct 26 15:10:52 debian kernel: [161880.075743]  [<ffffffffa0108b10>] ? ext4_file_write_iter+0xf0/0x3a0 [ext4]
Oct 26 15:10:52 debian kernel: [161880.075745]  [<ffffffff810d1c6f>] ? futex_wake+0x6f/0x120
Oct 26 15:10:52 debian kernel: [161880.075747]  [<ffffffff811a7ad4>] ? new_sync_write+0x74/0xa0
Oct 26 15:10:52 debian kernel: [161880.075748]  [<ffffffff811a8212>] ? vfs_write+0xb2/0x1f0
Oct 26 15:10:52 debian kernel: [161880.075750]  [<ffffffff810d469e>] ? SyS_futex+0x6e/0x150
Oct 26 15:10:52 debian kernel: [161880.075751]  [<ffffffff811a8d52>] ? SyS_write+0x42/0xa0
Oct 26 15:10:52 debian kernel: [161880.075752]  [<ffffffff811a7d33>] ? SyS_lseek+0x43/0xa0
Oct 26 15:10:52 debian kernel: [161880.075754]  [<ffffffff8151168d>] ? system_call_fast_compare_end+0x10/0x15
Oct 26 15:12:52 debian kernel: [162000.072639] kworker/u8:0    D ffff88013af444a8     0     6      2 0x00000000
Oct 26 15:12:52 debian kernel: [162000.072644] Workqueue: writeback bdi_writeback_workfn (flush-253:0)
Oct 26 15:12:52 debian kernel: [162000.072646]  ffff88013af44050 0000000000000046 0000000000012f00 ffff88013af5ffd8
Oct 26 15:12:52 debian kernel: [162000.072648]  0000000000012f00 ffff88013af44050 ffff88013a8ee000 ffff88013a8ee070
Oct 26 15:12:52 debian kernel: [162000.072649]  000000000004a720 000000000000000e 0000000000000000 ffff880128cb5e38
Oct 26 15:12:52 debian kernel: [162000.072650] Call Trace:
Oct 26 15:12:52 debian kernel: [162000.072659]  [<ffffffffa00f0074>] ? wait_transaction_locked+0x74/0xa0 [jbd2]
Oct 26 15:12:52 debian kernel: [162000.072663]  [<ffffffff810a7a40>] ? prepare_to_wait_event+0xf0/0xf0
Oct 26 15:12:52 debian kernel: [162000.072665]  [<ffffffffa00f03a1>] ? start_this_handle+0x281/0x5a0 [jbd2]
Oct 26 15:12:52 debian kernel: [162000.072667]  [<ffffffffa00f08b4>] ? jbd2__journal_start+0xf4/0x1e0 [jbd2]
Oct 26 15:12:52 debian kernel: [162000.072672]  [<ffffffffa011192c>] ? ext4_writepages+0x3ac/0xd00 [ext4]
Oct 26 15:12:52 debian kernel: [162000.072675]  [<ffffffff811ce539>] ? __writeback_single_inode+0x39/0x220
Oct 26 15:12:52 debian kernel: [162000.072676]  [<ffffffff811cf1a4>] ? writeback_sb_inodes+0x1a4/0x3e0
Oct 26 15:12:52 debian kernel: [162000.072678]  [<ffffffff811cf476>] ? __writeback_inodes_wb+0x96/0xc0
Oct 26 15:12:52 debian kernel: [162000.072679]  [<ffffffff811cf6e3>] ? wb_writeback+0x243/0x2d0
Oct 26 15:12:52 debian kernel: [162000.072680]  [<ffffffff811d1a21>] ? bdi_writeback_workfn+0x2a1/0x420
Oct 26 15:12:52 debian kernel: [162000.072682]  [<ffffffff81081662>] ? process_one_work+0x172/0x420
Oct 26 15:12:52 debian kernel: [162000.072683]  [<ffffffff81081cf3>] ? worker_thread+0x113/0x4f0
Oct 26 15:12:52 debian kernel: [162000.072685]  [<ffffffff81081be0>] ? rescuer_thread+0x2d0/0x2d0
Oct 26 15:12:52 debian kernel: [162000.072687]  [<ffffffff81087f7d>] ? kthread+0xbd/0xe0
Oct 26 15:12:52 debian kernel: [162000.072689]  [<ffffffff81087ec0>] ? kthread_create_on_node+0x180/0x180
Oct 26 15:12:52 debian kernel: [162000.072691]  [<ffffffff815115d8>] ? ret_from_fork+0x58/0x90
Oct 26 15:12:52 debian kernel: [162000.072693]  [<ffffffff81087ec0>] ? kthread_create_on_node+0x180/0x180

More info about zvol

zfs get all ssd/kvm631
NAME        PROPERTY              VALUE                  SOURCE
ssd/kvm631  type                  volume                 -
ssd/kvm631  creation              Sat Oct 24 17:05 2015  -
ssd/kvm631  used                  5.97G                  -
ssd/kvm631  available             80.3G                  -
ssd/kvm631  referenced            5.97G                  -
ssd/kvm631  compressratio         1.44x                  -
ssd/kvm631  reservation           none                   default
ssd/kvm631  volsize               40G                    local
ssd/kvm631  volblocksize          8K                     -
ssd/kvm631  checksum              on                     default
ssd/kvm631  compression           lz4                    local
ssd/kvm631  readonly              off                    default
ssd/kvm631  copies                1                      default
ssd/kvm631  refreservation        none                   default
ssd/kvm631  primarycache          all                    default
ssd/kvm631  secondarycache        all                    default
ssd/kvm631  usedbysnapshots       0                      -
ssd/kvm631  usedbydataset         5.97G                  -
ssd/kvm631  usedbychildren        0                      -
ssd/kvm631  usedbyrefreservation  0                      -
ssd/kvm631  logbias               latency                default
ssd/kvm631  dedup                 off                    default
ssd/kvm631  mlslabel              none                   default
ssd/kvm631  sync                  standard               default
ssd/kvm631  refcompressratio      1.44x                  -
ssd/kvm631  written               5.97G                  -
ssd/kvm631  logicalused           8.50G                  -
ssd/kvm631  logicalreferenced     8.50G                  -
ssd/kvm631  snapshot_limit        none                   default
ssd/kvm631  snapshot_count        none                   default
ssd/kvm631  snapdev               hidden                 default
ssd/kvm631  context               none                   default
ssd/kvm631  fscontext             none                   default
ssd/kvm631  defcontext            none                   default
ssd/kvm631  rootcontext           none                   default
ssd/kvm631  redundant_metadata    all                    default
ssd/kvm631  shareiscsi            off                    default
@alexanderhaensch
Copy link

Is mysqld running on ext4 or on zfs?

@poiuty
Copy link
Author

poiuty commented Oct 28, 2015

zfs => zvol kvm vm => lvm => ext4 => mysqld

@poiuty poiuty changed the title blocked for more than 120 seconds on 0.6.5.3 in KVM VM blocked for more than 120 seconds on 0.6.5.2 in KVM VM Oct 28, 2015
@alexanderhaensch
Copy link

Very interesting setup @poiuty . There are no zfs related logs on the host? Maybe the guest freezes before host kernel logs any problem. Can we reduce the hung timer on the host to show problems on the host?
for example:
echo 10 > /proc/sys/kernel/hung_task_timeout_secs
Just an idea. Maybe there are more options to increase logging on the host?

I guess your mysql is configured to use AIO. The AIO support in ZFS is relatively new. So maybe it reacts different if AIO is disabled?
https://dev.mysql.com/doc/innodb/1.1/en/innodb-performance-aio-linux.html

What about setting sync=disabled on the datastore. Does this changes anything?

@poiuty
Copy link
Author

poiuty commented Oct 29, 2015

@alexanderhaensch , I think prbolem in spl_taskq_thread_dynamic=1
Before I use 0.6.4.2 => and dont have any problems.
echo 0 > /sys/module/spl/parameters/spl_taskq_thread_dynamic
And wait (about 3 day) => no freeze.

@poiuty poiuty mentioned this issue Nov 17, 2015
Closed
@poiuty poiuty mentioned this issue Dec 4, 2015
Closed
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Assignees
No one assigned
Labels
None yet
Projects
None yet
Milestone
No milestone
Development

No branches or pull requests
3 participants
@alexanderhaensch @poiuty and others