New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

2.0.1 CSV Export hangs until timeout #3217

Closed
robfico opened this Issue Jan 30, 2016 · 5 comments

Comments

Projects
5 participants
@robfico
Contributor

robfico commented Jan 30, 2016

One of our clients has a 2.0.1 store that has 8,585 products in it (all imported through CSV imports). Everything looks fine with the data, no errors, nothing in debug. When we go to export the products, the pages hangs, and CPU usage is pegged. MySQL queries stop after one minute, but CPU runs until timeout is reached (we upped timeout to one hour and still times out). Once timeout is reached, export file appears in /var in its entirety.

It appears the export does initially complete in a minute, but the file does not get generated until the timeout occurs. Up until the timeout, CPU is pegged. Even if we exclude all fields but SKU and name, same behavior. Nothing in system.log or debug.log. Looks like a bug causing an infinite loop somehow, but I don't see what exactly.

@robfico

This comment has been minimized.

Show comment
Hide comment
@robfico

robfico Jan 30, 2016

Contributor

An strace output of the php process stops with the following last few lines and then hangs until timeout:

sendto(5, "\270\1\0\0\3SELECT `def`.*, IF(store.us"..., 444, MSG_DONTWAIT, NULL, 0) = 444
sendto(5, "(\2\0\0\3SELECT `main_table`.*, `tdv"..., 556, MSG_DONTWAIT, NULL, 0) = 556
sendto(5, "h\4\0\0\3SELECT `entity`.`sku`, `sup"..., 1132, MSG_DONTWAIT, NULL, 0) = 1132
sendto(5, "\204\0\0\0\3SELECT `main_table`.* FROM "..., 136, MSG_DONTWAIT, NULL, 0) = 136
sendto(5, "\20\2\0\0\3SELECT `e`.*, `link_table`."..., 532, MSG_DONTWAIT, NULL, 0) = 532
sendto(5, "\233\v\0\0\3SELECT `t_d`.`entity_id`, `"..., 2975, MSG_DONTWAIT, NULL, 0) = 2975
sendto(5, "\314\3\0\0\3SELECT `main`.`value_id`, `"..., 976, MSG_DONTWAIT, NULL, 0) = 976
sendto(5, "\343\2\0\0\3SELECT `main`.`value_id`, `"..., 743, MSG_DONTWAIT, NULL, 0) = 743
sendto(5, "\314\3\0\0\3SELECT `main`.`value_id`, `"..., 976, MSG_DONTWAIT, NULL, 0) = 976
sendto(5, "\314\3\0\0\3SELECT `main`.`value_id`, `"..., 976, MSG_DONTWAIT, NULL, 0) = 976
sendto(5, "\270\1\0\0\3SELECT `def`.*, IF(store.us"..., 444, MSG_DONTWAIT, NULL, 0) = 444
sendto(5, "(\2\0\0\3SELECT `main_table`.*, `tdv"..., 556, MSG_DONTWAIT, NULL, 0) = 556
sendto(5, "h\4\0\0\3SELECT `entity`.`sku`, `sup"..., 1132, MSG_DONTWAIT, NULL, 0) = 1132
sendto(5, "\204\0\0\0\3SELECT `main_table`.* FROM "..., 136, MSG_DONTWAIT, NULL, 0) = 136
sendto(5, "\20\2\0\0\3SELECT `e`.*, `link_table`."..., 532, MSG_DONTWAIT, NULL, 0) = 532
sendto(5, "s\v\0\0\3SELECT `t_d`.`entity_id`, `"..., 2935, MSG_DONTWAIT, NULL, 0) = 2935
sendto(5, "\314\3\0\0\3SELECT `main`.`value_id`, `"..., 976, MSG_DONTWAIT, NULL, 0) = 976
sendto(5, "\343\2\0\0\3SELECT `main`.`value_id`, `"..., 743, MSG_DONTWAIT, NULL, 0) = 743
sendto(5, "\314\3\0\0\3SELECT `main`.`value_id`, `"..., 976, MSG_DONTWAIT, NULL, 0) = 976
sendto(5, "\270\1\0\0\3SELECT `def`.*, IF(store.us"..., 444, MSG_DONTWAIT, NULL, 0) = 444
sendto(5, "!\2\0\0\3SELECT `main_table`.*, `tdv"..., 549, MSG_DONTWAIT, NULL, 0) = 549
sendto(5, "h\4\0\0\3SELECT `entity`.`sku`, `sup"..., 1132, MSG_DONTWAIT, NULL, 0) = 1132
sendto(5, "\204\0\0\0\3SELECT `main_table`.* FROM "..., 136, MSG_DONTWAIT, NULL, 0) = 136
sendto(5, "\20\2\0\0\3SELECT `e`.*, `link_table`."..., 532, MSG_DONTWAIT, NULL, 0) = 532
sendto(5, "\233\v\0\0\3SELECT `t_d`.`entity_id`, `"..., 2975, MSG_DONTWAIT, NULL, 0) = 2975
sendto(5, "\314\3\0\0\3SELECT `main`.`value_id`, `"..., 976, MSG_DONTWAIT, NULL, 0) = 976
sendto(5, "\343\2\0\0\3SELECT `main`.`value_id`, `"..., 743, MSG_DONTWAIT, NULL, 0) = 743
sendto(5, "\314\3\0\0\3SELECT `main`.`value_id`, `"..., 976, MSG_DONTWAIT, NULL, 0) = 976
sendto(5, "\314\3\0\0\3SELECT `main`.`value_id`, `"..., 976, MSG_DONTWAIT, NULL, 0) = 976
sendto(5, "\270\1\0\0\3SELECT `def`.*, IF(store.us"..., 444, MSG_DONTWAIT, NULL, 0) = 444
sendto(5, "(\2\0\0\3SELECT `main_table`.*, `tdv"..., 556, MSG_DONTWAIT, NULL, 0) = 556
sendto(5, "h\4\0\0\3SELECT `entity`.`sku`, `sup"..., 1132, MSG_DONTWAIT, NULL, 0) = 1132
sendto(5, "\204\0\0\0\3SELECT `main_table`.* FROM "..., 136, MSG_DONTWAIT, NULL, 0) = 136
sendto(5, "\20\2\0\0\3SELECT `e`.*, `link_table`."..., 532, MSG_DONTWAIT, NULL, 0) = 532
sendto(5, "\233\v\0\0\3SELECT `t_d`.`entity_id`, `"..., 2975, MSG_DONTWAIT, NULL, 0) = 2975
sendto(5, "\314\3\0\0\3SELECT `main`.`value_id`, `"..., 976, MSG_DONTWAIT, NULL, 0) = 976
sendto(5, "\343\2\0\0\3SELECT `main`.`value_id`, `"..., 743, MSG_DONTWAIT, NULL, 0) = 743
sendto(5, "\314\3\0\0\3SELECT `main`.`value_id`, `"..., 976, MSG_DONTWAIT, NULL, 0) = 976
sendto(5, "\314\3\0\0\3SELECT `main`.`value_id`, `"..., 976, MSG_DONTWAIT, NULL, 0) = 976
sendto(5, "\270\1\0\0\3SELECT `def`.*, IF(store.us"..., 444, MSG_DONTWAIT, NULL, 0) = 444
sendto(5, "(\2\0\0\3SELECT `main_table`.*, `tdv"..., 556, MSG_DONTWAIT, NULL, 0) = 556
sendto(5, "h\4\0\0\3SELECT `entity`.`sku`, `sup"..., 1132, MSG_DONTWAIT, NULL, 0) = 1132
sendto(5, "\204\0\0\0\3SELECT `main_table`.* FROM "..., 136, MSG_DONTWAIT, NULL, 0) = 136
sendto(5, "\20\2\0\0\3SELECT `e`.*, `link_table`."..., 532, MSG_DONTWAIT, NULL, 0) = 532
sendto(5, "\233\v\0\0\3SELECT `t_d`.`entity_id`, `"..., 2975, MSG_DONTWAIT, NULL, 0) = 2975
sendto(5, "\314\3\0\0\3SELECT `main`.`value_id`, `"..., 976, MSG_DONTWAIT, NULL, 0) = 976
sendto(5, "\343\2\0\0\3SELECT `main`.`value_id`, `"..., 743, MSG_DONTWAIT, NULL, 0) = 743
sendto(5, "\314\3\0\0\3SELECT `main`.`value_id`, `"..., 976, MSG_DONTWAIT, NULL, 0) = 976
sendto(5, "\314\3\0\0\3SELECT `main`.`value_id`, `"..., 976, MSG_DONTWAIT, NULL, 0) = 976
sendto(5, "\270\1\0\0\3SELECT `def`.*, IF(store.us"..., 444, MSG_DONTWAIT, NULL, 0) = 444
sendto(5, "(\2\0\0\3SELECT `main_table`.*, `tdv"..., 556, MSG_DONTWAIT, NULL, 0) = 556
sendto(5, "h\4\0\0\3SELECT `entity`.`sku`, `sup"..., 1132, MSG_DONTWAIT, NULL, 0) = 1132
open("/home/xxx/www/vendor/magento/module-grouped-import-export/Model/Export/RowCustomizer.php", O_RDONLY) = 8
open("/home/xxx/www/vendor/magento/module-grouped-import-export/Model/Export/RowCustomizer.php", O_RDONLY) = 8
Contributor

robfico commented Jan 30, 2016

An strace output of the php process stops with the following last few lines and then hangs until timeout:

sendto(5, "\270\1\0\0\3SELECT `def`.*, IF(store.us"..., 444, MSG_DONTWAIT, NULL, 0) = 444
sendto(5, "(\2\0\0\3SELECT `main_table`.*, `tdv"..., 556, MSG_DONTWAIT, NULL, 0) = 556
sendto(5, "h\4\0\0\3SELECT `entity`.`sku`, `sup"..., 1132, MSG_DONTWAIT, NULL, 0) = 1132
sendto(5, "\204\0\0\0\3SELECT `main_table`.* FROM "..., 136, MSG_DONTWAIT, NULL, 0) = 136
sendto(5, "\20\2\0\0\3SELECT `e`.*, `link_table`."..., 532, MSG_DONTWAIT, NULL, 0) = 532
sendto(5, "\233\v\0\0\3SELECT `t_d`.`entity_id`, `"..., 2975, MSG_DONTWAIT, NULL, 0) = 2975
sendto(5, "\314\3\0\0\3SELECT `main`.`value_id`, `"..., 976, MSG_DONTWAIT, NULL, 0) = 976
sendto(5, "\343\2\0\0\3SELECT `main`.`value_id`, `"..., 743, MSG_DONTWAIT, NULL, 0) = 743
sendto(5, "\314\3\0\0\3SELECT `main`.`value_id`, `"..., 976, MSG_DONTWAIT, NULL, 0) = 976
sendto(5, "\314\3\0\0\3SELECT `main`.`value_id`, `"..., 976, MSG_DONTWAIT, NULL, 0) = 976
sendto(5, "\270\1\0\0\3SELECT `def`.*, IF(store.us"..., 444, MSG_DONTWAIT, NULL, 0) = 444
sendto(5, "(\2\0\0\3SELECT `main_table`.*, `tdv"..., 556, MSG_DONTWAIT, NULL, 0) = 556
sendto(5, "h\4\0\0\3SELECT `entity`.`sku`, `sup"..., 1132, MSG_DONTWAIT, NULL, 0) = 1132
sendto(5, "\204\0\0\0\3SELECT `main_table`.* FROM "..., 136, MSG_DONTWAIT, NULL, 0) = 136
sendto(5, "\20\2\0\0\3SELECT `e`.*, `link_table`."..., 532, MSG_DONTWAIT, NULL, 0) = 532
sendto(5, "s\v\0\0\3SELECT `t_d`.`entity_id`, `"..., 2935, MSG_DONTWAIT, NULL, 0) = 2935
sendto(5, "\314\3\0\0\3SELECT `main`.`value_id`, `"..., 976, MSG_DONTWAIT, NULL, 0) = 976
sendto(5, "\343\2\0\0\3SELECT `main`.`value_id`, `"..., 743, MSG_DONTWAIT, NULL, 0) = 743
sendto(5, "\314\3\0\0\3SELECT `main`.`value_id`, `"..., 976, MSG_DONTWAIT, NULL, 0) = 976
sendto(5, "\270\1\0\0\3SELECT `def`.*, IF(store.us"..., 444, MSG_DONTWAIT, NULL, 0) = 444
sendto(5, "!\2\0\0\3SELECT `main_table`.*, `tdv"..., 549, MSG_DONTWAIT, NULL, 0) = 549
sendto(5, "h\4\0\0\3SELECT `entity`.`sku`, `sup"..., 1132, MSG_DONTWAIT, NULL, 0) = 1132
sendto(5, "\204\0\0\0\3SELECT `main_table`.* FROM "..., 136, MSG_DONTWAIT, NULL, 0) = 136
sendto(5, "\20\2\0\0\3SELECT `e`.*, `link_table`."..., 532, MSG_DONTWAIT, NULL, 0) = 532
sendto(5, "\233\v\0\0\3SELECT `t_d`.`entity_id`, `"..., 2975, MSG_DONTWAIT, NULL, 0) = 2975
sendto(5, "\314\3\0\0\3SELECT `main`.`value_id`, `"..., 976, MSG_DONTWAIT, NULL, 0) = 976
sendto(5, "\343\2\0\0\3SELECT `main`.`value_id`, `"..., 743, MSG_DONTWAIT, NULL, 0) = 743
sendto(5, "\314\3\0\0\3SELECT `main`.`value_id`, `"..., 976, MSG_DONTWAIT, NULL, 0) = 976
sendto(5, "\314\3\0\0\3SELECT `main`.`value_id`, `"..., 976, MSG_DONTWAIT, NULL, 0) = 976
sendto(5, "\270\1\0\0\3SELECT `def`.*, IF(store.us"..., 444, MSG_DONTWAIT, NULL, 0) = 444
sendto(5, "(\2\0\0\3SELECT `main_table`.*, `tdv"..., 556, MSG_DONTWAIT, NULL, 0) = 556
sendto(5, "h\4\0\0\3SELECT `entity`.`sku`, `sup"..., 1132, MSG_DONTWAIT, NULL, 0) = 1132
sendto(5, "\204\0\0\0\3SELECT `main_table`.* FROM "..., 136, MSG_DONTWAIT, NULL, 0) = 136
sendto(5, "\20\2\0\0\3SELECT `e`.*, `link_table`."..., 532, MSG_DONTWAIT, NULL, 0) = 532
sendto(5, "\233\v\0\0\3SELECT `t_d`.`entity_id`, `"..., 2975, MSG_DONTWAIT, NULL, 0) = 2975
sendto(5, "\314\3\0\0\3SELECT `main`.`value_id`, `"..., 976, MSG_DONTWAIT, NULL, 0) = 976
sendto(5, "\343\2\0\0\3SELECT `main`.`value_id`, `"..., 743, MSG_DONTWAIT, NULL, 0) = 743
sendto(5, "\314\3\0\0\3SELECT `main`.`value_id`, `"..., 976, MSG_DONTWAIT, NULL, 0) = 976
sendto(5, "\314\3\0\0\3SELECT `main`.`value_id`, `"..., 976, MSG_DONTWAIT, NULL, 0) = 976
sendto(5, "\270\1\0\0\3SELECT `def`.*, IF(store.us"..., 444, MSG_DONTWAIT, NULL, 0) = 444
sendto(5, "(\2\0\0\3SELECT `main_table`.*, `tdv"..., 556, MSG_DONTWAIT, NULL, 0) = 556
sendto(5, "h\4\0\0\3SELECT `entity`.`sku`, `sup"..., 1132, MSG_DONTWAIT, NULL, 0) = 1132
sendto(5, "\204\0\0\0\3SELECT `main_table`.* FROM "..., 136, MSG_DONTWAIT, NULL, 0) = 136
sendto(5, "\20\2\0\0\3SELECT `e`.*, `link_table`."..., 532, MSG_DONTWAIT, NULL, 0) = 532
sendto(5, "\233\v\0\0\3SELECT `t_d`.`entity_id`, `"..., 2975, MSG_DONTWAIT, NULL, 0) = 2975
sendto(5, "\314\3\0\0\3SELECT `main`.`value_id`, `"..., 976, MSG_DONTWAIT, NULL, 0) = 976
sendto(5, "\343\2\0\0\3SELECT `main`.`value_id`, `"..., 743, MSG_DONTWAIT, NULL, 0) = 743
sendto(5, "\314\3\0\0\3SELECT `main`.`value_id`, `"..., 976, MSG_DONTWAIT, NULL, 0) = 976
sendto(5, "\314\3\0\0\3SELECT `main`.`value_id`, `"..., 976, MSG_DONTWAIT, NULL, 0) = 976
sendto(5, "\270\1\0\0\3SELECT `def`.*, IF(store.us"..., 444, MSG_DONTWAIT, NULL, 0) = 444
sendto(5, "(\2\0\0\3SELECT `main_table`.*, `tdv"..., 556, MSG_DONTWAIT, NULL, 0) = 556
sendto(5, "h\4\0\0\3SELECT `entity`.`sku`, `sup"..., 1132, MSG_DONTWAIT, NULL, 0) = 1132
open("/home/xxx/www/vendor/magento/module-grouped-import-export/Model/Export/RowCustomizer.php", O_RDONLY) = 8
open("/home/xxx/www/vendor/magento/module-grouped-import-export/Model/Export/RowCustomizer.php", O_RDONLY) = 8

@katmoon katmoon added the MX label Feb 1, 2016

@robfico

This comment has been minimized.

Show comment
Hide comment
@robfico

robfico Feb 1, 2016

Contributor

Some additional information if it helps. The store has only simple and configurable products. It did have grouped products in the past, but they were all deleted. Maybe this is what triggers the bug?

Contributor

robfico commented Feb 1, 2016

Some additional information if it helps. The store has only simple and configurable products. It did have grouped products in the past, but they were all deleted. Maybe this is what triggers the bug?

@kandy

This comment has been minimized.

Show comment
Hide comment
@kandy

kandy Feb 3, 2016

Contributor

Thanks for reporting.
We have created ticket MAGETWO-48721 to for timeout issue and MAGETWO-48722 for performance improvment

Contributor

kandy commented Feb 3, 2016

Thanks for reporting.
We have created ticket MAGETWO-48721 to for timeout issue and MAGETWO-48722 for performance improvment

@KrystynaKabannyk

This comment has been minimized.

Show comment
Hide comment
@KrystynaKabannyk

KrystynaKabannyk Apr 29, 2016

Hello @robfico, the reported issues have been fixed in 2.0.5 patch release that's why I'm closing the issue. Thanks for your help! If you have additional questions or information feel free to create another issue!

KrystynaKabannyk commented Apr 29, 2016

Hello @robfico, the reported issues have been fixed in 2.0.5 patch release that's why I'm closing the issue. Thanks for your help! If you have additional questions or information feel free to create another issue!

@rqsakai

This comment has been minimized.

Show comment
Hide comment
@rqsakai

rqsakai Sep 15, 2016

Same issue on 2.0.7 with a 25k catalog of all simple products

rqsakai commented Sep 15, 2016

Same issue on 2.0.7 with a 25k catalog of all simple products

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment