OLD-3885: CSV Exceeds shared hosting script processing time #76

cpaschen · 2012-10-21T19:45:24Z

Description

The CSV import feature takes too long to run even with a small import file. I have tried with 50 records on a Hostgator shared server which times out scripts at 30 seconds and the script errors out

History

#13 Updated by Chris DioscouriChris Paschen. 5 months ago

The CSV importer, as well as a number of internal queries have been updated (at least once, some more than once) since this ticket was originally created.
In attempting smaller imports (25ish) this doesn't appear to be a problem any longer.

If anyone is still having problems importing larger CSV files please reply here (and post your CSV file so we can test if possible) [However, be aware that files posted here are available to the public.]

If we don't hear form anyone on this within the next few weeks I'm going to close this as resolved.

#12 Updated by Chris DioscouriChris Paschen. 8 months ago

Target version changed from Version 0.9.9 - Misc Bug Fixes and New Features to Version 0.9.4 - Plugin Testing and Finalization

#11 Updated by Chris DioscouriChris Paschen. 9 months ago

Status changed from New to Unconfirmed
Assignee deleted (Daniele Rosario)

#10 Updated by Chris DioscouriChris Paschen. about 1 year ago

Target version changed from Version 0.8.1 - Bug Fixes to Version 0.9.9 - Misc Bug Fixes and New Features

#9 Updated by Chris DioscouriChris Paschen. about 1 year ago

Great. Thanks!

#8 Updated by Iain Mace about 1 year ago

Hi Chris, My apologies - i originally added in here simply because i thought it could be done in tandem with the task... I should have known better - sorry!! Have added new Feature request #6061
Thanks, Iain

#7 Updated by Chris DioscouriChris Paschen. about 1 year ago

Affects Template Files set to No

Iain,

Your topic doesn't relate to this ticket.
If you want this to be considered, please create a new ticket as a feature request.

#6 Updated by Iain Mace about 1 year ago

Guys - when you start work on the csv import tool PLEASE could you add a TAX column (similar to the shipping column). We have a number of products (like books) which are not Taxable in the UK - that gives us the headache of having to sift through the catalog and manually open the products that are not taxable. Thanks

#5 Updated by Rafael Diaz-Tushman almost 2 years ago

Assignee set to Daniele Rosario

Another one for the CSV Import tool.

#4 Updated by Rafael Diaz-Tushman almost 2 years ago

Category set to Admin - Data Import/Export
Priority changed from High to Normal
Target version set to Version 0.8.1 - Bug Fixes

#3 Updated by Ken Lyle almost 2 years ago

I claim no coding chops, but it appears that the state of the art in managing big, long-running processes in bite-sized chunks is Mr. Nicolas D***********s, of AkeebaBackup fame. I expect this should be a trivial assignment for him, and if not, I would be curious to understand why not.

#2 Updated by Michael Kesterton almost 2 years ago

I have done some more tests. If the CSV file has 200 records it will add 4 records before 30 second execution timeout.