What is the recommended way to export huge data (1Lac plus rows).

[gopalvirat]

Problem:

What is the recommended way to export huge data (1 Lac plus rows).
As the data will be processing line by line, what is the best possible way to handle this.

[JordanVerasamy]

There's really no way to avoid making 1 API call per customer -- the Magento SOAP API does not support bulk retrieval of customer info. You have to get customer metadata in bulk and then make 1 call per customer to get the detailed data.

Are you getting timeouts? Or is it just slow and you wish it was faster?

[gopalvirat]

@JordanVerasamy currently getting no timeouts. It is just slow and I want it to be a little faster.

[surajreddy]

@gopalvirat I've created a feature request based on this to retrieve data in parallel: #66