How to deal with very very large dataset?

[b-y-f]

we have id 1-80,000 and each id is associated with 30,000 rows of data. I guess this will take ages to finish with tsfresh

[nils-braun]

I have given some advice in the issue you created #1005.
In short: use another extractor setting, chunk up the data into windows (because some extractors do not scale linearly with the number of rows) or use a computing cluster/batch system.
Let's continue the discussion on the issue.