Stream CSV file reading & SQL file writing

[Vikram0118]

The CSV file can get very huge. So, depending on the size of your CSV file, we might want to consider streaming the file instead of reading the entire content into memory.

[gitdagray]

This is a good idea!! 💯

[Vikram0118]

Processing them sequentially might lead to performance bottlenecks. Parallelizing the processing of multiple rows simultaneously can significantly improve overall performance. I once came across promise.all() for a project doing parallel reading. we can add that.