mongodb hanging on 1 million rows

[deeTEEcee]

trying to insert 1 million rows into mongodb but it hangs

[emirozer]

hmm, okay I guess at the time of developing this tool i did not consider huge inserts.
Merely chunking the data for multi insert should make it not hang but its just a gut feeling.
I will take a look in the upcoming days.

[deeTEEcee]

haha no problem. my use case right now is im trying to figure out how to handle mass deletion and how i should split it into different jobs, how long it takes to delete x records. just researching here and there for that.

[JacobHZ]

I also have this problem,when use mysql and insert 30000rows,log appears "Lost connection to MySQL server at '127.0.0.1:3306', system error: 32 Broken pipe".

[emirozer]

Ok for 30k rows this should absolutely not happen. I can investigate this in the coming week.
@JacobHZ would you mind sharing your system details (os / mem / python version)

[JacobHZ]

@emirozer
system details:
macOS High Sierra 10.13.4
memory：8GB 1600 MHz DDR3
python version：3.6.0
mysql version: mysql Ver 14.14 Distrib 5.7.21, for osx10.13 (x86_64) using EditLine wrapper