Skip to content

OOM when downloading csv on harvest.data.gov #5843

@FuhuXia

Description

@FuhuXia

Download CSV gives OOM error

[ERROR] Worker (pid:207) was sent SIGKILL! Perhaps out of memory?

How to reproduce

https://harvest.data.gov/harvest_job/7df8043f-f0df-4bc4-bdd0-3342845501c3

Sketch

It is fine for small csv
https://harvest.data.gov/harvest_job/5322fb7b-16f8-47c6-85ce-2a043e4b2198

Find out why csv generation cause this error for big csv

current RAM and Disk for the instance are 1G and 4G.

Metadata

Metadata

Assignees

No one assigned

    Labels

    Type

    No type

    Projects

    Status

    📥 Queue

    Milestone

    No milestone

    Relationships

    None yet

    Development

    No branches or pull requests

    Issue actions