Skip to content

OOM error on large JSON files #14337

Description

@aduh95

I did this

curl --config - <<'EOF'
request = "POST"
fail-with-body
verbose
show-error
url = "http://172.16.22.1:12507/"
header = "Expect:"
insecure
max-time = "300"
data-urlencode = "transloadit@/path/to/data.json"
globoff
create-dirs
max-redirs = "5"
max-filesize = "128849018880"
EOF

I'd rather not share data.json, but I can disclose it's a 16M JSON file.

I expected the following

Note: Unnecessary use of -X or --request, POST is already inferred.
*   Trying 172.16.22.1:12507...

Instead got curl: <stdin>:9: 'data-urlencode' out of memory

curl/libcurl version

git bisect pointed me to f37840a. I can confirm that reverting this commit does solve the issue for me.

operating system

Reproduced with macOS 14.5 and Linux 6.8.0

Activity

  1. bagder commented on Aug 1, 2024

    @bagder
    Member

    Hm, right. It stops at 8MB now...

  2. self-assigned this
    on Aug 1, 2024
  3. bagder commented on Aug 1, 2024

    @bagder
    Member

    I'll fix

  4. added a commit that references this issue on Aug 2, 2024
    1f61db5
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment

Metadata

Metadata

Assignees

Type

No type

Projects

No projects

    Milestone

    No milestone

    Relationships

    None yet

    Development

    No branches or pull requests

    Issue actions