Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

--skip-existing doesn't work with globbing in parallel mode #15261

Closed
tobwen opened this issue Oct 11, 2024 · 0 comments
Closed

--skip-existing doesn't work with globbing in parallel mode #15261

tobwen opened this issue Oct 11, 2024 · 0 comments
Assignees

Comments

@tobwen
Copy link

tobwen commented Oct 11, 2024

I did this

# initial download
curl --create-dirs --output 'test/123_#1.json' --url 'https://httpbin.org/get?[1-3]'
sleep 60

# added `--skip-existing`
curl --create-dirs --output 'test/123_#1.json' --url 'https://httpbin.org/get?[1-3]' --skip-existing 
sleep 60

# added `--parallel`
curl --create-dirs --output 'test/123_#1.json' --url 'https://httpbin.org/get?[1-3]' --skip-existing --parallel

I expected the following

I expected curl to skip existing files in --parallel mode, like in sequential mode, but parallel overwrites the files instead of skipping them.

curl/libcurl version

curl 8.10.1 (x86_64-pc-linux-musl) libcurl/8.10.1 OpenSSL/3.1.7 zlib/1.3.1 libssh2/1.11.0 nghttp2/1.58.0
Release-Date: 2024-09-18
Protocols: dict file ftp ftps gopher gophers http https imap imaps ipfs ipns mqtt pop3 pop3s rtsp scp sftp smb smbs smtp smtps telnet tftp
Features: alt-svc AsynchDNS HSTS HTTP2 HTTPS-proxy IPv6 Largefile libz NTLM SSL threadsafe TLS-SRP UnixSockets

operating system

Linux 6.10.9-1-liquorix-amd64 #1 ZEN SMP PREEMPT liquorix 6.10-11.1~bookworm (2024-09-08) x86_64 GNU/Linux
@bagder bagder self-assigned this Oct 11, 2024
bagder added a commit that referenced this issue Oct 13, 2024
@bagder bagder closed this as completed in 69bf530 Oct 13, 2024
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Development

Successfully merging a pull request may close this issue.

3 participants