Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

upload gets stuck when "parallel" on Windows #1323

Closed
yarikoptic opened this issue Aug 22, 2023 · 1 comment
Closed

upload gets stuck when "parallel" on Windows #1323

yarikoptic opened this issue Aug 22, 2023 · 1 comment

Comments

@yarikoptic
Copy link
Member

this might be a duplicate of a ghost (I can't see it - says doesn't exit) issue #1321 by @ZhuJiaBCM (also according to github - non existing account for me but does provide hyperlink and details with name and location to confirm my sanity... filed a support issue). From an email correspondence:

As I told in slack, the upload succeeded by running :
'set DANDI_DEVEL=1', then 'dandi -l DEBUG upload --devel-debug'
The later trials for 'dandi -l DEBUG upload --J 1:1' and 'dandi -l DEBUG
upload --J 1:5' worked,
'dandi -l DEBUG upload --J 5:1' and 'dandi -l DEBUG upload --J 5:5' got
stuck.
As Yarik mentioned, the default uploading is 5 files at the same time-- 5
treads in parallel. So, I guess the reason I failed in previous uploading
is it can't deal multiple files at the same time.

and processes were stuck in pre-validating state. Might be something about caching by fscacher or locking... heh

@CodyCBakerPhD
Copy link
Contributor

#1321 is now visible

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Projects
None yet
Development

No branches or pull requests

2 participants