403 error when uploading an embargoed Zarr asset #1709
Description
I am uploading Zarr assets to an embargoed Dandiset and am receiving 403 errors just for the Zarr assets. I have tried this a few times but no luck. I have correctly entered my API key and am an owner of the Dandiset.
@yarikoptic @CodyCBakerPhD Any ideas? Thanks.
cc @satra
Terminal output:
19:09 $ DANDI_DEVEL=1 dandi upload --allow-any-path --validation ignore .
2025-09-18 19:09:30,762 [ INFO] Found 26 files to consider
PATH SIZE ERRORS PROGRESS STATUS MESSAGE
dandiset.yaml 1.1 kB skipped should be edited...
...ld_1-epoch=82-val_loss=0.5101.ckpt 710.3 MB 0 skipped file exists
...ld_2-epoch=85-val_loss=0.4167.ckpt 710.3 MB 0 skipped file exists
...d_3-epoch=166-val_loss=0.4527.ckpt 710.3 MB 0 skipped file exists
...d_4-epoch=100-val_loss=0.3755.ckpt 710.3 MB 0 skipped file exists
...ld_5-epoch=93-val_loss=0.3843.ckpt 710.3 MB 0 skipped file exists
...inetuning_checkpoints/last-v1.ckpt 710.3 MB 0 skipped file exists
...inetuning_checkpoints/last-v2.ckpt 710.3 MB 0 skipped file exists
...inetuning_checkpoints/last-v3.ckpt 710.3 MB 0 skipped file exists
...inetuning_checkpoints/last-v4.ckpt 710.3 MB 0 skipped file exists
...n/finetuning_checkpoints/last.ckpt 710.3 MB 0 skipped file exists
...on/unet_pretrained_checkpoint.ckpt 710.3 MB 0 skipped file exists
...4_sample-IC_acq-overview_XPCT.json 77 Bytes 0 done
...mple-IC_acq-overview_XPCT.ome.zarr 89.9 GB 0 ERROR Error 403 while ...
...ple-IC_acq-zoom_chunk-01_XPCT.json 74 Bytes 0 done
...IC_acq-zoom_chunk-01_XPCT.ome.zarr pre-validating
...ple-IC_acq-zoom_chunk-02_XPCT.json 74 Bytes 0 done
...IC_acq-zoom_chunk-02_XPCT.ome.zarr pre-validating
...ple-IC_acq-zoom_chunk-03_XPCT.json 74 Bytes 0 done
...IC_acq-zoom_chunk-03_XPCT.ome.zarr 0 traversing local...
...sample-hemi_acq-overview_XPCT.json 77 Bytes 0 done
...le-hemi_acq-overview_XPCT.ome.zarr pre-validating
...e-hemi_acq-zoom_chunk-01_XPCT.json 74 Bytes 0 done
...mi_acq-zoom_chunk-01_XPCT.ome.zarr pre-validating
...e-hemi_acq-zoom_chunk-02_XPCT.json
...mi_acq-zoom_chunk-02_XPCT.ome.zarr
Summary: 97.7 GB 12 skipped 1 should be edit...
6 done 11 file exists
1 ERROR 1 Error some whi...
4 pre-validating
1 traversing loc... Portion of the log file:
2025-09-18T19:10:37+0000 [DEBUG ] dandi.support.digests 1418:140350448117440 Estimating digests for /home/kabilar/20250915/001602/sourcedata/raw/sub-I74/micr/sub-I74_sample-IC_acq-overview_XPCT.ome.zarr/0/0/28/29
2025-09-18T19:10:37+0000 [DEBUG ] dandi.support.digests 1418:140350427137728 Estimating digests for /home/kabilar/20250915/001602/sourcedata/raw/sub-I74/micr/sub-I74_sample-IC_acq-overview_XPCT.ome.zarr/0/0/28/38
2025-09-18T19:10:37+0000 [DEBUG ] urllib3.connectionpool 1418:140349761640128 https://dandiarchive.s3.amazonaws.com:443 "PUT /zarr/a620802e-e7f7-4003-bf3c-1f2f3d9239e1/4/.zarray?X-Amz-Algorithm=AWS4-HMAC-SHA256&X-Amz-Credential=AKIAUBRWC5GAEKH3223E%2F20250918%2Fus-east-2%2Fs3%2Faws4_request&X-Amz-Date=20250918T191037Z&X-Amz-Expires=21600&X-Amz-SignedHeaders=content-md5%3Bhost%3Bx-amz-tagging&X-Amz-Signature=ffe7f6bb79dd0aed9c753072c1cc48789c1df133688ed1e00eaa16211bbeff65 HTTP/1.1" 403 None
2025-09-18T19:10:37+0000 [DEBUG ] dandi.support.digests 1418:140350437627584 Estimating digests for /home/kabilar/20250915/001602/sourcedata/raw/sub-I74/micr/sub-I74_sample-IC_acq-overview_XPCT.ome.zarr/0/0/28/25
2025-09-18T19:10:37+0000 [DEBUG ] dandi 1418:140349761640128 Response: 403
2025-09-18T19:10:37+0000 [DEBUG ] urllib3.connectionpool 1418:140349599119040 https://dandiarchive.s3.amazonaws.com:443 "PUT /zarr/a620802e-e7f7-4003-bf3c-1f2f3d9239e1/3/.zarray?X-Amz-Algorithm=AWS4-HMAC-SHA256&X-Amz-Credential=AKIAUBRWC5GAEKH3223E%2F20250918%2Fus-east-2%2Fs3%2Faws4_request&X-Amz-Date=20250918T191037Z&X-Amz-Expires=21600&X-Amz-SignedHeaders=content-md5%3Bhost%3Bx-amz-tagging&X-Amz-Signature=10b8e02e62c18afca1aa08a720184564e526a385a4e1ca1e6935e094cfc007c0 HTTP/1.1" 403 None
2025-09-18T19:10:37+0000 [DEBUG ] urllib3.connectionpool 1418:140349588629184 https://dandiarchive.s3.amazonaws.com:443 "PUT /zarr/a620802e-e7f7-4003-bf3c-1f2f3d9239e1/.zattrs?X-Amz-Algorithm=AWS4-HMAC-SHA256&X-Amz-Credential=AKIAUBRWC5GAEKH3223E%2F20250918%2Fus-east-2%2Fs3%2Faws4_request&X-Amz-Date=20250918T191037Z&X-Amz-Expires=21600&X-Amz-SignedHeaders=content-md5%3Bhost%3Bx-amz-tagging&X-Amz-Signature=f8d0a6031305c96fd01fce406c70d97f2a0df9b50a6da60c9d1a843e4e9e6f55 HTTP/1.1" 403 None
2025-09-18T19:10:37+0000 [DEBUG ] charset_normalizer 1418:140349761640128 Encoding detection: utf_8 is most likely the one.
2025-09-18T19:10:37+0000 [DEBUG ] urllib3.connectionpool 1418:140349751150272 https://dandiarchive.s3.amazonaws.com:443 "PUT /zarr/a620802e-e7f7-4003-bf3c-1f2f3d9239e1/1/.zarray?X-Amz-Algorithm=AWS4-HMAC-SHA256&X-Amz-Credential=AKIAUBRWC5GAEKH3223E%2F20250918%2Fus-east-2%2Fs3%2Faws4_request&X-Amz-Date=20250918T191037Z&X-Amz-Expires=21600&X-Amz-SignedHeaders=content-md5%3Bhost%3Bx-amz-tagging&X-Amz-Signature=68ddb5a708d89f5456ff147e3d8c10d4dd27ec66613449b23633818c9103a961 HTTP/1.1" 403 None
2025-09-18T19:10:37+0000 [DEBUG ] dandi 1418:140349599119040 Response: 403
2025-09-18T19:10:37+0000 [DEBUG ] urllib3.connectionpool 1418:140349578139328 https://dandiarchive.s3.amazonaws.com:443 "PUT /zarr/a620802e-e7f7-4003-bf3c-1f2f3d9239e1/0/0/0/26?X-Amz-Algorithm=AWS4-HMAC-SHA256&X-Amz-Credential=AKIAUBRWC5GAEKH3223E%2F20250918%2Fus-east-2%2Fs3%2Faws4_request&X-Amz-Date=20250918T191037Z&X-Amz-Expires=21600&X-Amz-SignedHeaders=content-md5%3Bhost%3Bx-amz-tagging&X-Amz-Signature=0f4a56a2922a1df2b9443c6eff9d8a8b11b61b472b8124e96972489727e09a77 HTTP/1.1" 403 None
2025-09-18T19:10:37+0000 [ERROR ] dandi 1418:140349761640128 Error 403 while sending PUT request to https://dandiarchive.s3.amazonaws.com/zarr/a620802e-e7f7-4003-bf3c-1f2f3d9239e1/4/.zarray?X-Amz-Algorithm=AWS4-HMAC-SHA256&X-Amz-Credential=AKIAUBRWC5GAEKH3223E%2F20250918%2Fus-east-2%2Fs3%2Faws4_request&X-Amz-Date=20250918T191037Z&X-Amz-Expires=21600&X-Amz-SignedHeaders=content-md5%3Bhost%3Bx-amz-tagging&X-Amz-Signature=ffe7f6bb79dd0aed9c753072c1cc48789c1df133688ed1e00eaa16211bbeff65: <?xml version="1.0" encoding="UTF-8"?>
<Error><Code>AccessDenied</Code><Message>There were headers present in the request which were not signed</Message><HeadersNotSigned>x-amz-acl</HeadersNotSigned><RequestId>VABC9NQC5C262PN4</RequestId><HostId>7lc7Ut/sDgaxSVviq6ThHse7nB2wLtwHdcqjFkufL7D6uzxvhDxVgbH1ojfLkdgsb6BT/Zb/ZSWsdb+rRI87GYGs5mOhggDE59nLE0Rxp8k=</HostId></Error>
2025-09-18T19:10:37+0000 [DEBUG ] dandi.support.digests 1418:140350458607296 Estimating digests for /home/kabilar/20250915/001602/sourcedata/raw/sub-I74/micr/sub-I74_sample-IC_acq-overview_XPCT.ome.zarr/0/0/28/34
2025-09-18T19:10:37+0000 [DEBUG ] dandi 1418:140349751150272 Response: 403
2025-09-18T19:10:37+0000 [DEBUG ] charset_normalizer 1418:140349599119040 Encoding detection: utf_8 is most likely the one.
2025-09-18T19:10:37+0000 [DEBUG ] dandi 1418:140349588629184 Response: 403
2025-09-18T19:10:37+0000 [DEBUG ] dandi.support.digests 1418:140350427137728 Estimating digests for /home/kabilar/20250915/001602/sourcedata/raw/sub-I74/micr/sub-I74_sample-IC_acq-overview_XPCT.ome.zarr/0/0/28/7
2025-09-18T19:10:37+0000 [DEBUG ] dandi.support.digests 1418:140350437627584 Estimating digests for /home/kabilar/20250915/001602/sourcedata/raw/sub-I74/micr/sub-I74_sample-IC_acq-overview_XPCT.ome.zarr/0/0/28/16
2025-09-18T19:10:37+0000 [DEBUG ] dandi.support.digests 1418:140350513718976 Estimating digests for /home/kabilar/20250915/001602/sourcedata/raw/sub-I74/micr/sub-I74_sample-IC_acq-overview_XPCT.ome.zarr/0/0/19/0
2025-09-18T19:10:37+0000 [DEBUG ] charset_normalizer 1418:140349761640128 Encoding detection: utf_8 is most likely the one.
2025-09-18T19:10:37+0000 [DEBUG ] dandi.support.digests 1418:140350448117440 Estimating digests for /home/kabilar/20250915/001602/sourcedata/raw/sub-I74/micr/sub-I74_sample-IC_acq-overview_XPCT.ome.zarr/0/0/19/26
2025-09-18T19:10:37+0000 [DEBUG ] dandi 1418:140349578139328 Response: 403
2025-09-18T19:10:37+0000 [DEBUG ] charset_normalizer 1418:140349751150272 Encoding detection: utf_8 is most likely the one.
2025-09-18T19:10:37+0000 [ERROR ] dandi 1418:140349599119040 Error 403 while sending PUT request to https://dandiarchive.s3.amazonaws.com/zarr/a620802e-e7f7-4003-bf3c-1f2f3d9239e1/3/.zarray?X-Amz-Algorithm=AWS4-HMAC-SHA256&X-Amz-Credential=AKIAUBRWC5GAEKH3223E%2F20250918%2Fus-east-2%2Fs3%2Faws4_request&X-Amz-Date=20250918T191037Z&X-Amz-Expires=21600&X-Amz-SignedHeaders=content-md5%3Bhost%3Bx-amz-tagging&X-Amz-Signature=10b8e02e62c18afca1aa08a720184564e526a385a4e1ca1e6935e094cfc007c0: <?xml version="1.0" encoding="UTF-8"?>
<Error><Code>AccessDenied</Code><Message>There were headers present in the request which were not signed</Message><HeadersNotSigned>x-amz-acl</HeadersNotSigned><RequestId>VABFQAGWYXJZA5H6</RequestId><HostId>4m/zUGUFP7dqEFTtT0a/e6wNC2mDpZrL8u5RouG9LCFtiyowFM9q+Or6VUFyist1fjy2Egca+mztnl+F8qkiUI83RWc7XYOWZkUiX5CKGmk=</HostId></Error>
2025-09-18T19:10:37+0000 [DEBUG ] charset_normalizer 1418:140349588629184 Encoding detection: utf_8 is most likely the one.
2025-09-18T19:10:37+0000 [DEBUG ] charset_normalizer 1418:140349761640128 Encoding detection: utf_8 is most likely the one.
2025-09-18T19:10:37+0000 [DEBUG ] charset_normalizer 1418:140349578139328 Encoding detection: utf_8 is most likely the one.
2025-09-18T19:10:37+0000 [ERROR ] dandi 1418:140349751150272 Error 403 while sending PUT request to https://dandiarchive.s3.amazonaws.com/zarr/a620802e-e7f7-4003-bf3c-1f2f3d9239e1/1/.zarray?X-Amz-Algorithm=AWS4-HMAC-SHA256&X-Amz-Credential=AKIAUBRWC5GAEKH3223E%2F20250918%2Fus-east-2%2Fs3%2Faws4_request&X-Amz-Date=20250918T191037Z&X-Amz-Expires=21600&X-Amz-SignedHeaders=content-md5%3Bhost%3Bx-amz-tagging&X-Amz-Signature=68ddb5a708d89f5456ff147e3d8c10d4dd27ec66613449b23633818c9103a961: <?xml version="1.0" encoding="UTF-8"?>
<Error><Code>AccessDenied</Code><Message>There were headers present in the request which were not signed</Message><HeadersNotSigned>x-amz-acl</HeadersNotSigned><RequestId>VABE48QJNMTY8GVN</RequestId><HostId>JzDiuGfQQMkaQ1QfhXHjnin3Kir192u97i744T28sPK9h/UyvVhKroN4fB8Zr9Hx9OFZOGjHrQlfaY9taYlE1uaeUGa+BnsZmrmbiYIZxvs=</HostId></Error>
2025-09-18T19:10:37+0000 [DEBUG ] dandi.support.digests 1418:140350458607296 Estimating digests for /home/kabilar/20250915/001602/sourcedata/raw/sub-I74/micr/sub-I74_sample-IC_acq-overview_XPCT.ome.zarr/0/0/19/35
2025-09-18T19:10:37+0000 [DEBUG ] charset_normalizer 1418:140349599119040 Encoding detection: utf_8 is most likely the one.
2025-09-18T19:10:37+0000 [ERROR ] dandi 1418:140349588629184 Error 403 while sending PUT request to https://dandiarchive.s3.amazonaws.com/zarr/a620802e-e7f7-4003-bf3c-1f2f3d9239e1/.zattrs?X-Amz-Algorithm=AWS4-HMAC-SHA256&X-Amz-Credential=AKIAUBRWC5GAEKH3223E%2F20250918%2Fus-east-2%2Fs3%2Faws4_request&X-Amz-Date=20250918T191037Z&X-Amz-Expires=21600&X-Amz-SignedHeaders=content-md5%3Bhost%3Bx-amz-tagging&X-Amz-Signature=f8d0a6031305c96fd01fce406c70d97f2a0df9b50a6da60c9d1a843e4e9e6f55: <?xml version="1.0" encoding="UTF-8"?>
<Error><Code>AccessDenied</Code><Message>There were headers present in the request which were not signed</Message><HeadersNotSigned>x-amz-acl</HeadersNotSigned><RequestId>VABFFS283083XBKE</RequestId><HostId>StqlLepVy0HV0dzuh8mRqpaC5bDuny5D8RsGGC5t8AR7Zk8w11/gHlVFYWzFoeVHoz0M3hSu3tZiRgQKGvHqE4NWAr+BHmvwHdHZsgGdelg=</HostId></Error>
2025-09-18T19:10:37+0000 [ERROR ] dandi 1418:140349578139328 Error 403 while sending PUT request to https://dandiarchive.s3.amazonaws.com/zarr/a620802e-e7f7-4003-bf3c-1f2f3d9239e1/0/0/0/26?X-Amz-Algorithm=AWS4-HMAC-SHA256&X-Amz-Credential=AKIAUBRWC5GAEKH3223E%2F20250918%2Fus-east-2%2Fs3%2Faws4_request&X-Amz-Date=20250918T191037Z&X-Amz-Expires=21600&X-Amz-SignedHeaders=content-md5%3Bhost%3Bx-amz-tagging&X-Amz-Signature=0f4a56a2922a1df2b9443c6eff9d8a8b11b61b472b8124e96972489727e09a77: <?xml version="1.0" encoding="UTF-8"?>
<Error><Code>AccessDenied</Code><Message>There were headers present in the request which were not signed</Message><HeadersNotSigned>x-amz-acl</HeadersNotSigned><RequestId>VABF8S9HSN4ZBDY1</RequestId><HostId>Z5CCeEVXSPPvaUtKfdSm+MR9CrFkvzpynMhAgNKOqsVlsgr/8B6JB/Ys6YPFLxHxg3epoWTX+r4vD7H0t+mcigTdXuQ54NUcEPIwYeojQKc=</HostId></Error>
2025-09-18T19:10:37+0000 [DEBUG ] charset_normalizer 1418:140349751150272 Encoding detection: utf_8 is most likely the one.
2025-09-18T19:10:37+0000 [DEBUG ] dandi.support.digests 1418:140350437627584 Estimating digests for /home/kabilar/20250915/001602/sourcedata/raw/sub-I74/micr/sub-I74_sample-IC_acq-overview_XPCT.ome.zarr/0/0/19/8
2025-09-18T19:10:37+0000 [DEBUG ] charset_normalizer 1418:140349599119040 Encoding detection: utf_8 is most likely the one.
2025-09-18T19:10:37+0000 [DEBUG ] dandi.support.digests 1418:140350427137728 Estimating digests for /home/kabilar/20250915/001602/sourcedata/raw/sub-I74/micr/sub-I74_sample-IC_acq-overview_XPCT.ome.zarr/0/0/19/17
2025-09-18T19:10:37+0000 [DEBUG ] charset_normalizer 1418:140349588629184 Encoding detection: utf_8 is most likely the one.
2025-09-18T19:10:37+0000 [DEBUG ] dandi 1418:140350477768384 Error uploading zarr: HTTPError: Error 403 while sending PUT request to https://dandiarchive.s3.amazonaws.com/zarr/a620802e-e7f7-4003-bf3c-1f2f3d9239e1/4/.zarray?X-Amz-Algorithm=AWS4-HMAC-SHA256&X-Amz-Credential=AKIAUBRWC5GAEKH3223E%2F20250918%2Fus-east-2%2Fs3%2Faws4_request&X-Amz-Date=20250918T191037Z&X-Amz-Expires=21600&X-Amz-SignedHeaders=content-md5%3Bhost%3Bx-amz-tagging&X-Amz-Signature=ffe7f6bb79dd0aed9c753072c1cc48789c1df133688ed1e00eaa16211bbeff65: <?xml version="1.0" encoding="UTF-8"?>
<Error><Code>AccessDenied</Code><Message>There were headers present in the request which were not signed</Message><HeadersNotSigned>x-amz-acl</HeadersNotSigned><RequestId>VABC9NQC5C262PN4</RequestId><HostId>7lc7Ut/sDgaxSVviq6ThHse7nB2wLtwHdcqjFkufL7D6uzxvhDxVgbH1ojfLkdgsb6BT/Zb/ZSWsdb+rRI87GYGs5mOhggDE59nLE0Rxp8k=</HostId></Error>
2025-09-18T19:10:37+0000 [DEBUG ] charset_normalizer 1418:140349578139328 Encoding detection: utf_8 is most likely the one.
2025-09-18T19:10:37+0000 [DEBUG ] charset_normalizer 1418:140349751150272 Encoding detection: utf_8 is most likely the one.
2025-09-18T19:10:37+0000 [DEBUG ] dandi 1418:140349761640128 PUT https://dandiarchive.s3.amazonaws.com/zarr/a620802e-e7f7-4003-bf3c-1f2f3d9239e1/0/0/0/8?X-Amz-Algorithm=AWS4-HMAC-SHA256&X-Amz-Credential=AKIAUBRWC5GAEKH3223E%2F20250918%2Fus-east-2%2Fs3%2Faws4_request&X-Amz-Date=20250918T191037Z&X-Amz-Expires=21600&X-Amz-SignedHeaders=content-md5%3Bhost%3Bx-amz-tagging&X-Amz-Signature=2aa20299a9003bb671f778c6e604e88dc660fa28354f4dd313e234f68e165957
2025-09-18T19:10:37+0000 [DEBUG ] charset_normalizer 1418:140349588629184 Encoding detection: utf_8 is most likely the one.
2025-09-18T19:10:37+0000 [DEBUG ] dandi 1418:140350477768384 Cancelling upload
2025-09-18T19:10:37+0000 [DEBUG ] charset_normalizer 1418:140349578139328 Encoding detection: utf_8 is most likely the one.
2025-09-18T19:10:37+0000 [DEBUG ] urllib3.connectionpool 1418:140349761640128 Resetting dropped connection: dandiarchive.s3.amazonaws.com
2025-09-18T19:10:37+0000 [DEBUG ] dandi 1418:140349599119040 PUT https://dandiarchive.s3.amazonaws.com/zarr/a620802e-e7f7-4003-bf3c-1f2f3d9239e1/0/.zarray?X-Amz-Algorithm=AWS4-HMAC-SHA256&X-Amz-Credential=AKIAUBRWC5GAEKH3223E%2F20250918%2Fus-east-2%2Fs3%2Faws4_request&X-Amz-Date=20250918T191037Z&X-Amz-Expires=21600&X-Amz-SignedHeaders=content-md5%3Bhost%3Bx-amz-tagging&X-Amz-Signature=e571fa63134dcc73459ee8d9690b61da38476ca1d619fcc4f7e63d8a21c440c3
2025-09-18T19:10:37+0000 [DEBUG ] urllib3.connectionpool 1418:140349599119040 Resetting dropped connection: dandiarchive.s3.amazonaws.com
2025-09-18T19:10:37+0000 [DEBUG ] dandi.support.digests 1418:140350513718976 Estimating digests for /home/kabilar/20250915/001602/sourcedata/raw/sub-I74/micr/sub-I74_sample-IC_acq-overview_XPCT.ome.zarr/0/0/19/22
2025-09-18T19:10:37+0000 [DEBUG ] dandi.support.digests 1418:140350448117440 Estimating digests for /home/kabilar/20250915/001602/sourcedata/raw/sub-I74/micr/sub-I74_sample-IC_acq-overview_XPCT.ome.zarr/0/0/19/31
2025-09-18T19:10:37+0000 [DEBUG ] dandi.support.digests 1418:140350458607296 Estimating digests for /home/kabilar/20250915/001602/sourcedata/raw/sub-I74/micr/sub-I74_sample-IC_acq-overview_XPCT.ome.zarr/0/0/19/4
2025-09-18T19:10:37+0000 [DEBUG ] dandi.support.digests 1418:140350437627584 Estimating digests for /home/kabilar/20250915/001602/sourcedata/raw/sub-I74/micr/sub-I74_sample-IC_acq-overview_XPCT.ome.zarr/0/0/19/13
2025-09-18T19:10:37+0000 [DEBUG ] dandi.support.digests 1418:140350427137728 Estimating digests for /home/kabilar/20250915/001602/sourcedata/raw/sub-I74/micr/sub-I74_sample-IC_acq-overview_XPCT.ome.zarr/0/0/19/39
2025-09-18T19:10:37+0000 [DEBUG ] dandi.support.digests 1418:140350513718976 Estimating digests for /home/kabilar/20250915/001602/sourcedata/raw/sub-I74/micr/sub-I74_sample-IC_acq-overview_XPCT.ome.zarr/0/0/19/20
2025-09-18T19:10:37+0000 [DEBUG ] dandi.support.digests 1418:140350448117440 Estimating digests for /home/kabilar/20250915/001602/sourcedata/raw/sub-I74/micr/sub-I74_sample-IC_acq-overview_XPCT.ome.zarr/0/0/19/2
2025-09-18T19:10:37+0000 [DEBUG ] urllib3.connectionpool 1418:140349599119040 https://dandiarchive.s3.amazonaws.com:443 "PUT /zarr/a620802e-e7f7-4003-bf3c-1f2f3d9239e1/0/.zarray?X-Amz-Algorithm=AWS4-HMAC-SHA256&X-Amz-Credential=AKIAUBRWC5GAEKH3223E%2F20250918%2Fus-east-2%2Fs3%2Faws4_request&X-Amz-Date=20250918T191037Z&X-Amz-Expires=21600&X-Amz-SignedHeaders=content-md5%3Bhost%3Bx-amz-tagging&X-Amz-Signature=e571fa63134dcc73459ee8d9690b61da38476ca1d619fcc4f7e63d8a21c440c3 HTTP/1.1" 403 None
2025-09-18T19:10:37+0000 [DEBUG ] dandi 1418:140349599119040 Response: 403
2025-09-18T19:10:37+0000 [DEBUG ] charset_normalizer 1418:140349599119040 Encoding detection: utf_8 is most likely the one.
2025-09-18T19:10:37+0000 [ERROR ] dandi 1418:140349599119040 Error 403 while sending PUT request to https://dandiarchive.s3.amazonaws.com/zarr/a620802e-e7f7-4003-bf3c-1f2f3d9239e1/0/.zarray?X-Amz-Algorithm=AWS4-HMAC-SHA256&X-Amz-Credential=AKIAUBRWC5GAEKH3223E%2F20250918%2Fus-east-2%2Fs3%2Faws4_request&X-Amz-Date=20250918T191037Z&X-Amz-Expires=21600&X-Amz-SignedHeaders=content-md5%3Bhost%3Bx-amz-tagging&X-Amz-Signature=e571fa63134dcc73459ee8d9690b61da38476ca1d619fcc4f7e63d8a21c440c3: <?xml version="1.0" encoding="UTF-8"?>
<Error><Code>AccessDenied</Code><Message>There were headers present in the request which were not signed</Message><HeadersNotSigned>x-amz-acl</HeadersNotSigned><RequestId>VAB42KCTYHPKDAEK</RequestId><HostId>Fp3b7y4xWNrCiD+P562RDE2kHHtGxteguLw///KU+G8COcdRT+9l5lf809lbeWJXwwqxnQkOOqU=</HostId></Error>
2025-09-18T19:10:37+0000 [DEBUG ] charset_normalizer 1418:140349599119040 Encoding detection: utf_8 is most likely the one.
2025-09-18T19:10:37+0000 [DEBUG ] charset_normalizer 1418:140349599119040 Encoding detection: utf_8 is most likely the one.
2025-09-18T19:10:37+0000 [DEBUG ] urllib3.connectionpool 1418:140349761640128 https://dandiarchive.s3.amazonaws.com:443 "PUT /zarr/a620802e-e7f7-4003-bf3c-1f2f3d9239e1/0/0/0/8?X-Amz-Algorithm=AWS4-HMAC-SHA256&X-Amz-Credential=AKIAUBRWC5GAEKH3223E%2F20250918%2Fus-east-2%2Fs3%2Faws4_request&X-Amz-Date=20250918T191037Z&X-Amz-Expires=21600&X-Amz-SignedHeaders=content-md5%3Bhost%3Bx-amz-tagging&X-Amz-Signature=2aa20299a9003bb671f778c6e604e88dc660fa28354f4dd313e234f68e165957 HTTP/1.1" 403 None
2025-09-18T19:10:37+0000 [DEBUG ] dandi 1418:140349761640128 Response: 403
2025-09-18T19:10:37+0000 [DEBUG ] dandi.support.digests 1418:140350458607296 Estimating digests for /home/kabilar/20250915/001602/sourcedata/raw/sub-I74/micr/sub-I74_sample-IC_acq-overview_XPCT.ome.zarr/0/0/19/11
2025-09-18T19:10:37+0000 [DEBUG ] charset_normalizer 1418:140349761640128 Encoding detection: utf_8 is most likely the one.
2025-09-18T19:10:37+0000 [ERROR ] dandi 1418:140349761640128 Error 403 while sending PUT request to https://dandiarchive.s3.amazonaws.com/zarr/a620802e-e7f7-4003-bf3c-1f2f3d9239e1/0/0/0/8?X-Amz-Algorithm=AWS4-HMAC-SHA256&X-Amz-Credential=AKIAUBRWC5GAEKH3223E%2F20250918%2Fus-east-2%2Fs3%2Faws4_request&X-Amz-Date=20250918T191037Z&X-Amz-Expires=21600&X-Amz-SignedHeaders=content-md5%3Bhost%3Bx-amz-tagging&X-Amz-Signature=2aa20299a9003bb671f778c6e604e88dc660fa28354f4dd313e234f68e165957: <?xml version="1.0" encoding="UTF-8"?>
<Error><Code>AccessDenied</Code><Message>There were headers present in the request which were not signed</Message><HeadersNotSigned>x-amz-acl</HeadersNotSigned><RequestId>VABFRJEFMP9NWQDW</RequestId><HostId>4/PyuCIuIrcdZHcKbAeRX/Kk5z0y6PVwCdN28DROH+hKJskwT7ke6UuQA92eOznTKK/jTGnF3Vg=</HostId></Error>
2025-09-18T19:10:37+0000 [DEBUG ] charset_normalizer 1418:140349761640128 Encoding detection: utf_8 is most likely the one.
2025-09-18T19:10:37+0000 [DEBUG ] charset_normalizer 1418:140349761640128 Encoding detection: utf_8 is most likely the one.
2025-09-18T19:10:37+0000 [DEBUG ] dandi.support.digests 1418:140350427137728 Estimating digests for /home/kabilar/20250915/001602/sourcedata/raw/sub-I74/micr/sub-I74_sample-IC_acq-overview_XPCT.ome.zarr/0/0/19/28
2025-09-18T19:10:37+0000 [DEBUG ] dandi.support.digests 1418:140350437627584 Estimating digests for /home/kabilar/20250915/001602/sourcedata/raw/sub-I74/micr/sub-I74_sample-IC_acq-overview_XPCT.ome.zarr/0/0/19/37
2025-09-18T19:10:37+0000 [ERROR ] dandi 1418:140350477768384 Error uploading /home/kabilar/20250915/001602/sourcedata/raw/sub-I74/micr/sub-I74_sample-IC_acq-overview_XPCT.ome.zarr:
Traceback (most recent call last):
File "/home/conda/nebari-git/1435a3fc-1752013420-36-dandi/lib/python3.12/site-packages/dandi/upload.py", line 359, in process_path
for r in dfile.iter_upload(
File "/home/conda/nebari-git/1435a3fc-1752013420-36-dandi/lib/python3.12/site-packages/dandi/files/zarr.py", line 748, in iter_upload
size = fut.result()
^^^^^^^^^^^^
File "/home/conda/nebari-git/1435a3fc-1752013420-36-dandi/lib/python3.12/concurrent/futures/_base.py", line 449, in result
return self.__get_result()
^^^^^^^^^^^^^^^^^^^
File "/home/conda/nebari-git/1435a3fc-1752013420-36-dandi/lib/python3.12/concurrent/futures/_base.py", line 401, in __get_result
raise self._exception
File "/home/conda/nebari-git/1435a3fc-1752013420-36-dandi/lib/python3.12/concurrent/futures/thread.py", line 58, in run
result = self.fn(*self.args, **self.kwargs)
^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
File "/home/conda/nebari-git/1435a3fc-1752013420-36-dandi/lib/python3.12/site-packages/dandi/files/zarr.py", line 829, in _upload_zarr_file
storage_session.put(
File "/home/conda/nebari-git/1435a3fc-1752013420-36-dandi/lib/python3.12/site-packages/dandi/dandiapi.py", line 323, in put
return self.request("PUT", path, **kwargs)
^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
File "/home/conda/nebari-git/1435a3fc-1752013420-36-dandi/lib/python3.12/site-packages/dandi/dandiapi.py", line 287, in request
raise requests.HTTPError(msg, response=result)
requests.exceptions.HTTPError: Error 403 while sending PUT request to https://dandiarchive.s3.amazonaws.com/zarr/a620802e-e7f7-4003-bf3c-1f2f3d9239e1/4/.zarray?X-Amz-Algorithm=AWS4-HMAC-SHA256&X-Amz-Credential=AKIAUBRWC5GAEKH3223E%2F20250918%2Fus-east-2%2Fs3%2Faws4_request&X-Amz-Date=20250918T191037Z&X-Amz-Expires=21600&X-Amz-SignedHeaders=content-md5%3Bhost%3Bx-amz-tagging&X-Amz-Signature=ffe7f6bb79dd0aed9c753072c1cc48789c1df133688ed1e00eaa16211bbeff65: <?xml version="1.0" encoding="UTF-8"?>
<Error><Code>AccessDenied</Code><Message>There were headers present in the request which were not signed</Message><HeadersNotSigned>x-amz-acl</HeadersNotSigned><RequestId>VABC9NQC5C262PN4</RequestId><HostId>7lc7Ut/sDgaxSVviq6ThHse7nB2wLtwHdcqjFkufL7D6uzxvhDxVgbH1ojfLkdgsb6BT/Zb/ZSWsdb+rRI87GYGs5mOhggDE59nLE0Rxp8k=</HostId></Error>