insite1@img1-ingester:/opt/insiteone/python> ./cloudRetrieveBasic.py --inputfile /tmp/doRetrieve.medstar/flist.oneperline --workers 1 --gcs_key_file /opt/insiteone/index/gcs-keyfile.json --bucketname medstar-test-archive-bucket --destdir /tmp Loading work queue... Added PK2F00ET.018 to work queue Added 0 items to work queue Starting file retrieval send: b'POST /token HTTP/1.1\r\nHost: oauth2.googleapis.com\r\nAccept-Encoding: gzip, deflate\r\nAccept: */*\r\nConnection: keep-alive\r\nUser-Agent: python-requests/2.21.0\r\ncontent-type: application/x-www-form-urlencoded\r\nContent-Length: 827\r\n\r\ngrant_type=urn%3Aietf%3Aparams%3Aoauth%3Agrant-type%3Ajwt-bearer&assertion=eyJ0eXAiOiAiSldUIiwgImtpZCI6ICJhNWMzY2JjMWJiYTYzYTFiZjM1NzdlYzNmMzFjMmQzNmM4ODUwZWExIiwgImFsZyI6ICJSUzI1NiJ9.eyJhdWQiOiAiaHR0cHM6Ly9vYXV0aDIuZ29vZ2xlYXBpcy5jb20vdG9rZW4iLCAiaXNzIjogIm1lZHN0YXItdGVzdC1zZXJ2aWNlYWNjb3VudEBtZWRzdGFyLXRlc3QtMjY0NjE1LmlhbS5nc2VydmljZWFjY291bnQuY29tIiwgImV4cCI6IDE1ODIyMjU0MTUsICJzY29wZSI6ICJodHRwczovL3d3dy5nb29nbGVhcGlzLmNvbS9hdXRoL2Nsb3VkLXBsYXRmb3JtIiwgImlhdCI6IDE1ODIyMjE4MTV9.aCbwtQGumrAZICIHSm-xcDS_LWmm-ha7G2ZCKG_7ZAyiqfoDeTZ24dqXuLbJp5PBtBrPwN-fzBCwTAlIIWUaGAr4dIpyFj77HwvwnlKoEl_2LNIQHOvUNwst9A9fxrzjWOjkdrdWYjwGBekVl-rPKeatbk4I0bptX__bBQ7ONpNXxrnghUIVVbIo_axey0ofq1iSwUUZ_xFROb0eGEhyabI9WcMfz8DLrRidpUzaSHP3cLZcbvv4oQmxE5O3cJ6qBM7sL3lcNMHA6M5puwMMSVpeP09XuDkSY3mc83LEGqBlKKBsteb-of__f776e8oim7Newg1p9rJWpalHDZVtKg' reply: 'HTTP/1.1 200 OK\r\n' header: Content-Type header: Vary header: Vary header: Vary header: Content-Encoding header: Date header: Server header: Cache-Control header: X-XSS-Protection header: X-Frame-Options header: X-Content-Type-Options header: Transfer-Encoding send: b'GET /storage/v1/b/medstar-test-archive-bucket?projection=noAcl HTTP/1.1\r\nHost: storage.googleapis.com\r\nAccept-Encoding: gzip\r\nAccept: */*\r\nConnection: keep-alive\r\nUser-Agent: gcloud-python/1.25.0 gl-python/3.4.6 gax/1.16.0 gccl/1.25.0\r\nX-Goog-API-Client: gcloud-python/1.25.0 gl-python/3.4.6 gax/1.16.0 gccl/1.25.0\r\nauthorization: Bearer ya29.c.Ko8BvQdkW1nlfRE1XfXi4d1LGKd-Sc3sSrdJCvDNw4f2FBTS0_3qrgTr0DsRKHLNzfcHQ72xa3TZi71E5z8Gq1ETN4FbIIV-Jno44SWTr5WOuqxDbc_ljYp30ByeltSbbT_8VLyk4i3Br0zSYRbm7JsctQQXlnPjRT45J2-2qEzrzG48B6MBifG4qgIndkcfxi8\r\n\r\n' reply: 'HTTP/1.1 200 OK\r\n' header: X-GUploader-UploadID header: ETag header: Content-Type header: Date header: Vary header: Vary header: Cache-Control header: Expires header: Content-Length header: Server send: b'GET /storage/v1/b/medstar-test-archive-bucket/o/PK2F00ET.018?projection=noAcl HTTP/1.1\r\nHost: storage.googleapis.com\r\nAccept-Encoding: gzip\r\nAccept: */*\r\nConnection: keep-alive\r\nUser-Agent: gcloud-python/1.25.0 gl-python/3.4.6 gax/1.16.0 gccl/1.25.0\r\nX-Goog-API-Client: gcloud-python/1.25.0 gl-python/3.4.6 gax/1.16.0 gccl/1.25.0\r\nauthorization: Bearer ya29.c.Ko8BvQdkW1nlfRE1XfXi4d1LGKd-Sc3sSrdJCvDNw4f2FBTS0_3qrgTr0DsRKHLNzfcHQ72xa3TZi71E5z8Gq1ETN4FbIIV-Jno44SWTr5WOuqxDbc_ljYp30ByeltSbbT_8VLyk4i3Br0zSYRbm7JsctQQXlnPjRT45J2-2qEzrzG48B6MBifG4qgIndkcfxi8\r\n\r\n' reply: 'HTTP/1.1 200 OK\r\n' header: X-GUploader-UploadID header: ETag header: Content-Type header: Date header: Vary header: Vary header: Cache-Control header: Expires header: Content-Length header: Server send: b'GET /download/storage/v1/b/medstar-test-archive-bucket/o/PK2F00ET.018?generation=1581893544652700&alt=media HTTP/1.1\r\nHost: storage.googleapis.com\r\naccept-encoding: gzip\r\nAccept: */*\r\nConnection: keep-alive\r\nUser-Agent: python-requests/2.21.0\r\nauthorization: Bearer ya29.c.Ko8BvQdkW1nlfRE1XfXi4d1LGKd-Sc3sSrdJCvDNw4f2FBTS0_3qrgTr0DsRKHLNzfcHQ72xa3TZi71E5z8Gq1ETN4FbIIV-Jno44SWTr5WOuqxDbc_ljYp30ByeltSbbT_8VLyk4i3Br0zSYRbm7JsctQQXlnPjRT45J2-2qEzrzG48B6MBifG4qgIndkcfxi8\r\n\r\n' reply: 'HTTP/1.1 200 OK\r\n' header: X-GUploader-UploadID header: Content-Type header: X-Goog-Generation header: X-Goog-Metageneration header: X-Goog-Storage-Class header: Pragma header: Expires header: Cache-Control header: X-Goog-Hash header: ETag header: Content-Disposition header: Date header: Vary header: Vary header: Content-Length header: Server send: b'PATCH /storage/v1/b/medstar-test-archive-bucket/o/PK2F00ET.018?generation=1581893544652700&projection=full HTTP/1.1\r\nHost: storage.googleapis.com\r\nAccept-Encoding: gzip\r\nAccept: */*\r\nConnection: keep-alive\r\nUser-Agent: gcloud-python/1.25.0 gl-python/3.4.6 gax/1.16.0 gccl/1.25.0\r\nContent-Type: application/json\r\nauthorization: Bearer ya29.c.Ko8BvQdkW1nlfRE1XfXi4d1LGKd-Sc3sSrdJCvDNw4f2FBTS0_3qrgTr0DsRKHLNzfcHQ72xa3TZi71E5z8Gq1ETN4FbIIV-Jno44SWTr5WOuqxDbc_ljYp30ByeltSbbT_8VLyk4i3Br0zSYRbm7JsctQQXlnPjRT45J2-2qEzrzG48B6MBifG4qgIndkcfxi8\r\nX-Goog-API-Client: gcloud-python/1.25.0 gl-python/3.4.6 gax/1.16.0 gccl/1.25.0\r\nContent-Length: 48\r\n\r\n{"metadata": {"UCA-META-RETRIEVECOUNTER": "24"}}' reply: 'HTTP/1.1 200 OK\r\n' header: X-GUploader-UploadID header: ETag header: Content-Type header: Date header: Vary header: Vary header: Cache-Control header: Expires header: Pragma header: Content-Length header: Server Retrieval took 10.01004433631897