# 100 files, 10 threads. 1kb each file. 2020-02-20 11:18:56,899.899 MainThread DEBUG: PARAMETERS ================================== 2020-02-20 11:18:56,900.900 MainThread DEBUG: Input file: input-100.txt 2020-02-20 11:18:56,900.900 MainThread DEBUG: Dest dir: ntt-test-1 2020-02-20 11:18:56,900.900 MainThread DEBUG: Workers: 10 2020-02-20 11:18:56,900.900 MainThread DEBUG: Key file: /Users/crwilcox/Documents/crwilcox-test-da9d65a3d2e3.json 2020-02-20 11:18:56,900.900 MainThread DEBUG: Bucket: crwilcox-test Loading work queue... Added 99 items to work queue Starting file retrieval 2020-02-20 11:18:56,905.905 Thread-6 retrieveWorker DEBUG: Creating GCS credentials 2020-02-20 11:18:56,906.906 Thread-7 retrieveWorker DEBUG: Creating GCS credentials 2020-02-20 11:18:56,907.907 Thread-8 retrieveWorker DEBUG: Creating GCS credentials 2020-02-20 11:18:56,908.908 Thread-9 retrieveWorker DEBUG: Creating GCS credentials 2020-02-20 11:18:56,910.910 Thread-10 retrieveWorker DEBUG: Creating GCS credentials 2020-02-20 11:18:56,911.911 Thread-11 retrieveWorker DEBUG: Creating GCS credentials 2020-02-20 11:18:56,913.913 Thread-12 retrieveWorker DEBUG: Creating GCS credentials 2020-02-20 11:18:56,915.915 Thread-13 retrieveWorker DEBUG: Creating GCS credentials 2020-02-20 11:18:56,916.916 Thread-14 retrieveWorker DEBUG: Creating GCS credentials 2020-02-20 11:18:56,918.918 Thread-15 retrieveWorker DEBUG: Creating GCS credentials 2020-02-20 11:18:56,924.924 Thread-11 retrieveWorker DEBUG: Creating GCS client 2020-02-20 11:18:56,925.925 Thread-11 retrieveWorker DEBUG: GCS connected 2020-02-20 11:18:56,930.930 Thread-10 retrieveWorker DEBUG: Creating GCS client 2020-02-20 11:18:56,933.933 Thread-9 retrieveWorker DEBUG: Creating GCS client 2020-02-20 11:18:56,947.947 Thread-9 retrieveWorker DEBUG: GCS connected 2020-02-20 11:18:56,936.936 Thread-8 retrieveWorker DEBUG: Creating GCS client 2020-02-20 11:18:56,940.940 Thread-10 retrieveWorker DEBUG: GCS connected 2020-02-20 11:18:56,947.947 Thread-12 retrieveWorker DEBUG: Creating GCS client 2020-02-20 11:18:56,954.954 Thread-8 retrieveWorker DEBUG: GCS connected 2020-02-20 11:18:56,959.959 Thread-15 retrieveWorker DEBUG: Creating GCS client 2020-02-20 11:18:56,960.960 Thread-6 retrieveWorker DEBUG: Creating GCS client 2020-02-20 11:18:56,939.939 Thread-14 retrieveWorker DEBUG: Creating GCS client 2020-02-20 11:18:57,019.019 Thread-7 retrieveWorker DEBUG: Creating GCS client 2020-02-20 11:18:57,020.020 Thread-12 retrieveWorker DEBUG: GCS connected 2020-02-20 11:18:57,105.105 Thread-15 retrieveWorker DEBUG: GCS connected 2020-02-20 11:18:57,113.113 Thread-13 retrieveWorker DEBUG: Creating GCS client 2020-02-20 11:18:57,113.113 Thread-6 retrieveWorker DEBUG: GCS connected 2020-02-20 11:18:57,156.156 Thread-14 retrieveWorker DEBUG: GCS connected 2020-02-20 11:18:57,159.159 Thread-7 retrieveWorker DEBUG: GCS connected 2020-02-20 11:18:57,207.207 Thread-13 retrieveWorker DEBUG: GCS connected 2020-02-20 11:18:57,796.796 Thread-14 retrieveWorker DEBUG: Processing "demo-data/file001.data" 2020-02-20 11:18:57,804.804 Thread-12 retrieveWorker DEBUG: Processing "demo-data/file002.data" 2020-02-20 11:18:57,812.812 Thread-7 retrieveWorker DEBUG: Processing "demo-data/file003.data" 2020-02-20 11:18:57,831.831 Thread-11 retrieveWorker DEBUG: Processing "demo-data/file004.data" 2020-02-20 11:18:57,833.833 Thread-15 retrieveWorker DEBUG: Processing "demo-data/file005.data" 2020-02-20 11:18:57,841.841 Thread-6 retrieveWorker DEBUG: Processing "demo-data/file006.data" 2020-02-20 11:18:57,845.845 Thread-9 retrieveWorker DEBUG: Processing "demo-data/file007.data" 2020-02-20 11:18:57,848.848 Thread-8 retrieveWorker DEBUG: Processing "demo-data/file008.data" 2020-02-20 11:18:57,850.850 Thread-13 retrieveWorker DEBUG: Processing "demo-data/file009.data" 2020-02-20 11:18:57,852.852 Thread-10 retrieveWorker DEBUG: Processing "demo-data/file010.data" 2020-02-20 11:18:58,016.016 Thread-14 retrieveWorker DEBUG: Set retrieve counter to 3 2020-02-20 11:18:58,052.052 Thread-11 retrieveWorker DEBUG: Set retrieve counter to 1 2020-02-20 11:18:58,055.055 Thread-12 retrieveWorker DEBUG: Set retrieve counter to 1 2020-02-20 11:18:58,063.063 Thread-7 retrieveWorker DEBUG: Set retrieve counter to 1 2020-02-20 11:18:58,084.084 Thread-15 retrieveWorker DEBUG: Set retrieve counter to 1 2020-02-20 11:18:58,090.090 Thread-6 retrieveWorker DEBUG: Set retrieve counter to 1 2020-02-20 11:18:58,097.097 Thread-10 retrieveWorker DEBUG: Set retrieve counter to 1 2020-02-20 11:18:58,137.137 Thread-8 retrieveWorker DEBUG: Set retrieve counter to 1 2020-02-20 11:18:58,160.160 Thread-9 retrieveWorker DEBUG: Set retrieve counter to 1 2020-02-20 11:18:58,188.188 Thread-13 retrieveWorker DEBUG: Set retrieve counter to 1 2020-02-20 11:18:58,197.197 Thread-14 retrieveWorker DEBUG: Cloud - GET demo-data/file001.data completed 2020-02-20 11:18:58,197.197 Thread-14 retrieveWorker DEBUG: Processing "demo-data/file011.data" 2020-02-20 11:18:58,230.230 Thread-7 retrieveWorker DEBUG: Cloud - GET demo-data/file003.data completed 2020-02-20 11:18:58,230.230 Thread-7 retrieveWorker DEBUG: Processing "demo-data/file012.data" 2020-02-20 11:18:58,231.231 Thread-11 retrieveWorker DEBUG: Cloud - GET demo-data/file004.data completed 2020-02-20 11:18:58,231.231 Thread-11 retrieveWorker DEBUG: Processing "demo-data/file013.data" 2020-02-20 11:18:58,234.234 Thread-12 retrieveWorker DEBUG: Cloud - GET demo-data/file002.data completed 2020-02-20 11:18:58,235.235 Thread-12 retrieveWorker DEBUG: Processing "demo-data/file014.data" 2020-02-20 11:18:58,268.268 Thread-15 retrieveWorker DEBUG: Cloud - GET demo-data/file005.data completed 2020-02-20 11:18:58,268.268 Thread-15 retrieveWorker DEBUG: Processing "demo-data/file015.data" 2020-02-20 11:18:58,297.297 Thread-8 retrieveWorker DEBUG: Cloud - GET demo-data/file008.data completed 2020-02-20 11:18:58,297.297 Thread-8 retrieveWorker DEBUG: Processing "demo-data/file016.data" 2020-02-20 11:18:58,308.308 Thread-10 retrieveWorker DEBUG: Cloud - GET demo-data/file010.data completed 2020-02-20 11:18:58,308.308 Thread-10 retrieveWorker DEBUG: Processing "demo-data/file017.data" 2020-02-20 11:18:58,354.354 Thread-6 retrieveWorker DEBUG: Cloud - GET demo-data/file006.data completed 2020-02-20 11:18:58,355.355 Thread-6 retrieveWorker DEBUG: Processing "demo-data/file018.data" 2020-02-20 11:18:58,367.367 Thread-9 retrieveWorker DEBUG: Cloud - GET demo-data/file007.data completed 2020-02-20 11:18:58,367.367 Thread-9 retrieveWorker DEBUG: Processing "demo-data/file019.data" 2020-02-20 11:18:58,403.403 Thread-13 retrieveWorker DEBUG: Cloud - GET demo-data/file009.data completed 2020-02-20 11:18:58,404.404 Thread-13 retrieveWorker DEBUG: Processing "demo-data/file020.data" 2020-02-20 11:18:58,423.423 Thread-14 retrieveWorker DEBUG: Set retrieve counter to 1 2020-02-20 11:18:58,439.439 Thread-12 retrieveWorker DEBUG: Set retrieve counter to 1 2020-02-20 11:18:58,446.446 Thread-11 retrieveWorker DEBUG: Set retrieve counter to 1 2020-02-20 11:18:58,482.482 Thread-7 retrieveWorker DEBUG: Set retrieve counter to 1 2020-02-20 11:18:58,490.490 Thread-15 retrieveWorker DEBUG: Set retrieve counter to 1 2020-02-20 11:18:58,518.518 Thread-8 retrieveWorker DEBUG: Set retrieve counter to 1 2020-02-20 11:18:58,533.533 Thread-10 retrieveWorker DEBUG: Set retrieve counter to 1 2020-02-20 11:18:58,584.584 Thread-14 retrieveWorker DEBUG: Cloud - GET demo-data/file011.data completed 2020-02-20 11:18:58,584.584 Thread-14 retrieveWorker DEBUG: Processing "demo-data/file021.data" 2020-02-20 11:18:58,592.592 Thread-9 retrieveWorker DEBUG: Set retrieve counter to 1 2020-02-20 11:18:58,637.637 Thread-11 retrieveWorker DEBUG: Cloud - GET demo-data/file013.data completed 2020-02-20 11:18:58,637.637 Thread-11 retrieveWorker DEBUG: Processing "demo-data/file022.data" 2020-02-20 11:18:58,639.639 Thread-12 retrieveWorker DEBUG: Cloud - GET demo-data/file014.data completed 2020-02-20 11:18:58,639.639 Thread-12 retrieveWorker DEBUG: Processing "demo-data/file023.data" 2020-02-20 11:18:58,643.643 Thread-6 retrieveWorker DEBUG: Set retrieve counter to 1 2020-02-20 11:18:58,656.656 Thread-13 retrieveWorker DEBUG: Set retrieve counter to 1 2020-02-20 11:18:58,665.665 Thread-7 retrieveWorker DEBUG: Cloud - GET demo-data/file012.data completed 2020-02-20 11:18:58,665.665 Thread-7 retrieveWorker DEBUG: Processing "demo-data/file024.data" 2020-02-20 11:18:58,681.681 Thread-15 retrieveWorker DEBUG: Cloud - GET demo-data/file015.data completed 2020-02-20 11:18:58,681.681 Thread-15 retrieveWorker DEBUG: Processing "demo-data/file025.data" 2020-02-20 11:18:58,698.698 Thread-10 retrieveWorker DEBUG: Cloud - GET demo-data/file017.data completed 2020-02-20 11:18:58,699.699 Thread-10 retrieveWorker DEBUG: Processing "demo-data/file026.data" 2020-02-20 11:18:58,712.712 Thread-8 retrieveWorker DEBUG: Cloud - GET demo-data/file016.data completed 2020-02-20 11:18:58,713.713 Thread-8 retrieveWorker DEBUG: Processing "demo-data/file027.data" 2020-02-20 11:18:58,785.785 Thread-9 retrieveWorker DEBUG: Cloud - GET demo-data/file019.data completed 2020-02-20 11:18:58,790.790 Thread-9 retrieveWorker DEBUG: Processing "demo-data/file028.data" 2020-02-20 11:18:58,838.838 Thread-13 retrieveWorker DEBUG: Cloud - GET demo-data/file020.data completed 2020-02-20 11:18:58,838.838 Thread-13 retrieveWorker DEBUG: Processing "demo-data/file029.data" 2020-02-20 11:18:58,853.853 Thread-6 retrieveWorker DEBUG: Cloud - GET demo-data/file018.data completed 2020-02-20 11:18:58,853.853 Thread-6 retrieveWorker DEBUG: Processing "demo-data/file030.data" 2020-02-20 11:18:58,865.865 Thread-14 retrieveWorker DEBUG: Set retrieve counter to 1 2020-02-20 11:18:58,918.918 Thread-12 retrieveWorker DEBUG: Set retrieve counter to 1 2020-02-20 11:18:58,954.954 Thread-7 retrieveWorker DEBUG: Set retrieve counter to 1 2020-02-20 11:18:58,957.957 Thread-11 retrieveWorker DEBUG: Set retrieve counter to 1 2020-02-20 11:18:58,965.965 Thread-10 retrieveWorker DEBUG: Set retrieve counter to 1 2020-02-20 11:18:59,006.006 Thread-8 retrieveWorker DEBUG: Set retrieve counter to 1 2020-02-20 11:18:59,020.020 Thread-15 retrieveWorker DEBUG: Set retrieve counter to 1 2020-02-20 11:18:59,037.037 Thread-14 retrieveWorker DEBUG: Cloud - GET demo-data/file021.data completed 2020-02-20 11:18:59,037.037 Thread-14 retrieveWorker DEBUG: Processing "demo-data/file031.data" 2020-02-20 11:18:59,056.056 Thread-9 retrieveWorker DEBUG: Set retrieve counter to 1 2020-02-20 11:18:59,072.072 Thread-13 retrieveWorker DEBUG: Set retrieve counter to 1 2020-02-20 11:18:59,087.087 Thread-12 retrieveWorker DEBUG: Cloud - GET demo-data/file023.data completed 2020-02-20 11:18:59,087.087 Thread-12 retrieveWorker DEBUG: Processing "demo-data/file032.data" 2020-02-20 11:18:59,100.100 Thread-6 retrieveWorker DEBUG: Set retrieve counter to 1 2020-02-20 11:18:59,138.138 Thread-10 retrieveWorker DEBUG: Cloud - GET demo-data/file026.data completed 2020-02-20 11:18:59,138.138 Thread-10 retrieveWorker DEBUG: Processing "demo-data/file033.data" 2020-02-20 11:18:59,141.141 Thread-7 retrieveWorker DEBUG: Cloud - GET demo-data/file024.data completed 2020-02-20 11:18:59,142.142 Thread-7 retrieveWorker DEBUG: Processing "demo-data/file034.data" 2020-02-20 11:18:59,158.158 Thread-11 retrieveWorker DEBUG: Cloud - GET demo-data/file022.data completed 2020-02-20 11:18:59,158.158 Thread-11 retrieveWorker DEBUG: Processing "demo-data/file035.data" 2020-02-20 11:18:59,177.177 Thread-8 retrieveWorker DEBUG: Cloud - GET demo-data/file027.data completed 2020-02-20 11:18:59,179.179 Thread-8 retrieveWorker DEBUG: Processing "demo-data/file036.data" 2020-02-20 11:18:59,194.194 Thread-15 retrieveWorker DEBUG: Cloud - GET demo-data/file025.data completed 2020-02-20 11:18:59,195.195 Thread-15 retrieveWorker DEBUG: Processing "demo-data/file037.data" 2020-02-20 11:18:59,235.235 Thread-9 retrieveWorker DEBUG: Cloud - GET demo-data/file028.data completed 2020-02-20 11:18:59,235.235 Thread-9 retrieveWorker DEBUG: Processing "demo-data/file038.data" 2020-02-20 11:18:59,258.258 Thread-13 retrieveWorker DEBUG: Cloud - GET demo-data/file029.data completed 2020-02-20 11:18:59,258.258 Thread-13 retrieveWorker DEBUG: Processing "demo-data/file039.data" 2020-02-20 11:18:59,297.297 Thread-14 retrieveWorker DEBUG: Set retrieve counter to 1 2020-02-20 11:18:59,304.304 Thread-6 retrieveWorker DEBUG: Cloud - GET demo-data/file030.data completed 2020-02-20 11:18:59,304.304 Thread-6 retrieveWorker DEBUG: Processing "demo-data/file040.data" 2020-02-20 11:18:59,319.319 Thread-12 retrieveWorker DEBUG: Set retrieve counter to 1 2020-02-20 11:18:59,365.365 Thread-7 retrieveWorker DEBUG: Set retrieve counter to 1 2020-02-20 11:18:59,386.386 Thread-10 retrieveWorker DEBUG: Set retrieve counter to 1 2020-02-20 11:18:59,403.403 Thread-15 retrieveWorker DEBUG: Set retrieve counter to 1 2020-02-20 11:18:59,409.409 Thread-8 retrieveWorker DEBUG: Set retrieve counter to 1 2020-02-20 11:18:59,420.420 Thread-11 retrieveWorker DEBUG: Set retrieve counter to 1 2020-02-20 11:18:59,469.469 Thread-14 retrieveWorker DEBUG: Cloud - GET demo-data/file031.data completed 2020-02-20 11:18:59,469.469 Thread-14 retrieveWorker DEBUG: Processing "demo-data/file041.data" 2020-02-20 11:18:59,485.485 Thread-9 retrieveWorker DEBUG: Set retrieve counter to 1 2020-02-20 11:18:59,499.499 Thread-12 retrieveWorker DEBUG: Cloud - GET demo-data/file032.data completed 2020-02-20 11:18:59,500.500 Thread-12 retrieveWorker DEBUG: Processing "demo-data/file042.data" 2020-02-20 11:18:59,502.502 Thread-13 retrieveWorker DEBUG: Set retrieve counter to 1 2020-02-20 11:18:59,518.518 Thread-6 retrieveWorker DEBUG: Set retrieve counter to 1 2020-02-20 11:18:59,538.538 Thread-7 retrieveWorker DEBUG: Cloud - GET demo-data/file034.data completed 2020-02-20 11:18:59,539.539 Thread-7 retrieveWorker DEBUG: Processing "demo-data/file043.data" 2020-02-20 11:18:59,574.574 Thread-10 retrieveWorker DEBUG: Cloud - GET demo-data/file033.data completed 2020-02-20 11:18:59,575.575 Thread-10 retrieveWorker DEBUG: Processing "demo-data/file044.data" 2020-02-20 11:18:59,591.591 Thread-11 retrieveWorker DEBUG: Cloud - GET demo-data/file035.data completed 2020-02-20 11:18:59,592.592 Thread-15 retrieveWorker DEBUG: Cloud - GET demo-data/file037.data completed 2020-02-20 11:18:59,595.595 Thread-11 retrieveWorker DEBUG: Processing "demo-data/file045.data" 2020-02-20 11:18:59,599.599 Thread-8 retrieveWorker DEBUG: Cloud - GET demo-data/file036.data completed 2020-02-20 11:18:59,599.599 Thread-15 retrieveWorker DEBUG: Processing "demo-data/file046.data" 2020-02-20 11:18:59,602.602 Thread-8 retrieveWorker DEBUG: Processing "demo-data/file047.data" 2020-02-20 11:18:59,694.694 Thread-9 retrieveWorker DEBUG: Cloud - GET demo-data/file038.data completed 2020-02-20 11:18:59,694.694 Thread-9 retrieveWorker DEBUG: Processing "demo-data/file048.data" 2020-02-20 11:18:59,697.697 Thread-6 retrieveWorker DEBUG: Cloud - GET demo-data/file040.data completed 2020-02-20 11:18:59,697.697 Thread-6 retrieveWorker DEBUG: Processing "demo-data/file049.data" 2020-02-20 11:18:59,700.700 Thread-13 retrieveWorker DEBUG: Cloud - GET demo-data/file039.data completed 2020-02-20 11:18:59,700.700 Thread-13 retrieveWorker DEBUG: Processing "demo-data/file050.data" 2020-02-20 11:18:59,705.705 Thread-14 retrieveWorker DEBUG: Set retrieve counter to 1 2020-02-20 11:18:59,757.757 Thread-12 retrieveWorker DEBUG: Set retrieve counter to 1 2020-02-20 11:18:59,782.782 Thread-7 retrieveWorker DEBUG: Set retrieve counter to 1 2020-02-20 11:18:59,850.850 Thread-10 retrieveWorker DEBUG: Set retrieve counter to 1 2020-02-20 11:18:59,861.861 Thread-11 retrieveWorker DEBUG: Set retrieve counter to 1 2020-02-20 11:18:59,881.881 Thread-8 retrieveWorker DEBUG: Set retrieve counter to 1 2020-02-20 11:18:59,903.903 Thread-14 retrieveWorker DEBUG: Cloud - GET demo-data/file041.data completed 2020-02-20 11:18:59,903.903 Thread-14 retrieveWorker DEBUG: Processing "demo-data/file051.data" 2020-02-20 11:18:59,926.926 Thread-6 retrieveWorker DEBUG: Set retrieve counter to 1 2020-02-20 11:18:59,932.932 Thread-15 retrieveWorker DEBUG: Set retrieve counter to 1 2020-02-20 11:18:59,936.936 Thread-12 retrieveWorker DEBUG: Cloud - GET demo-data/file042.data completed 2020-02-20 11:18:59,936.936 Thread-12 retrieveWorker DEBUG: Processing "demo-data/file052.data" 2020-02-20 11:18:59,965.965 Thread-13 retrieveWorker DEBUG: Set retrieve counter to 1 2020-02-20 11:18:59,966.966 Thread-9 retrieveWorker DEBUG: Set retrieve counter to 1 2020-02-20 11:18:59,977.977 Thread-7 retrieveWorker DEBUG: Cloud - GET demo-data/file043.data completed 2020-02-20 11:18:59,977.977 Thread-7 retrieveWorker DEBUG: Processing "demo-data/file053.data" 2020-02-20 11:19:00,024.024 Thread-10 retrieveWorker DEBUG: Cloud - GET demo-data/file044.data completed 2020-02-20 11:19:00,024.024 Thread-10 retrieveWorker DEBUG: Processing "demo-data/file054.data" 2020-02-20 11:19:00,052.052 Thread-8 retrieveWorker DEBUG: Cloud - GET demo-data/file047.data completed 2020-02-20 11:19:00,052.052 Thread-11 retrieveWorker DEBUG: Cloud - GET demo-data/file045.data completed 2020-02-20 11:19:00,055.055 Thread-8 retrieveWorker DEBUG: Processing "demo-data/file055.data" 2020-02-20 11:19:00,055.055 Thread-11 retrieveWorker DEBUG: Processing "demo-data/file056.data" 2020-02-20 11:19:00,136.136 Thread-6 retrieveWorker DEBUG: Cloud - GET demo-data/file049.data completed 2020-02-20 11:19:00,136.136 Thread-6 retrieveWorker DEBUG: Processing "demo-data/file057.data" 2020-02-20 11:19:00,146.146 Thread-15 retrieveWorker DEBUG: Cloud - GET demo-data/file046.data completed 2020-02-20 11:19:00,147.147 Thread-15 retrieveWorker DEBUG: Processing "demo-data/file058.data" 2020-02-20 11:19:00,162.162 Thread-14 retrieveWorker DEBUG: Set retrieve counter to 1 2020-02-20 11:19:00,174.174 Thread-13 retrieveWorker DEBUG: Cloud - GET demo-data/file050.data completed 2020-02-20 11:19:00,174.174 Thread-13 retrieveWorker DEBUG: Processing "demo-data/file059.data" 2020-02-20 11:19:00,193.193 Thread-9 retrieveWorker DEBUG: Cloud - GET demo-data/file048.data completed 2020-02-20 11:19:00,193.193 Thread-9 retrieveWorker DEBUG: Processing "demo-data/file060.data" 2020-02-20 11:19:00,203.203 Thread-12 retrieveWorker DEBUG: Set retrieve counter to 1 2020-02-20 11:19:00,216.216 Thread-7 retrieveWorker DEBUG: Set retrieve counter to 1 2020-02-20 11:19:00,312.312 Thread-10 retrieveWorker DEBUG: Set retrieve counter to 1 2020-02-20 11:19:00,373.373 Thread-8 retrieveWorker DEBUG: Set retrieve counter to 1 2020-02-20 11:19:00,382.382 Thread-6 retrieveWorker DEBUG: Set retrieve counter to 1 2020-02-20 11:19:00,397.397 Thread-11 retrieveWorker DEBUG: Set retrieve counter to 1 2020-02-20 11:19:00,412.412 Thread-12 retrieveWorker DEBUG: Cloud - GET demo-data/file052.data completed 2020-02-20 11:19:00,413.413 Thread-12 retrieveWorker DEBUG: Processing "demo-data/file061.data" 2020-02-20 11:19:00,414.414 Thread-14 retrieveWorker DEBUG: Cloud - GET demo-data/file051.data completed 2020-02-20 11:19:00,418.418 Thread-14 retrieveWorker DEBUG: Processing "demo-data/file062.data" 2020-02-20 11:19:00,422.422 Thread-7 retrieveWorker DEBUG: Cloud - GET demo-data/file053.data completed 2020-02-20 11:19:00,422.422 Thread-7 retrieveWorker DEBUG: Processing "demo-data/file063.data" 2020-02-20 11:19:00,445.445 Thread-13 retrieveWorker DEBUG: Set retrieve counter to 1 2020-02-20 11:19:00,458.458 Thread-15 retrieveWorker DEBUG: Set retrieve counter to 1 2020-02-20 11:19:00,483.483 Thread-9 retrieveWorker DEBUG: Set retrieve counter to 1 2020-02-20 11:19:00,489.489 Thread-10 retrieveWorker DEBUG: Cloud - GET demo-data/file054.data completed 2020-02-20 11:19:00,489.489 Thread-10 retrieveWorker DEBUG: Processing "demo-data/file064.data" 2020-02-20 11:19:00,553.553 Thread-8 retrieveWorker DEBUG: Cloud - GET demo-data/file055.data completed 2020-02-20 11:19:00,554.554 Thread-8 retrieveWorker DEBUG: Processing "demo-data/file065.data" 2020-02-20 11:19:00,573.573 Thread-6 retrieveWorker DEBUG: Cloud - GET demo-data/file057.data completed 2020-02-20 11:19:00,573.573 Thread-6 retrieveWorker DEBUG: Processing "demo-data/file066.data" 2020-02-20 11:19:00,583.583 Thread-11 retrieveWorker DEBUG: Cloud - GET demo-data/file056.data completed 2020-02-20 11:19:00,587.587 Thread-11 retrieveWorker DEBUG: Processing "demo-data/file067.data" 2020-02-20 11:19:00,624.624 Thread-13 retrieveWorker DEBUG: Cloud - GET demo-data/file059.data completed 2020-02-20 11:19:00,625.625 Thread-13 retrieveWorker DEBUG: Processing "demo-data/file068.data" 2020-02-20 11:19:00,630.630 Thread-12 retrieveWorker DEBUG: Set retrieve counter to 1 2020-02-20 11:19:00,632.632 Thread-15 retrieveWorker DEBUG: Cloud - GET demo-data/file058.data completed 2020-02-20 11:19:00,632.632 Thread-15 retrieveWorker DEBUG: Processing "demo-data/file069.data" 2020-02-20 11:19:00,667.667 Thread-7 retrieveWorker DEBUG: Set retrieve counter to 1 2020-02-20 11:19:00,694.694 Thread-14 retrieveWorker DEBUG: Set retrieve counter to 1 2020-02-20 11:19:00,695.695 Thread-9 retrieveWorker DEBUG: Cloud - GET demo-data/file060.data completed 2020-02-20 11:19:00,695.695 Thread-9 retrieveWorker DEBUG: Processing "demo-data/file070.data" 2020-02-20 11:19:00,789.789 Thread-10 retrieveWorker DEBUG: Set retrieve counter to 1 2020-02-20 11:19:00,806.806 Thread-11 retrieveWorker DEBUG: Set retrieve counter to 1 2020-02-20 11:19:00,814.814 Thread-12 retrieveWorker DEBUG: Cloud - GET demo-data/file061.data completed 2020-02-20 11:19:00,816.816 Thread-12 retrieveWorker DEBUG: Processing "demo-data/file071.data" 2020-02-20 11:19:00,825.825 Thread-6 retrieveWorker DEBUG: Set retrieve counter to 1 2020-02-20 11:19:00,841.841 Thread-13 retrieveWorker DEBUG: Set retrieve counter to 1 2020-02-20 11:19:00,846.846 Thread-8 retrieveWorker DEBUG: Set retrieve counter to 1 2020-02-20 11:19:00,865.865 Thread-7 retrieveWorker DEBUG: Cloud - GET demo-data/file063.data completed 2020-02-20 11:19:00,865.865 Thread-7 retrieveWorker DEBUG: Processing "demo-data/file072.data" 2020-02-20 11:19:00,871.871 Thread-14 retrieveWorker DEBUG: Cloud - GET demo-data/file062.data completed 2020-02-20 11:19:00,871.871 Thread-14 retrieveWorker DEBUG: Processing "demo-data/file073.data" 2020-02-20 11:19:00,906.906 Thread-9 retrieveWorker DEBUG: Set retrieve counter to 1 2020-02-20 11:19:00,920.920 Thread-15 retrieveWorker DEBUG: Set retrieve counter to 1 2020-02-20 11:19:00,946.946 Thread-10 retrieveWorker DEBUG: Cloud - GET demo-data/file064.data completed 2020-02-20 11:19:00,948.948 Thread-10 retrieveWorker DEBUG: Processing "demo-data/file074.data" 2020-02-20 11:19:00,980.980 Thread-11 retrieveWorker DEBUG: Cloud - GET demo-data/file067.data completed 2020-02-20 11:19:00,981.981 Thread-11 retrieveWorker DEBUG: Processing "demo-data/file075.data" 2020-02-20 11:19:00,992.992 Thread-6 retrieveWorker DEBUG: Cloud - GET demo-data/file066.data completed 2020-02-20 11:19:00,993.993 Thread-6 retrieveWorker DEBUG: Processing "demo-data/file076.data" 2020-02-20 11:19:01,049.049 Thread-8 retrieveWorker DEBUG: Cloud - GET demo-data/file065.data completed 2020-02-20 11:19:01,050.050 Thread-8 retrieveWorker DEBUG: Processing "demo-data/file077.data" 2020-02-20 11:19:01,098.098 Thread-9 retrieveWorker DEBUG: Cloud - GET demo-data/file070.data completed 2020-02-20 11:19:01,099.099 Thread-9 retrieveWorker DEBUG: Processing "demo-data/file078.data" 2020-02-20 11:19:01,117.117 Thread-13 retrieveWorker DEBUG: Cloud - GET demo-data/file068.data completed 2020-02-20 11:19:01,118.118 Thread-13 retrieveWorker DEBUG: Processing "demo-data/file079.data" 2020-02-20 11:19:01,125.125 Thread-7 retrieveWorker DEBUG: Set retrieve counter to 1 2020-02-20 11:19:01,141.141 Thread-12 retrieveWorker DEBUG: Set retrieve counter to 1 2020-02-20 11:19:01,146.146 Thread-15 retrieveWorker DEBUG: Cloud - GET demo-data/file069.data completed 2020-02-20 11:19:01,147.147 Thread-15 retrieveWorker DEBUG: Processing "demo-data/file080.data" 2020-02-20 11:19:01,159.159 Thread-14 retrieveWorker DEBUG: Set retrieve counter to 1 2020-02-20 11:19:01,219.219 Thread-10 retrieveWorker DEBUG: Set retrieve counter to 1 2020-02-20 11:19:01,328.328 Thread-11 retrieveWorker DEBUG: Set retrieve counter to 1 2020-02-20 11:19:01,339.339 Thread-8 retrieveWorker DEBUG: Set retrieve counter to 1 2020-02-20 11:19:01,371.371 Thread-14 retrieveWorker DEBUG: Cloud - GET demo-data/file073.data completed 2020-02-20 11:19:01,372.372 Thread-14 retrieveWorker DEBUG: Processing "demo-data/file081.data" 2020-02-20 11:19:01,373.373 Thread-12 retrieveWorker DEBUG: Cloud - GET demo-data/file071.data completed 2020-02-20 11:19:01,373.373 Thread-7 retrieveWorker DEBUG: Cloud - GET demo-data/file072.data completed 2020-02-20 11:19:01,373.373 Thread-12 retrieveWorker DEBUG: Processing "demo-data/file082.data" 2020-02-20 11:19:01,376.376 Thread-7 retrieveWorker DEBUG: Processing "demo-data/file083.data" 2020-02-20 11:19:01,395.395 Thread-10 retrieveWorker DEBUG: Cloud - GET demo-data/file074.data completed 2020-02-20 11:19:01,396.396 Thread-10 retrieveWorker DEBUG: Processing "demo-data/file084.data" 2020-02-20 11:19:01,411.411 Thread-6 retrieveWorker DEBUG: Set retrieve counter to 1 2020-02-20 11:19:01,431.431 Thread-15 retrieveWorker DEBUG: Set retrieve counter to 1 2020-02-20 11:19:01,443.443 Thread-13 retrieveWorker DEBUG: Set retrieve counter to 1 2020-02-20 11:19:01,462.462 Thread-9 retrieveWorker DEBUG: Set retrieve counter to 1 2020-02-20 11:19:01,506.506 Thread-8 retrieveWorker DEBUG: Cloud - GET demo-data/file077.data completed 2020-02-20 11:19:01,506.506 Thread-8 retrieveWorker DEBUG: Processing "demo-data/file085.data" 2020-02-20 11:19:01,507.507 Thread-11 retrieveWorker DEBUG: Cloud - GET demo-data/file075.data completed 2020-02-20 11:19:01,518.518 Thread-11 retrieveWorker DEBUG: Processing "demo-data/file086.data" 2020-02-20 11:19:01,596.596 Thread-15 retrieveWorker DEBUG: Cloud - GET demo-data/file080.data completed 2020-02-20 11:19:01,596.596 Thread-15 retrieveWorker DEBUG: Processing "demo-data/file087.data" 2020-02-20 11:19:01,608.608 Thread-13 retrieveWorker DEBUG: Cloud - GET demo-data/file079.data completed 2020-02-20 11:19:01,609.609 Thread-13 retrieveWorker DEBUG: Processing "demo-data/file088.data" 2020-02-20 11:19:01,638.638 Thread-6 retrieveWorker DEBUG: Cloud - GET demo-data/file076.data completed 2020-02-20 11:19:01,638.638 Thread-6 retrieveWorker DEBUG: Processing "demo-data/file089.data" 2020-02-20 11:19:01,651.651 Thread-10 retrieveWorker DEBUG: Set retrieve counter to 1 2020-02-20 11:19:01,655.655 Thread-14 retrieveWorker DEBUG: Set retrieve counter to 1 2020-02-20 11:19:01,668.668 Thread-7 retrieveWorker DEBUG: Set retrieve counter to 1 2020-02-20 11:19:01,701.701 Thread-9 retrieveWorker DEBUG: Cloud - GET demo-data/file078.data completed 2020-02-20 11:19:01,702.702 Thread-9 retrieveWorker DEBUG: Processing "demo-data/file090.data" 2020-02-20 11:19:01,714.714 Thread-12 retrieveWorker DEBUG: Set retrieve counter to 1 2020-02-20 11:19:01,747.747 Thread-8 retrieveWorker DEBUG: Set retrieve counter to 1 2020-02-20 11:19:01,758.758 Thread-11 retrieveWorker DEBUG: Set retrieve counter to 1 2020-02-20 11:19:01,819.819 Thread-10 retrieveWorker DEBUG: Cloud - GET demo-data/file084.data completed 2020-02-20 11:19:01,820.820 Thread-10 retrieveWorker DEBUG: Processing "demo-data/file091.data" 2020-02-20 11:19:01,828.828 Thread-14 retrieveWorker DEBUG: Cloud - GET demo-data/file081.data completed 2020-02-20 11:19:01,830.830 Thread-14 retrieveWorker DEBUG: Processing "demo-data/file092.data" 2020-02-20 11:19:01,850.850 Thread-7 retrieveWorker DEBUG: Cloud - GET demo-data/file083.data completed 2020-02-20 11:19:01,850.850 Thread-7 retrieveWorker DEBUG: Processing "demo-data/file093.data" 2020-02-20 11:19:01,853.853 Thread-15 retrieveWorker DEBUG: Set retrieve counter to 1 2020-02-20 11:19:01,890.890 Thread-6 retrieveWorker DEBUG: Set retrieve counter to 1 2020-02-20 11:19:01,891.891 Thread-13 retrieveWorker DEBUG: Set retrieve counter to 1 2020-02-20 11:19:01,921.921 Thread-9 retrieveWorker DEBUG: Set retrieve counter to 1 2020-02-20 11:19:01,929.929 Thread-12 retrieveWorker DEBUG: Cloud - GET demo-data/file082.data completed 2020-02-20 11:19:01,930.930 Thread-12 retrieveWorker DEBUG: Processing "demo-data/file094.data" 2020-02-20 11:19:01,942.942 Thread-11 retrieveWorker DEBUG: Cloud - GET demo-data/file086.data completed 2020-02-20 11:19:01,945.945 Thread-11 retrieveWorker DEBUG: Processing "demo-data/file095.data" 2020-02-20 11:19:01,946.946 Thread-8 retrieveWorker DEBUG: Cloud - GET demo-data/file085.data completed 2020-02-20 11:19:01,953.953 Thread-8 retrieveWorker DEBUG: Processing "demo-data/file096.data" 2020-02-20 11:19:02,041.041 Thread-15 retrieveWorker DEBUG: Cloud - GET demo-data/file087.data completed 2020-02-20 11:19:02,042.042 Thread-15 retrieveWorker DEBUG: Processing "demo-data/file097.data" 2020-02-20 11:19:02,067.067 Thread-13 retrieveWorker DEBUG: Cloud - GET demo-data/file088.data completed 2020-02-20 11:19:02,068.068 Thread-13 retrieveWorker DEBUG: Processing "demo-data/file098.data" 2020-02-20 11:19:02,075.075 Thread-6 retrieveWorker DEBUG: Cloud - GET demo-data/file089.data completed 2020-02-20 11:19:02,075.075 Thread-6 retrieveWorker DEBUG: Processing "demo-data/file099.data" 2020-02-20 11:19:02,102.102 Thread-14 retrieveWorker DEBUG: Set retrieve counter to 1 2020-02-20 11:19:02,113.113 Thread-10 retrieveWorker DEBUG: Set retrieve counter to 1 2020-02-20 11:19:02,133.133 Thread-7 retrieveWorker DEBUG: Set retrieve counter to 1 2020-02-20 11:19:02,140.140 Thread-9 retrieveWorker DEBUG: Cloud - GET demo-data/file090.data completed 2020-02-20 11:19:02,142.142 Thread-9 retrieveWorker DEBUG: Processing "demo-data/file100.data" 2020-02-20 11:19:02,187.187 Thread-12 retrieveWorker DEBUG: Set retrieve counter to 1 2020-02-20 11:19:02,192.192 Thread-8 retrieveWorker DEBUG: Set retrieve counter to 1 2020-02-20 11:19:02,287.287 Thread-11 retrieveWorker DEBUG: Set retrieve counter to 1 2020-02-20 11:19:02,298.298 Thread-15 retrieveWorker DEBUG: Set retrieve counter to 1 2020-02-20 11:19:02,306.306 Thread-10 retrieveWorker DEBUG: Cloud - GET demo-data/file091.data completed 2020-02-20 11:19:02,316.316 Thread-13 retrieveWorker DEBUG: Set retrieve counter to 1 2020-02-20 11:19:02,324.324 Thread-7 retrieveWorker DEBUG: Cloud - GET demo-data/file093.data completed 2020-02-20 11:19:02,349.349 Thread-14 retrieveWorker DEBUG: Cloud - GET demo-data/file092.data completed 2020-02-20 11:19:02,387.387 Thread-9 retrieveWorker DEBUG: Set retrieve counter to 1 2020-02-20 11:19:02,402.402 Thread-6 retrieveWorker DEBUG: Set retrieve counter to 1 2020-02-20 11:19:02,415.415 Thread-8 retrieveWorker DEBUG: Cloud - GET demo-data/file096.data completed 2020-02-20 11:19:02,427.427 Thread-12 retrieveWorker DEBUG: Cloud - GET demo-data/file094.data completed 2020-02-20 11:19:02,448.448 Thread-11 retrieveWorker DEBUG: Cloud - GET demo-data/file095.data completed 2020-02-20 11:19:02,458.458 Thread-15 retrieveWorker DEBUG: Cloud - GET demo-data/file097.data completed 2020-02-20 11:19:02,499.499 Thread-13 retrieveWorker DEBUG: Cloud - GET demo-data/file098.data completed 2020-02-20 11:19:02,574.574 Thread-9 retrieveWorker DEBUG: Cloud - GET demo-data/file100.data completed