Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

DeviantArt Scrap downloader is broken #376

Closed
kargaroc opened this issue Aug 11, 2019 · 0 comments
Closed

DeviantArt Scrap downloader is broken #376

kargaroc opened this issue Aug 11, 2019 · 0 comments
Labels

Comments

@kargaroc
Copy link

kargaroc commented Aug 11, 2019

The Deviantart scrap downloader fails after downloading the first page of pictures

[gallery-dl][debug] Version 1.10.1
[gallery-dl][debug] Python 3.7.4 - Linux-5.2.6-arch1-1-ARCH-x86_64-with-arch
[gallery-dl][debug] requests 2.22.0 - urllib3 1.25.3
[gallery-dl][debug] Starting DownloadJob for 'https://www.deviantart.com/greyanimebeast/gallery/?catpath=scraps'
[gallery-dl][debug] Updating urllib3 ciphers
[deviantart][debug] Using DeviantartScrapsExtractor for 'https://www.deviantart.com/greyanimebeast/gallery/?catpath=scraps'
[urllib3.connectionpool][debug] Starting new HTTPS connection (1): www.deviantart.com:443
[urllib3.connectionpool][debug] https://www.deviantart.com:443 "GET /api/v1/oauth2/user/profile/greyanimebeast HTTP/1.1" 200 1505
[urllib3.connectionpool][debug] https://www.deviantart.com:443 "GET /greyanimebeast/gallery/?catpath=scraps HTTP/1.1" 301 0
[urllib3.connectionpool][debug] https://www.deviantart.com:443 "GET /l-i-j/gallery/?catpath=scraps&rnrd=280492 HTTP/1.1" 200 None
[urllib3.connectionpool][debug] https://www.deviantart.com:443 "POST /dapi/v1/gallery/0 HTTP/1.1" 200 None
[urllib3.connectionpool][debug] https://www.deviantart.com:443 "GET /l-i-j/art/Zynques-redesign-doodles-679694728 HTTP/1.1" 200 None
[urllib3.connectionpool][debug] https://www.deviantart.com:443 "GET /api/v1/oauth2/deviation/DFF33B39-DFC7-4F00-085F-886FF0147856 HTTP/1.1" 200 1179
[urllib3.connectionpool][debug] https://www.deviantart.com:443 "GET /api/v1/oauth2/deviation/metadata?deviationids%5B0%5D=DFF33B39-DFC7-4F00-085F-886FF0147856&mature_content=true HTTP/1.1" 200 402
[deviantart][debug] Active postprocessor modules: [<gallery_dl.postprocessor.metadata.MetadataPP object at 0x7f3d5b0be0d0>]
[urllib3.connectionpool][debug] https://www.deviantart.com:443 "GET /api/v1/oauth2/deviation/download/DFF33B39-DFC7-4F00-085F-886FF0147856?mature_content=true HTTP/1.1" 200 1238
./gallery-dl/deviantart/greyanimebeast/Scraps/deviantart_679694728_Zynques redesign doodles.jpg
[urllib3.connectionpool][debug] https://www.deviantart.com:443 "GET /l-i-j/art/McCree-progress-678252488 HTTP/1.1" 200 None
[urllib3.connectionpool][debug] https://www.deviantart.com:443 "GET /api/v1/oauth2/deviation/88B23CBE-A2BD-8CF6-0EA1-31F1AED809E3 HTTP/1.1" 200 1088
[urllib3.connectionpool][debug] https://www.deviantart.com:443 "GET /api/v1/oauth2/deviation/metadata?deviationids%5B0%5D=88B23CBE-A2BD-8CF6-0EA1-31F1AED809E3&mature_content=true HTTP/1.1" 200 386
[urllib3.connectionpool][debug] https://www.deviantart.com:443 "GET /api/v1/oauth2/deviation/download/88B23CBE-A2BD-8CF6-0EA1-31F1AED809E3?mature_content=true HTTP/1.1" 200 1242
./gallery-dl/deviantart/greyanimebeast/Scraps/deviantart_678252488_McCree progress.jpg
[urllib3.connectionpool][debug] https://www.deviantart.com:443 "GET /l-i-j/art/Colossus-closeup-313635530 HTTP/1.1" 200 None
[urllib3.connectionpool][debug] https://www.deviantart.com:443 "GET /api/v1/oauth2/deviation/4B875349-FB09-06C8-80D7-390B1F61EC44 HTTP/1.1" 200 1209
[urllib3.connectionpool][debug] https://www.deviantart.com:443 "GET /api/v1/oauth2/deviation/metadata?deviationids%5B0%5D=4B875349-FB09-06C8-80D7-390B1F61EC44&mature_content=true HTTP/1.1" 200 371
[urllib3.connectionpool][debug] https://www.deviantart.com:443 "GET /api/v1/oauth2/deviation/download/4B875349-FB09-06C8-80D7-390B1F61EC44?mature_content=true HTTP/1.1" 200 1235
./gallery-dl/deviantart/greyanimebeast/Scraps/deviantart_313635530_Colossus closeup.jpg
[urllib3.connectionpool][debug] https://www.deviantart.com:443 "GET /l-i-j/art/Anthro-ratticate-289936580 HTTP/1.1" 200 None
[urllib3.connectionpool][debug] https://www.deviantart.com:443 "GET /api/v1/oauth2/deviation/8A96D41D-A581-461B-34EE-51BD7EC07E59 HTTP/1.1" 200 691
[urllib3.connectionpool][debug] https://www.deviantart.com:443 "GET /api/v1/oauth2/deviation/metadata?deviationids%5B0%5D=8A96D41D-A581-461B-34EE-51BD7EC07E59&mature_content=true HTTP/1.1" 200 405
./gallery-dl/deviantart/greyanimebeast/Scraps/deviantart_289936580_Anthro ratticate.jpg
[urllib3.connectionpool][debug] https://www.deviantart.com:443 "GET /l-i-j/art/Hysketch-iceanddarknesswithinn-289936363 HTTP/1.1" 200 None
[urllib3.connectionpool][debug] https://www.deviantart.com:443 "GET /api/v1/oauth2/deviation/53BD9233-2699-73AB-272A-089DF3060C35 HTTP/1.1" 200 696
[urllib3.connectionpool][debug] https://www.deviantart.com:443 "GET /api/v1/oauth2/deviation/metadata?deviationids%5B0%5D=53BD9233-2699-73AB-272A-089DF3060C35&mature_content=true HTTP/1.1" 200 443
./gallery-dl/deviantart/greyanimebeast/Scraps/deviantart_289936363_Hysketch_iceanddarknesswithinn.jpg
[urllib3.connectionpool][debug] https://www.deviantart.com:443 "GET /l-i-j/art/Hy-long1-289935984 HTTP/1.1" 200 None
[urllib3.connectionpool][debug] https://www.deviantart.com:443 "GET /api/v1/oauth2/deviation/A45D4CAA-38EC-A96F-A0ED-E27CBABF1A20 HTTP/1.1" 200 680
[urllib3.connectionpool][debug] https://www.deviantart.com:443 "GET /api/v1/oauth2/deviation/metadata?deviationids%5B0%5D=A45D4CAA-38EC-A96F-A0ED-E27CBABF1A20&mature_content=true HTTP/1.1" 200 593
./gallery-dl/deviantart/greyanimebeast/Scraps/deviantart_289935984_Hy_long1.jpg
[urllib3.connectionpool][debug] https://www.deviantart.com:443 "GET /l-i-j/art/Hy-hairdoodle-289935559 HTTP/1.1" 200 None
[urllib3.connectionpool][debug] https://www.deviantart.com:443 "GET /api/v1/oauth2/deviation/8227E14F-0F6A-69FA-ED0B-F548E418889D HTTP/1.1" 200 682
[urllib3.connectionpool][debug] https://www.deviantart.com:443 "GET /api/v1/oauth2/deviation/metadata?deviationids%5B0%5D=8227E14F-0F6A-69FA-ED0B-F548E418889D&mature_content=true HTTP/1.1" 200 403
./gallery-dl/deviantart/greyanimebeast/Scraps/deviantart_289935559_Hy_hairdoodle.jpg
[urllib3.connectionpool][debug] https://www.deviantart.com:443 "GET /l-i-j/art/Hy-hairstylesthinkies-289935262 HTTP/1.1" 200 None
[urllib3.connectionpool][debug] https://www.deviantart.com:443 "GET /api/v1/oauth2/deviation/08F9251E-15E6-1689-AFB6-9E6811DC74CF HTTP/1.1" 200 695
[urllib3.connectionpool][debug] https://www.deviantart.com:443 "GET /api/v1/oauth2/deviation/metadata?deviationids%5B0%5D=08F9251E-15E6-1689-AFB6-9E6811DC74CF&mature_content=true HTTP/1.1" 200 498
./gallery-dl/deviantart/greyanimebeast/Scraps/deviantart_289935262_Hy_hairstylesthinkies.jpg
[urllib3.connectionpool][debug] https://www.deviantart.com:443 "GET /l-i-j/art/Creeping-in-WIP-265917825 HTTP/1.1" 200 None
[urllib3.connectionpool][debug] https://www.deviantart.com:443 "GET /api/v1/oauth2/deviation/51E4B6B0-2FB7-913E-240B-B643CF1DD39A HTTP/1.1" 200 1206
[urllib3.connectionpool][debug] https://www.deviantart.com:443 "GET /api/v1/oauth2/deviation/metadata?deviationids%5B0%5D=51E4B6B0-2FB7-913E-240B-B643CF1DD39A&mature_content=true HTTP/1.1" 200 357
[urllib3.connectionpool][debug] https://www.deviantart.com:443 "GET /api/v1/oauth2/deviation/download/51E4B6B0-2FB7-913E-240B-B643CF1DD39A?mature_content=true HTTP/1.1" 200 1239
./gallery-dl/deviantart/greyanimebeast/Scraps/deviantart_265917825_Creeping in WIP.jpg
[urllib3.connectionpool][debug] https://www.deviantart.com:443 "GET /l-i-j/art/Dragonfly-Dragon-259039746 HTTP/1.1" 200 None
[urllib3.connectionpool][debug] https://www.deviantart.com:443 "GET /api/v1/oauth2/deviation/4BE309C9-5170-3A56-B9DC-6F87B5982F10 HTTP/1.1" 200 1054
[urllib3.connectionpool][debug] https://www.deviantart.com:443 "GET /api/v1/oauth2/deviation/metadata?deviationids%5B0%5D=4BE309C9-5170-3A56-B9DC-6F87B5982F10&mature_content=true HTTP/1.1" 200 319
./gallery-dl/deviantart/greyanimebeast/Scraps/deviantart_259039746_Dragonfly Dragon.jpg
[urllib3.connectionpool][debug] https://www.deviantart.com:443 "GET /l-i-j/art/Leetheya-259039435 HTTP/1.1" 200 None
[urllib3.connectionpool][debug] https://www.deviantart.com:443 "GET /api/v1/oauth2/deviation/2D3CEA9E-5BC6-B2A7-4523-59639E5D44F0 HTTP/1.1" 200 1055
[urllib3.connectionpool][debug] https://www.deviantart.com:443 "GET /api/v1/oauth2/deviation/metadata?deviationids%5B0%5D=2D3CEA9E-5BC6-B2A7-4523-59639E5D44F0&mature_content=true HTTP/1.1" 200 372
./gallery-dl/deviantart/greyanimebeast/Scraps/deviantart_259039435_Leetheya.jpg
[urllib3.connectionpool][debug] https://www.deviantart.com:443 "GET /l-i-j/art/Big-chicken-259039044 HTTP/1.1" 200 None
[urllib3.connectionpool][debug] https://www.deviantart.com:443 "GET /api/v1/oauth2/deviation/8EC0E5DC-FA79-E563-C367-44B4D12D7640 HTTP/1.1" 200 1053
[urllib3.connectionpool][debug] https://www.deviantart.com:443 "GET /api/v1/oauth2/deviation/metadata?deviationids%5B0%5D=8EC0E5DC-FA79-E563-C367-44B4D12D7640&mature_content=true HTTP/1.1" 200 363
./gallery-dl/deviantart/greyanimebeast/Scraps/deviantart_259039044_Big chicken.jpg
[urllib3.connectionpool][debug] https://www.deviantart.com:443 "GET /l-i-j/art/48AFK70048060-259038562 HTTP/1.1" 200 None
[urllib3.connectionpool][debug] https://www.deviantart.com:443 "GET /api/v1/oauth2/deviation/7818776C-5194-D0F3-6C4B-DA2E211BEDBC HTTP/1.1" 200 1114
[urllib3.connectionpool][debug] https://www.deviantart.com:443 "GET /api/v1/oauth2/deviation/metadata?deviationids%5B0%5D=7818776C-5194-D0F3-6C4B-DA2E211BEDBC&mature_content=true HTTP/1.1" 200 336
./gallery-dl/deviantart/greyanimebeast/Scraps/deviantart_259038562_48AFK70048060.jpg
[urllib3.connectionpool][debug] https://www.deviantart.com:443 "GET /l-i-j/art/Stars-deer-259038073 HTTP/1.1" 200 None
[urllib3.connectionpool][debug] https://www.deviantart.com:443 "GET /api/v1/oauth2/deviation/70FB221A-6753-13F4-2E85-8F93695EECAD HTTP/1.1" 200 1056
[urllib3.connectionpool][debug] https://www.deviantart.com:443 "GET /api/v1/oauth2/deviation/metadata?deviationids%5B0%5D=70FB221A-6753-13F4-2E85-8F93695EECAD&mature_content=true HTTP/1.1" 200 316
./gallery-dl/deviantart/greyanimebeast/Scraps/deviantart_259038073_Stars deer.jpg
[urllib3.connectionpool][debug] https://www.deviantart.com:443 "GET /l-i-j/art/76AFK11-3n4k-259037514 HTTP/1.1" 200 None
[urllib3.connectionpool][debug] https://www.deviantart.com:443 "GET /api/v1/oauth2/deviation/DB0D292D-B56C-8B3A-23A3-73EF5C71D2A6 HTTP/1.1" 200 1073
[urllib3.connectionpool][debug] https://www.deviantart.com:443 "GET /api/v1/oauth2/deviation/metadata?deviationids%5B0%5D=DB0D292D-B56C-8B3A-23A3-73EF5C71D2A6&mature_content=true HTTP/1.1" 200 349
[urllib3.connectionpool][debug] https://www.deviantart.com:443 "GET /api/v1/oauth2/deviation/download/DB0D292D-B56C-8B3A-23A3-73EF5C71D2A6?mature_content=true HTTP/1.1" 200 1237
./gallery-dl/deviantart/greyanimebeast/Scraps/deviantart_259037514_76AFK11 3n4k.jpg
[urllib3.connectionpool][debug] https://www.deviantart.com:443 "GET /l-i-j/art/Bull-259037035 HTTP/1.1" 200 None
[urllib3.connectionpool][debug] https://www.deviantart.com:443 "GET /api/v1/oauth2/deviation/A7C59F26-406C-1E69-6C85-38DB2A6BDDC8 HTTP/1.1" 200 1042
[urllib3.connectionpool][debug] https://www.deviantart.com:443 "GET /api/v1/oauth2/deviation/metadata?deviationids%5B0%5D=A7C59F26-406C-1E69-6C85-38DB2A6BDDC8&mature_content=true HTTP/1.1" 200 375
./gallery-dl/deviantart/greyanimebeast/Scraps/deviantart_259037035_Bull.jpg
[urllib3.connectionpool][debug] https://www.deviantart.com:443 "GET /l-i-j/art/bug-259035249 HTTP/1.1" 200 None
[urllib3.connectionpool][debug] https://www.deviantart.com:443 "GET /api/v1/oauth2/deviation/E5DF31E6-BDF5-E1EA-4B49-DC8501C1D09C HTTP/1.1" 200 1048
[urllib3.connectionpool][debug] https://www.deviantart.com:443 "GET /api/v1/oauth2/deviation/metadata?deviationids%5B0%5D=E5DF31E6-BDF5-E1EA-4B49-DC8501C1D09C&mature_content=true HTTP/1.1" 200 345
./gallery-dl/deviantart/greyanimebeast/Scraps/deviantart_259035249_bug.jpg
[urllib3.connectionpool][debug] https://www.deviantart.com:443 "GET /l-i-j/art/Ghaslion-259034695 HTTP/1.1" 200 None
[urllib3.connectionpool][debug] https://www.deviantart.com:443 "GET /api/v1/oauth2/deviation/7A7361C4-DCEF-1AB4-4F4E-7E2E1F4071FA HTTP/1.1" 200 1078
[urllib3.connectionpool][debug] https://www.deviantart.com:443 "GET /api/v1/oauth2/deviation/metadata?deviationids%5B0%5D=7A7361C4-DCEF-1AB4-4F4E-7E2E1F4071FA&mature_content=true HTTP/1.1" 200 360
./gallery-dl/deviantart/greyanimebeast/Scraps/deviantart_259034695_Ghaslion.jpg
[urllib3.connectionpool][debug] https://www.deviantart.com:443 "GET /l-i-j/art/Raed-259034087 HTTP/1.1" 200 None
[urllib3.connectionpool][debug] https://www.deviantart.com:443 "GET /api/v1/oauth2/deviation/E0CF8387-E19F-0009-41FE-6FF46F4E561D HTTP/1.1" 200 1050
[urllib3.connectionpool][debug] https://www.deviantart.com:443 "GET /api/v1/oauth2/deviation/metadata?deviationids%5B0%5D=E0CF8387-E19F-0009-41FE-6FF46F4E561D&mature_content=true HTTP/1.1" 200 393
./gallery-dl/deviantart/greyanimebeast/Scraps/deviantart_259034087_Raed.jpg
[urllib3.connectionpool][debug] https://www.deviantart.com:443 "GET /l-i-j/art/Grimmjow-full-259032592 HTTP/1.1" 200 None
[urllib3.connectionpool][debug] https://www.deviantart.com:443 "GET /api/v1/oauth2/deviation/672AB090-06F3-23D6-D108-E93FD0A02A53 HTTP/1.1" 200 1085
[urllib3.connectionpool][debug] https://www.deviantart.com:443 "GET /api/v1/oauth2/deviation/metadata?deviationids%5B0%5D=672AB090-06F3-23D6-D108-E93FD0A02A53&mature_content=true HTTP/1.1" 200 351
./gallery-dl/deviantart/greyanimebeast/Scraps/deviantart_259032592_Grimmjow full.jpg
[urllib3.connectionpool][debug] https://www.deviantart.com:443 "GET /l-i-j/art/Grimmjow-bust-259032338 HTTP/1.1" 200 None
[urllib3.connectionpool][debug] https://www.deviantart.com:443 "GET /api/v1/oauth2/deviation/D469104D-10A8-6588-BFAB-2030741D6176 HTTP/1.1" 200 1087
[urllib3.connectionpool][debug] https://www.deviantart.com:443 "GET /api/v1/oauth2/deviation/metadata?deviationids%5B0%5D=D469104D-10A8-6588-BFAB-2030741D6176&mature_content=true HTTP/1.1" 200 326
./gallery-dl/deviantart/greyanimebeast/Scraps/deviantart_259032338_Grimmjow bust.jpg
[urllib3.connectionpool][debug] https://www.deviantart.com:443 "GET /l-i-j/art/umbrella-closeup-214056696 HTTP/1.1" 200 None
[urllib3.connectionpool][debug] https://www.deviantart.com:443 "GET /api/v1/oauth2/deviation/5AFC4FD0-15B7-615E-7E7C-EECCE9C40220 HTTP/1.1" 200 1211
[urllib3.connectionpool][debug] https://www.deviantart.com:443 "GET /api/v1/oauth2/deviation/metadata?deviationids%5B0%5D=5AFC4FD0-15B7-615E-7E7C-EECCE9C40220&mature_content=true HTTP/1.1" 200 398
[urllib3.connectionpool][debug] https://www.deviantart.com:443 "GET /api/v1/oauth2/deviation/download/5AFC4FD0-15B7-615E-7E7C-EECCE9C40220?mature_content=true HTTP/1.1" 200 1240
./gallery-dl/deviantart/greyanimebeast/Scraps/deviantart_214056696_umbrella closeup.jpg
[urllib3.connectionpool][debug] https://www.deviantart.com:443 "GET /l-i-j/art/Horse-2-209989966 HTTP/1.1" 200 None
[urllib3.connectionpool][debug] https://www.deviantart.com:443 "GET /api/v1/oauth2/deviation/11B58C4E-BF85-F30A-3719-E65C11E690B8 HTTP/1.1" 200 1059
[urllib3.connectionpool][debug] https://www.deviantart.com:443 "GET /api/v1/oauth2/deviation/metadata?deviationids%5B0%5D=11B58C4E-BF85-F30A-3719-E65C11E690B8&mature_content=true HTTP/1.1" 200 339
[urllib3.connectionpool][debug] https://www.deviantart.com:443 "GET /api/v1/oauth2/deviation/download/11B58C4E-BF85-F30A-3719-E65C11E690B8?mature_content=true HTTP/1.1" 200 1233
./gallery-dl/deviantart/greyanimebeast/Scraps/deviantart_209989966_Horse 2.jpg
[urllib3.connectionpool][debug] https://www.deviantart.com:443 "GET /l-i-j/art/Horse-1-209989792 HTTP/1.1" 200 None
[urllib3.connectionpool][debug] https://www.deviantart.com:443 "GET /api/v1/oauth2/deviation/521B6AB3-7666-35EB-6EC0-F2CA99948E06 HTTP/1.1" 200 1192
[urllib3.connectionpool][debug] https://www.deviantart.com:443 "GET /api/v1/oauth2/deviation/metadata?deviationids%5B0%5D=521B6AB3-7666-35EB-6EC0-F2CA99948E06&mature_content=true HTTP/1.1" 200 344
[urllib3.connectionpool][debug] https://www.deviantart.com:443 "GET /api/v1/oauth2/deviation/download/521B6AB3-7666-35EB-6EC0-F2CA99948E06?mature_content=true HTTP/1.1" 200 1231
./gallery-dl/deviantart/greyanimebeast/Scraps/deviantart_209989792_Horse 1.jpg
[urllib3.connectionpool][debug] https://www.deviantart.com:443 "POST /dapi/v1/gallery/0 HTTP/1.1" 403 83
[deviantart][error] HTTP request failed:  403: Forbidden for url: https://www.deviantart.com/dapi/v1/gallery/0

This was after I'd already downloaded them, but it happened the first time too.

@mikf mikf added the bug label Aug 11, 2019
@mikf mikf closed this as completed in 423f68f Aug 11, 2019
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
Projects
None yet
Development

No branches or pull requests

2 participants