Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Deviant Art 403 errors #159

Closed
ghost opened this issue Jan 17, 2015 · 8 comments
Closed

Deviant Art 403 errors #159

ghost opened this issue Jan 17, 2015 · 8 comments
Labels

Comments

@ghost
Copy link

ghost commented Jan 17, 2015

Hey 4_pr0n,

There's also, all of a sudden, 403 errors coming from Deviant Art.

Here are some samples of the issue:
2015-01-16 16:49:39,310 ERROR ripper.DownloadFileThread - [!] Non-retriable status code 403 while downloading from http://www.deviantart.com/download/183604348/brenna_by_balassa-d31ba0s.jpg?token=e9346d31c3b654cdd0a34ae345063fe87d1e1efc&ts=1421445574
2015-01-16 16:49:39,410 ERROR ripper.DownloadFileThread - [!] Non-retriable status code 403 while downloading from http://www.deviantart.com/download/183462125/ashley_by_balassa-d3188a5.jpg?token=23995813072610d18fdd13c20907618145e0739f&ts=1421445574
2015-01-16 16:49:39,423 ERROR ripper.DownloadFileThread - [!] Non-retriable status code 403 while downloading from http://www.deviantart.com/download/183456727/nicole_by_balassa-d318447.jpg?token=93f624960c01b575e8a6230633e0795080f062f5&ts=1421445575
2015-01-16 16:49:39,429 ERROR ripper.DownloadFileThread - [!] Non-retriable status code 403 while downloading from http://www.deviantart.com/download/183134405/simply_lit_by_balassa-d3117et.jpg?token=dd84f955905fb2e81e45fbec482a706f0c5fc76f&ts=1421445575
2015-01-16 16:49:39,532 ERROR ripper.DownloadFileThread - [!] Non-retriable status code 403 while downloading from http://www.deviantart.com/download/182600885/poolside_pose_by_balassa-d30prqt.jpg?token=4708e2467416a2ac5dea54cc619be250dece70f2&ts=1421445576

Also, what does the Deviant Art ripper rip now, since I know there have been a few fixes along the way? Can I just put the user's home page to rip? Or do I have to go to their work section or add their individual album urls each time?

@4pr0n 4pr0n closed this as completed in c2a9d68 Jan 26, 2015
@4pr0n
Copy link
Owner

4pr0n commented Jan 26, 2015

Looks like DeviantArt throws 403 errors after a certain number of files are ripped. I added an extra-long sleep timer so the 403 errors shouldn't be a problem... but now it takes a really long time to rip a user's pictures (like 2-3 seconds per rip).

Also, what does the Deviant Art ripper rip now, since I know there have been a few fixes along the way?

It now rips the image descriptions which are saved to a .txt file.

Can I just put the user's home page to rip? Or do I have to go to their work section or add their individual album urls each time?

You can go to their "all" page (/gallery/?catpath=/) but I made a change so if you type http://username.deviantart.com it auto-completes to http://username.deviantart.com/gallery/?catpath=/, so you just need the username.deviantart.com and it should get all of their deviations.

@4pr0n
Copy link
Owner

4pr0n commented Jan 26, 2015

Was able to rip ~150 images from an account without any 403 errors. If you get errors again, reopen this and I'll adjust the sleep times.

@ghost
Copy link
Author

ghost commented Feb 5, 2015

I was able to rip most of the deviations from a few accounts, but I got about seventeen 403 errors. They came mostly at the end of the last user.

@4pr0n 4pr0n reopened this Feb 8, 2015
EraYaN pushed a commit to EraYaN/ripme that referenced this issue Feb 11, 2015
4pr0n added a commit that referenced this issue Feb 13, 2015
@4pr0n 4pr0n added the bug label Feb 20, 2015
@meongx
Copy link

meongx commented Apr 18, 2016

using v1.2.12 this issue is back when ripping gallery with hundreds of images. probably DeviantArt modified its limit?

sample gallery: http://reef1600.deviantart.com/

@code-monkey231
Copy link

I've been receiving the 403 errors. I'm using v1.4.1

Any ideas what I can do to fix this?

@metaprime
Copy link
Collaborator

Websites change from time to time which breaks RipMe's rippers' logic which is tightly tied to the layout of websites. Likely the current issue is not related to this issue from 2 years ago.

I think your current complaint is covered by #424 so I won't reopen this issue.

@code-monkey231
Copy link

Interestingly enough over the last 24 hours my issue has become that covered in #424 - before that it was exactly this one. Thanks for the reply, I'll keep an eye out for a fix to #424

@metaprime
Copy link
Collaborator

Didn't realize this issue was still open. Will track the issue in #424

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
Projects
None yet
Development

No branches or pull requests

4 participants