New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Request sites to support here #8

Open
4pr0n opened this Issue Apr 5, 2014 · 191 comments

Comments

Projects
None yet
@4pr0n
Owner

4pr0n commented Apr 5, 2014

PLEASE include an example URL of the type of album to rip.


Supported sites + commits:


Pending sites + examples (NSFW):


Enhancement requests:

  • flickr - login support (see #32)
  • vk - Video ripper rename files
  • twitter - Search ripping
  • gifyo - Don't skip some images
  • *chan rippers - Handle external links (vocaroo), store comments
  • tumblr - Rip by date (/archive/year/month)

@4pr0n 4pr0n changed the title from Rip from these sites to Request sites to support here Apr 6, 2014

@CaspianRoach

This comment has been minimized.

CaspianRoach commented Apr 12, 2014

wakaba threads on imageboards (such as 4chan or more examples here http://allchans.org/)

Random example: http://desuchan.net/v/res/7034.html
Can probably be done by retrieving all that point to an image file extension. Or constricted to /src/ folder.

With that in mind, maybe this method can be expanded to allow the ripping of 'generic' web album pages, the ones that link directly to the files.

@4pr0n

This comment has been minimized.

Owner

4pr0n commented Apr 12, 2014

I'll look into supporting generic *chan* sites.

maybe this method can be expanded to allow the ripping of 'generic' web album pages, the ones that link directly to the files.

For that, there's already DownThemAll, the Firefox add-on which works really well.

4pr0n added a commit that referenced this issue Apr 12, 2014

@4pr0n

This comment has been minimized.

Owner

4pr0n commented Apr 13, 2014

maybe this method can be expanded to allow the ripping of 'generic' web album pages, the ones that link directly to the files.

I've had an idea for a ripper that can scrape anything, like random message boards that link to imagebam.com galleries or imgur albums. It would default to just try to scrape the page if the host isn't strictly supported. It would require refactoring the existing rippers, and adding a ton of one-off single-image hosts (imagetwist etc) which would be painful, but it's possible.

@CaspianRoach

This comment has been minimized.

CaspianRoach commented Apr 16, 2014

Not sure if it's worth your time, but there's this site:
http://kinkyshare.com
and I just can't leave it because I'm constantly opening new images from the bottom side :)

anyway, they sometimes have galleries like this http://kinkyshare.com/c/1857/blonde_and_brunette_margo_et_lilas_-_amiti_et_complicit
and this http://kinkyshare.com/c/1384/gia_felino_-_barbie_latex_catsuit

If it's not too much trouble a ripper for albums or even tag pages here would be nice.

@CaspianRoach

This comment has been minimized.

CaspianRoach commented Apr 16, 2014

Pornhub seems to have a decent number of albums, too.
http://www.pornhub.com/albums
It feels like a popular enough site to bother with a ripper for it.

@domonic46

This comment has been minimized.

domonic46 commented Apr 20, 2014

Request for support for:
Butttoucher.com
getgonewild.com
i.rarchives.com user pages
and teenplanet.org
Thank you for making this ripper!

@4pr0n

This comment has been minimized.

Owner

4pr0n commented Apr 20, 2014

Request for support for:
Butttoucher.com
getgonewild.com
i.rarchives.com user pages

Instead of waiting for these rippers to be implemented, try ripping http://gonewild.com/user/username (replace username with the user's name). It's more exhaustive than the above sites but doesn't always have the user.

@slipl

This comment has been minimized.

slipl commented Apr 21, 2014

Is Photobucket on the list?

@4pr0n

This comment has been minimized.

Owner

4pr0n commented Apr 21, 2014

Is Photobucket on the list?

It is now. Stay (patiently) tuned

4pr0n added a commit that referenced this issue Apr 21, 2014

4pr0n added a commit that referenced this issue Apr 21, 2014

@4pr0n

This comment has been minimized.

Owner

4pr0n commented Apr 21, 2014

3 commits above are in latest version & ripme should be updateable to this version.

@domonic46: getgonewild doesn't appear to work -- I can't find any "profiles" that contain imgur links. Hence the bolded text in OP:

Requests must include an example URL

@slipl

This comment has been minimized.

slipl commented Apr 22, 2014

Flickr support would be very nice too, thanks!

@Jar4ek

This comment has been minimized.

Jar4ek commented Apr 22, 2014

Request for support for:
flickr.com | For example, the photo on this page is not available download option. https://www.flickr.com/photos/beargills/

artician.com
pixiv.net

Thank you for making this ripper!

4pr0n added a commit that referenced this issue Apr 23, 2014

@crimble

This comment has been minimized.

crimble commented Apr 24, 2014

Possible to add a video ripper for something like this
http://vk.com/videos213696261

@4pr0n

This comment has been minimized.

Owner

4pr0n commented Apr 24, 2014

Haven't fully tested the VK video album ripper (hard to with a sample album of 2,000+ videos). It starts downloading them, so I guess it works.

@Jar4ek

This comment has been minimized.

Jar4ek commented Apr 24, 2014

Recently I asked for support for Flickr page and it works very good, but there is a problem. Namely, the pictures were downloaded link only partially.

Link: https://www.flickr.com/photos/beargills/ to 1,470 images downloaded only 100 photos. I'd asked for a solution to this problem.

Next Link : www.flickr.com/photos/gestiefeltekatze to 1,290 images downloaded only 100 photos. I'd asked for a solution to this problem.

I also failed to download photos from this site:

https://www.flickr.com/photos/bubuyalove/

I also would ask for support downloading photos from the 500px.com

If there is such a possibility, please let me know the solution to this problem.

Best Regards Jarek.

@crimble

This comment has been minimized.

crimble commented Apr 25, 2014

The VK video ripper is working great so far but before I attempt all 2,000+ videos, are there any original file names available to replace the current output?

What I'm getting now:
001_f4fc9d1705.720.mp4
002_dc3bda4117.720.mp4
003_9bc4105e2d.720.mp4

4pr0n added a commit that referenced this issue Apr 25, 2014

@4pr0n

This comment has been minimized.

Owner

4pr0n commented Apr 25, 2014

Looks like Flickr changed the login scheme to use javascript to set cookies that are required for logging in. The scheme is too complex for me to bother with. This means the Flickr ripper can't rip NSFW images.

I left the code to login (which used to work a few months ago) in case someone else wants to pick it up.

@dianasshi

This comment has been minimized.

dianasshi commented Apr 25, 2014

Request for support for
MINUS
http://exogallery.minus.com/mYzoL2DVlmXMJ

@erofanboy

This comment has been minimized.

erofanboy commented Apr 25, 2014

is it possible to rip partially tumblr archives, e.g. http://***.tumblr.com/archive/2014/4 ?

4pr0n added a commit that referenced this issue Apr 25, 2014

@anivia123

This comment has been minimized.

anivia123 commented Mar 28, 2017

Can you please add support for apina.nwps.ws
Example link - http://apina.nwps.ws/realgirls/madisondeckk/
Thanks

@cyian-1756

This comment has been minimized.

Contributor

cyian-1756 commented Mar 28, 2017

@BlueAnchorite Please provide example albums

@cyian-1756

This comment has been minimized.

Contributor

cyian-1756 commented Mar 28, 2017

@anivia123 I'm not really sure that ripme should support http://apina.nwps.ws. It looks a lot like a generic junk site (it's faking the total visitors, links to a chat site at the top of every page), it has very limit content and very rare updates, it seems to be on free hosting, it seems to be made to fool users into thinking it's an open directory (it lists index.php) and it has a bunch of domain names that all point to the same site.

@rudolphos

This comment has been minimized.

rudolphos commented Mar 31, 2017

Can vsco please be added ?
User above posted the request, but it was not referenced.

@cyian-1756

This comment has been minimized.

Contributor

cyian-1756 commented Mar 31, 2017

@rudolphos

@domonic46

It looks like ripme can't support vsco as the site requires javascript to load images and ripme does not have a javascript engine

@MrBiggz007

This comment has been minimized.

MrBiggz007 commented Apr 19, 2017

@cyian-1756 I can't seen to find my original post, but here are some example links I just grabbed off the pages:

http://forum.oneclickchicks.com/showthread.php?t=47951
http://forum.oneclickchicks.com/showthread.php?t=68338

Also, is there a way to rip your own "my likes" album on Tumblr? I can rip my posted photos easily but I can't get "my likes" to rip?

@cyian-1756

This comment has been minimized.

Contributor

cyian-1756 commented Apr 19, 2017

@MrBiggz007

Also, is there a way to rip your own "my likes" album on Tumblr?

I have no idea. You might be able to just rip it like any tumblr page.

I can't get "my likes" to rip?

What error message (if any) do you get?

@MrBiggz007

This comment has been minimized.

MrBiggz007 commented Apr 19, 2017

@metaprime

This comment has been minimized.

Collaborator

metaprime commented Apr 25, 2017

I'm locking this issue and diverting discussion to the new issue #502. Feel free to link back to comments on this issue. Thanks for understanding!

Repository owner locked and limited conversation to collaborators Apr 25, 2017

@metaprime

This comment has been minimized.

Collaborator

metaprime commented Apr 25, 2017

Oh, looks like if I lock an issue I can't use reactions to keep track of which items I've listed in #510. So I guess I'm unlocking the issue. Use your discretion, but I'd still urge people to move their discussions to #502.

@Flip32

This comment has been minimized.

Flip32 commented Jun 7, 2017

Hi, It seems Imagebam it's not working! And when does, the pics come smaller.

ex.: http://www.imagebam.com/gallery/72c5utvqv44wcqnkc9vzapm5yck8j1cr

@cyian-1756

This comment has been minimized.

Contributor

cyian-1756 commented Jun 7, 2017

@Flip32 Can you make a entirely new issue please? This issue was for tracking site support and has since been replaced

@jimbotomato

This comment has been minimized.

jimbotomato commented Jun 16, 2017

XHamster changed their gallery URL format so Ripme doesn't detect it anymore, could I most humbly request for an update to fix this please? =)

Previously:
xha*****.com/photos/gallery/@@numbers@@/@@name@@.html

Now:
xha******.com/photos/gallery/@@name@@-@@numbers@@

@spartan9362

This comment has been minimized.

spartan9362 commented Jul 5, 2017

Could you make a vsco.co/ ripper please it's a very good site Example: vsco.co/samdavis125 and vsco.co/samdavis125/images/1

@XeonPhobia

This comment has been minimized.

XeonPhobia commented Jul 11, 2017

I'm trying to add support for imgsrc.ru site, however I have a few issues, does anyone know how to get all URLs with data-src like the example below into an array with getURLsFromPage? Is there more documentation or tutorials on these kinds of problems?

a href='#54225016_next'> img class='big lazyload' data-src='http://URLj.jpg' src='URL'
</a

(had to remove some <>)

@cyian-1756

This comment has been minimized.

Contributor

cyian-1756 commented Jul 12, 2017

Is there more documentation or tutorials on these kinds of problems?

Check out the wiki

@metaprime

This comment has been minimized.

Collaborator

metaprime commented Jul 13, 2017

Please make new requests at #502

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment