Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

[urlgalleries] add support #4886

Merged
merged 2 commits into from Dec 8, 2023
Merged

[urlgalleries] add support #4886

merged 2 commits into from Dec 8, 2023

Conversation

JSouthGB
Copy link
Contributor

@JSouthGB JSouthGB commented Dec 5, 2023

For #919, #1184, #2905

incomplete

Gallery image urls redirect to a hosting site:

gallery url - https://beautiesonearth.urlgalleries.net/porn-gallery-6915206/gemma-arterton-%2a100-streets%2a-premiere-in-london-nov-8

image url - https://beautiesonearth.urlgalleries.net/gemma-arterton-+100-streets+-premiere-in-london-nov-8-w59n0dk3qy.jpg

image url forwards to - https://pixhost.to/show/952/35141831_dcotqomb.jpg

The extractor needs corrected to follow the redirect, work in progress. Right now it saves the image host source code as an image file.

@mikf
Copy link
Owner

mikf commented Dec 5, 2023

Gallery image urls redirect to a hosting site:

In that case you should not use the GalleryExtractor interface and need to spin your own items() that yields Message.Queue messages.

category = "urlgalleries"
root = "urlgalleries.net"
directory_fmt = ("{category}", "{title}")
pattern = r"(?:https?://)([^/?#]+)?\.urlgalleries\.net/([^/?#]+)/([^/?#]+)"
Copy link
Owner

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

Suggested change
pattern = r"(?:https?://)([^/?#]+)?\.urlgalleries\.net/([^/?#]+)/([^/?#]+)"
pattern = r"(?:https?://)([^/?#]+\.)?urlgalleries\.net/([^/?#]+)/([^/?#]+)"

otherwise it would match https://.urlgalleries.net

@mikf mikf merged commit ecaa0fe into mikf:master Dec 8, 2023
9 checks passed
@JSouthGB
Copy link
Contributor Author

JSouthGB commented Dec 9, 2023

Thank you for completing this. I don't believe I was anywhere near a working solution.

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
None yet
Projects
None yet
Development

Successfully merging this pull request may close these issues.

None yet

2 participants