-
-
Notifications
You must be signed in to change notification settings - Fork 409
New issue
Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.
By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.
Already on GitHub? Sign in to your account
Scrapers Request #73
Comments
Girlsway is already supported
|
ok sorry i |
Any interest in adding Tushy and TushyRaw? |
there one in the works if you look at the pull request, "Create vixenNetwork.yml xPath" |
The big hang up on the Vixen Media one is the images #1 (comment) . They are inserted via javascript and unpredictable in their position in the script. |
You can cross off AngelaWhite. |
@binarygeek119 xvideos, xnxx and xtube were merged. |
done |
@binarygeek119 hucows and xhamster ( new postprocess format so dev build required) were merged can you update ? |
done |
@binarygeek119 can you cross off xtube also ? it was merged along with xnxx and xvideos |
done |
Hope its still ok to make requests? dorcelclub| https://www.dorcelclub.com/| paid | no | none You are able to view each scene individually eg https://www.dorcelclub.com/en/scene/31298/so-xtrem-valentina-nappi |
added to the list |
@binarygeek119 dorcel club was just merged can you update ? |
done |
@binarygeek119 tushy,tushyraw were merged with the vixen network scraper . can you update? |
done also added some more i like to see |
Thanks for the last one; another request if someone can? Mandy Flores | https://mandyflores.com/ | paid | no | none |
@binarygeek119 mandyflores was merged , can you update ? |
done |
I gave this a shot but their website not only uses Cloudflare but they also store their consent "cookie" in localstorage and I haven't found a way to get around that using either CDP in an XPath scraper nor the Adding it to the list anyway, but this might need a bigger brain than mine 😅 |
@hurricaneporter I have added scene and performer scrapers for Broke Straight Boys (and the other sites from that network: Boy Gusher, College Boy Physicals and College Dudes) Working on Trailer Trash Boys, which seems to be a part of Naked Sword, so I'll probably end up fixing Naked Sword while I'm at it Triga films is behind Cloudflare and will be trickier, I am currently IP banned because I kept trying to scrape them 😅 |
Gelbooru | Gelbooru.com | free | no | mostly images, but also some scenes. |
Thanks for taking the time! Appreciated. |
Treasure Island Media | https://www.treasureislandmedia.com/ | premium | no | Scenes and Performers, base website of a network I could probably think of a few more, but I'm probably already asking too much. LOL. As I said in the notes, the Treasure Island Media site is the base site of their network of sites. Though most stuff is available on the main site, it would be useful to scrape the other sites as well. Do I need to request every site of the network individually or does this cover it? |
avmoo | https://avmoo.online/ | free | no subscription | Scenes and Performers, contain images for both, change domain name frequently, JAV only |
hobby.porn | https://hobby.porn/ | free | no subscription | Scenes and Performers, contains a lot deleted information from PornHub |
Solved by #1594 |
javdatabase | https://www.javdatabase.com/ | free | no subscription | Scenes & Performers, images available for both, JAV only Scenes: https://www.javdatabase.com/movies/ (metadata available) |
|
We already have a scraper for Minnano-AV. It's written in Python so it's able to properly handle the inconsistent way they list aliases for performers 🙂 |
roger, get it removed |
Twisted Factory | https://www.twistedfactory.com/ | free | requires subscription to view: no | Scenes and Performers There are certain scenes not available from kink.com but they're available on https://www.twistedfactory.com/ |
TMDB | https://www.themoviedb.org/ | free | requires subscription to view: no | Scenes and Performers |
erodougazo | https://erodougazo.com | free | no subscription | detailed Performer & film metadata, JAV only example link: https://erodougazo.com/actress/av/%E6%96%B0%E4%BA%95%E3%83%AA%E3%83%9E/ |
Happy to report that we now have a scraper for GEVI that can be installed from the web UI! It requires Python along with the Huge thanks to awesomeness who pointed me in the right direction to get around the Cloudflare issues I had before 👍 |
Ersties | https://ersties.com/ | paid | no* | *some scene info appears to be posted on their blog but model and additional scene info appears to be locked behind a free account |
Create scraper for itspov.com and its sub sites |
You can cross off Facial Abuse, as it's included in the relatively new AdultDoorway scraper. |
You can also cross off Trailer Trash Boys. It's now included in a recent update to the NakedSword scraper. |
Closing this in favor of creating individual issues for scraper requests: if you've come here to request a new scraper, please open a new issue for that |
updated on April 22, 2024
This issue is to remain open as a ongoing list.
I will
crossoutonce we get it made.Any of this can be worked on at any time.
Please ask for site with this style.
name of site | url | free/paid/premium(pay for more) | requires subscription to view (yes/no) | notes
21roleshttps://www.21roles.com/paidnononeadult time studioshttps://www.adulttime.com/paidyesnoneangela whitehttp://angelawhite.com/paidnononeavmoohttps://avmoo.online/freeno subscriptionScenes and Performers, contain images for both, change domain name frequently, JAV onlyBroke Straight Boyshttps://brokestraightboys.com/paidnoMostly clipsCadinothttps://www.cadinot.fr/enpaidnononeCarnal+https://carnalplus.com/paidnoNoneChanta's Bitcheshttps://www.twistedfactory.com/freenoScenes and PerformersMorton BridgesChanta's Bitcheshttps://www.twistedfactory.com/freenoScenes and PerformersCockyBoyshttps://cockyboys.com/paidnoNoneColby Knoxhttps://www.colbyknox.com/PaidnoScenes and PerformersColettehttps://www.colette.com/paidnoNonedickdrainershttp://dickdrainers.com/paidyesjust the scenesdorcelclubhttps://www.dorcelclub.com/paidnononeFacial Abusehttps://tour5m.facialabuse.compaidnoscenesFetish Networkhttp://www.fetishnetwork.com/paidnosub sites can be scraped from the main siteFuckedHard18http://fuckedhard18.com/membersarea/paidnonoGay Erotic Video Indexhttps://gayeroticvideoindex.com/freenononegirlswayhttps://www.girlsway.com/paidnononeGloryhole Secretshttps://www.gloryholesecrets.com/paidnononeGuys in Sweatpantshttps://guysinsweatpants.compaidnononeHarmonyVisionhttps://harmonyvision.com/paidnononehobby.pornhttps://hobby.porn/freeno subscriptionScenes and Performers, contains a lot deleted information from PornHubhucowshttps://www.hucows.com/paidnononeHung Young Brithttps://www.hungyoungbrit.com/Paidno for Scenes, Yes for Performersnoneincestflixhttp://www.incestflix.com/freenononeJacquie & Michel TVhttps://www.jacquieetmicheltv.netpaidnoblockedjavdatabasehttps://www.javdatabase.com/freenoScenes & Performers, images available for both, JAV onlylordaardvarkhttp://www.lordaardvark.com/freenononeMandy Floreshttps://mandyflores.com/paidnononemetarthttps://www.metart.com/premiumnononemotherlesshttps://motherless.com/freenononeMy Dirty Hobbyhttps://www.mydirtyhobby.com/paidnoScenes and ModelsNYSEEDhttps://nyseedxxx.com/PaidnoScenes and PerformersOlder4Mewww.older4me.com/homepaidnoAdultSiteRunner networkrachel steelehttps://rachel-steele.com/paidnononeRaw Fuck Clubhttps://www.rawfuckclub.com/PremiumnoScenes and Performersshiny's bound slutshttps://shinysboundsluts.com/paidyesbrowser able with out membershipspankbanghttps://spankbang.com/freenononestrokieshttp://www.strokies.com/paidnononestudiofowhttps://studiofow.com/freenononeTadpolexstudiohttps://www.tadpolexstudio.compaidnonon-VR scenes for tadpole studioTMDBhttps://www.themoviedb.org/freenoScenes and PerformersTrailer Trash Boyshttps://trailertrashboys.com/paidnoMostly clipstraxxxhttps://traxxx.mefreenononeTreasure Island Mediahttps://www.treasureislandmedia.com/premiumnoScenes and Performerstushyrawhttps://www.tushyraw.com/paidnononetushyhttps://www.tushy.com/paidnononeTwisted Factoryhttps://www.twistedfactory.com/freenoScenes and Performerswatchmygfhttps://www.watchmygf.mefreenononexhamsterhttp://xhamster.com/premiumnononexnxxhttps://www.xnxx.com/premiumnononextubehttps://www.xtube.com/premiumnononeWTFPasshttps://wtfpass.com/paidnononexvideoshttps://www.xvideos.com/premiumnononeyoupornhttps://youporn.comfreenononenotes
The text was updated successfully, but these errors were encountered: