Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

R18.com scrape doesn't work anymore #335

Open
capt1234 opened this issue Sep 18, 2020 · 11 comments
Open

R18.com scrape doesn't work anymore #335

capt1234 opened this issue Sep 18, 2020 · 11 comments
Labels

Comments

@capt1234
Copy link

Describe the bug
All the other sites are working, but scraping from r18.com does not work anymore. On the date 16th September 2020 it was working, but today, 18th September 2020 it is not working anymore.

Give an example
You can try any JAV-Movie, it doesn't work.

@capt1234 capt1234 added the bug label Sep 18, 2020
@Borisbee1
Copy link

R18 refuses connections unless you provide a user agent now

@capt1234
Copy link
Author

Oh, damn! The translations from R18 are well translated... the translations from javlibrary.com are bad, seem to be auto-translated... :-(

@zuko7177
Copy link
Contributor

zuko7177 commented Sep 18, 2020

R18 scraping is working for me without UserAgent.
Nonetheless, I've updated my PR to add UserAgent to R18.
77f394f

@Json188
Copy link

Json188 commented Sep 19, 2020

Ya, same here DMM\FANZA scrape also not working

@NewMember12345
Copy link

@zuko7177 you mind doing a build on your github fork so we peasants who don't know how to compile to get a jar?

@zuko7177
Copy link
Contributor

zuko7177 commented Sep 20, 2020

Building a jar should be easy as I added the gradle wrapper.

  1. Install JDK 11
  2. Clone my fork to your local drive.
  3. On windows, run the gradle wrapper: gradlew.bat shadowJar
  4. The jar is in \JAVMovieScraper\build\libs\

I've attached the jar if anyone still needs it. JAVMovieScraper-all.zip

I've switched to using https://github.com/jvlflame/Javinizer. It's been good and really fast. The repo owner does a great job. I'd encourage anyone to check it out.

My process is now

  1. Use Javinizer to do initial scrapes.
  2. Afterwards, use JAVMovieScraper to scroll through the scrapes. Make manual changes if needed.
  3. Enjoy.

@NewMember12345
Copy link

@zuko7177 Thank you very much for the included gradle wrapper. It makes it so simple!
I just tried Javinizer - The work flow is very different for my personal use. I have my mp4 sorted into its own folders with diff mp4 info like abc-123.1080p.mp4 or abc-123.uncenosred.mp4. Javinizer pretty much strips all my mp4's filename info into plain ABC-123 and it sorts into its own folder with the title names in the folder name. I looked into the setting files there and didn't seem like I can change this behavior.

@zuko7177
Copy link
Contributor

zuko7177 commented Sep 20, 2020

@zuko7177 Thank you very much for the included gradle wrapper. It makes it so simple!
I just tried Javinizer - The work flow is very different for my personal use. I have my mp4 sorted into its own folders with diff mp4 info like abc-123.1080p.mp4 or abc-123.uncenosred.mp4. Javinizer pretty much strips all my mp4's filename info into plain ABC-123 and it sorts into its own folder with the title names in the folder name. I looked into the setting files there and didn't seem like I can change this behavior.

I would give Javinizer 2.0 documentation another look. There is a nice settings file. I see a setting to "not rename files".
sort.renamefile : Specifies to rename the movie file after being sorted. values is 0 or 1.
And there are various settings for folder and file handling too.
Perhaps post a question if it supports what you want. Who knows... the repo owner may implement it. jvlflame has been receptive to reasonable requests.

Anyways, hope my updates to JAVMovieScraper helps you.
I probably won't update it much further since I no longer use it as much.

@NewMember12345
Copy link

I'll give it a try again with that setting off. Thanks for helping us zuko7177.

@berrysoda
Copy link

Building a jar should be easy as I added the gradle wrapper.

1. Install JDK 11

2. Clone my fork to your local drive.

3. On windows, run the gradle wrapper:  gradlew.bat shadowJar

4. The jar is in \JAVMovieScraper\build\libs\

I've attached the jar if anyone still needs it. JAVMovieScraper-all.zip

Any slightly more level 0 instructions? I get JDK installed, download the zip of your fork, unzip it, win+r then pasting "gradlew.bat shadowJar" doesn't find it. running the "gradelw.bat" in the unzip of your fork does something when ran, but it closes the second it finishes, so I don't know what it did. Looked around but didn't find any signs of the jar of your version having been created.

@NewMember12345
Copy link

Building a jar should be easy as I added the gradle wrapper.

1. Install JDK 11

2. Clone my fork to your local drive.

3. On windows, run the gradle wrapper:  gradlew.bat shadowJar

4. The jar is in \JAVMovieScraper\build\libs\

I've attached the jar if anyone still needs it. JAVMovieScraper-all.zip

Any slightly more level 0 instructions? I get JDK installed, download the zip of your fork, unzip it, win+r then pasting "gradlew.bat shadowJar" doesn't find it. running the "gradelw.bat" in the unzip of your fork does something when ran, but it closes the second it finishes, so I don't know what it did. Looked around but didn't find any signs of the jar of your version having been created.

I had it working briefly but with the constant changes, this github project sort of have been abandoned. I've also transitioned to using Javinzer by Jvflame. Works very well. I'm using the command line interface because the GUI never worked for me. It scrapes faster than javmoviescraper and now has added MGStage support!

https://github.com/jvlflame/Javinizer

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
Projects
None yet
Development

No branches or pull requests

6 participants