Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

RIPME very often java.net.SocketTimeoutException: Read timed out #606

Open
m4ntic0r opened this issue Nov 18, 2017 · 4 comments
Open

RIPME very often java.net.SocketTimeoutException: Read timed out #606

m4ntic0r opened this issue Nov 18, 2017 · 4 comments

Comments

@m4ntic0r
Copy link

m4ntic0r commented Nov 18, 2017

I dont know what i should do anymore.. i am ripping some reddit picture threads, and it is very often that the whole process is freezing and i have to kill the java process.

i am using latest ripme version, and java 1.8.0_131-b11 on a debian 9 stable system

my command is:

java -jar /path/ripme.jar -l /path/ripme/rips -u https://www.reddit.com/r/astrophotography/new/ >> path/logfile.log

in my logs i always see:

`[!] Skipping https://apod.nasa.gov/apod/image/1711/HubblesVariableNebula_HubbleSchmidt_1507.jpg -- file already exists: /hdd/collector/ripme/rips/reddit_sub_spaceporn/7bjvva-HubblesVariableNebula_HubbleSchmidt_1507.jpg
[!] Skipping https://i.redd.it/2xakxvhezkwz.png -- file already exists: /hdd/collector/ripme/rips/reddit_sub_spaceporn/7becjy-2xakxvhezkwz.png
[!] Skipping https://i.imgur.com/F3lu5vq.png -- file already exists: /hdd/collector/ripme/rips/reddit_sub_spaceporn/7bebsf-F3lu5vq.png
[!] Skipping https://www.nasa.gov/sites/default/files/thumbnails/image/potw1742a.jpg -- file already exists: /hdd/collector/ripme/rips/reddit_sub_spaceporn/7be245-potw1742a.jpg
[!] Skipping https://i.imgur.com/mkaA6u3.jpg -- file already exists: /hdd/collector/ripme/rips/reddit_sub_spaceporn/7bdtos-mkaA6u3.jpg

Error while loading https://www.reddit.com/r/spaceporn/new/.json?after=t3_7bdtos
java.net.SocketTimeoutException: Read timed out
at java.net.SocketInputStream.socketRead0(Native Method)
at java.net.SocketInputStream.socketRead(SocketInputStream.java:116)
at java.net.SocketInputStream.read(SocketInputStream.java:171)
at java.net.SocketInputStream.read(SocketInputStream.java:141)
at sun.security.ssl.InputRecord.readFully(InputRecord.java:465)
at sun.security.ssl.InputRecord.readV3Record(InputRecord.java:593)
at sun.security.ssl.InputRecord.read(InputRecord.java:532)
at sun.security.ssl.SSLSocketImpl.readRecord(SSLSocketImpl.java:973)
at sun.security.ssl.SSLSocketImpl.readDataRecord(SSLSocketImpl.java:930)
at sun.security.ssl.AppInputStream.read(AppInputStream.java:105)
at java.io.BufferedInputStream.fill(BufferedInputStream.java:246)
at java.io.BufferedInputStream.read1(BufferedInputStream.java:286)
at java.io.BufferedInputStream.read(BufferedInputStream.java:345)
at sun.net.www.MeteredStream.read(MeteredStream.java:134)
at java.io.FilterInputStream.read(FilterInputStream.java:133)
at sun.net.www.protocol.http.HttpURLConnection$HttpInputStream.read(HttpURLConnection.java:3375)
at sun.net.www.protocol.http.HttpURLConnection$HttpInputStream.read(HttpURLConnection.java:3368)
at sun.net.www.protocol.http.HttpURLConnection$HttpInputStream.read(HttpURLConnection.java:3356)
at java.util.zip.CheckedInputStream.read(CheckedInputStream.java:59)
at java.util.zip.GZIPInputStream.readUByte(GZIPInputStream.java:266)
at java.util.zip.GZIPInputStream.readUShort(GZIPInputStream.java:258)
at java.util.zip.GZIPInputStream.readHeader(GZIPInputStream.java:164)
at java.util.zip.GZIPInputStream.(GZIPInputStream.java:79)
at java.util.zip.GZIPInputStream.(GZIPInputStream.java:91)
at org.jsoup.helper.HttpConnection$Response.execute(HttpConnection.java:494)
at org.jsoup.helper.HttpConnection$Response.execute(HttpConnection.java:434)
at org.jsoup.helper.HttpConnection.execute(HttpConnection.java:181)
at com.rarchives.ripme.utils.Http.response(Http.java:130)
at com.rarchives.ripme.ripper.rippers.RedditRipper.getJsonArrayFromURL(RedditRipper.java:128)
at com.rarchives.ripme.ripper.rippers.RedditRipper.getAndParseAndReturnNext(RedditRipper.java:75)
at com.rarchives.ripme.ripper.rippers.RedditRipper.rip(RedditRipper.java:64)
at com.rarchives.ripme.App.rip(App.java:67)
at com.rarchives.ripme.App.ripURL(App.java:177)
at com.rarchives.ripme.App.handleArguments(App.java:169)
at com.rarchives.ripme.App.main(App.java:56)
[!] Error while ripping URL https://www.reddit.com/r/spaceporn/new/
java.io.IOException: Failed to load https://www.reddit.com/r/spaceporn/new/.json?after=t3_7bdtos after 1 attempts
at com.rarchives.ripme.utils.Http.response(Http.java:137)
at com.rarchives.ripme.ripper.rippers.RedditRipper.getJsonArrayFromURL(RedditRipper.java:128)
at com.rarchives.ripme.ripper.rippers.RedditRipper.getAndParseAndReturnNext(RedditRipper.java:75)
at com.rarchives.ripme.ripper.rippers.RedditRipper.rip(RedditRipper.java:64)
at com.rarchives.ripme.App.rip(App.java:67)
at com.rarchives.ripme.App.ripURL(App.java:177)
at com.rarchives.ripme.App.handleArguments(App.java:169)
at com.rarchives.ripme.App.main(App.java:56)
Caused by: java.net.SocketTimeoutException: Read timed out
at java.net.SocketInputStream.socketRead0(Native Method)
at java.net.SocketInputStream.socketRead(SocketInputStream.java:116)
at java.net.SocketInputStream.read(SocketInputStream.java:171)
at java.net.SocketInputStream.read(SocketInputStream.java:141)
at sun.security.ssl.InputRecord.readFully(InputRecord.java:465)
at sun.security.ssl.InputRecord.readV3Record(InputRecord.java:593)
at sun.security.ssl.InputRecord.read(InputRecord.java:532)
at sun.security.ssl.SSLSocketImpl.readRecord(SSLSocketImpl.java:973)
at sun.security.ssl.SSLSocketImpl.readDataRecord(SSLSocketImpl.java:930)
at sun.security.ssl.AppInputStream.read(AppInputStream.java:105)
at java.io.BufferedInputStream.fill(BufferedInputStream.java:246)
at java.io.BufferedInputStream.read1(BufferedInputStream.java:286)
at java.io.BufferedInputStream.read(BufferedInputStream.java:345)
at sun.net.www.MeteredStream.read(MeteredStream.java:134)
at java.io.FilterInputStream.read(FilterInputStream.java:133)
at sun.net.www.protocol.http.HttpURLConnection$HttpInputStream.read(HttpURLConnection.java:3375)
at sun.net.www.protocol.http.HttpURLConnection$HttpInputStream.read(HttpURLConnection.java:3368)
at sun.net.www.protocol.http.HttpURLConnection$HttpInputStream.read(HttpURLConnection.java:3356)
at java.util.zip.CheckedInputStream.read(CheckedInputStream.java:59)
at java.util.zip.GZIPInputStream.readUByte(GZIPInputStream.java:266)
at java.util.zip.GZIPInputStream.readUShort(GZIPInputStream.java:258)
at java.util.zip.GZIPInputStream.readHeader(GZIPInputStream.java:164)
at java.util.zip.GZIPInputStream.(GZIPInputStream.java:79)
at java.util.zip.GZIPInputStream.(GZIPInputStream.java:91)
at org.jsoup.helper.HttpConnection$Response.execute(HttpConnection.java:494)
at org.jsoup.helper.HttpConnection$Response.execute(HttpConnection.java:434)
at org.jsoup.helper.HttpConnection.execute(HttpConnection.java:181)
at com.rarchives.ripme.utils.Http.response(Http.java:130)
... 7 more`

@cyian-1756
Copy link
Contributor

This looks like an error with your connection

@m4ntic0r
Copy link
Author

m4ntic0r commented Nov 18, 2017

hm but there is no problem for me.. i use this connection for everything, on this machine there runs e.g. an irc connection without any issues.

are there some parameters like try it more often or longer timeouts or something? it just stops and the only thing you could do is kill the process and start again.

@rautamiekka
Copy link

Shall we move this to the new repo @ https://github.com/RipMeApp/ripme/ ?

@rautamiekka
Copy link

rautamiekka commented Nov 18, 2017

Window$ 7 Ultimate SP1 x64
Oracle Java SE 8 Update 152 x64
RipMe 1.6.13

Works fine for me as far as I see:

java -jar ripme1.6.13.jar -l .\rips -u https://www.reddit.com/r/astrophotography/new/ >> log.log
Loaded G:\_DOWNLOADS_\RipMe\rip.properties
Loaded log4j.properties
Initialized ripme v1.6.13
[+] Creating directory: .\rips\reddit_sub_astrophotography
[!] Unable to rip URL: https://www.astrobin.com/full/321464/C/
[!] Unable to rip URL: https://www.youtube.com/watch?v=O8takBGZO2A&t=1296s
[!] Unable to rip URL: http://astrob.in/321176/0/
[!] Unable to rip URL: https://camo.githubusercontent.com/41b1bdc8ebd925dfef2f0e2deba38c4148265cb1/687474703a2f2f7777772e64756e6c61702e75746f726f6e746f2e63612f77702d636f6e74656e742f75706c6f6164732f323031332f30352f447261676f6e666c795f3130383070785f4f63742d323031342e6a7067
[!] Unable to rip URL: https://www.facebook.com/AstroHuntsman/
[!] Unable to rip URL: https://twitter.com/astrohuntsman
[!] Unable to rip URL: https://github.com/AstroHuntsman/huntsman-specs/blob/master/Huntsman%20Telephoto%20Array%20specifications.ipynb
[!] Unable to rip URL: https://www.youtube.com/watch?v=0A3NFrnWTYg
[!] Unable to rip URL: https://www.youtube.com/watch?v=0A3NFrnWTYg
    Retrieving https://imgur.com/a/3tWIH/all
[!] Unable to rip URL: http://www.astrobin.com/full/319974/0/
    Retrieving https://imgur.com/a/GPdMT/all
    Retrieving https://imgur.com/a/nBWru/all
[!] Unable to rip URL: http://astrob.in/319613/0/
    Retrieving https://imgur.com/a/llcuD/all
[!] Unable to rip URL: http://api.arturas.space/Images/M81_M82_17-10-30.png
    Downloading file: https://i.redd.it/6tu7hn7e00vz.jpg Retry #1
    Retrieving https://imgur.com/a/c3bjy/all
[+] Saved https://i.redd.it/6tu7hn7e00vz.jpg as .\rips\reddit_sub_astrophotography\79p1wo-6tu7hn7e00vz.jpg
    Downloading file: https://www.astrobackyard.com/images/orions-belt-105mm-camera-lens.jpg Retry #1
    Retrieving https://imgur.com/a/PjiZt/all
[+] Saved https://www.astrobackyard.com/images/orions-belt-105mm-camera-lens.jpg as .\rips\reddit_sub_astrophotography\79o121-orions-belt-105mm-camera-lens.jpg
    Downloading file: https://i.imgur.com/Yd8gnsi.jpg Retry #1
[+] Saved https://i.imgur.com/Yd8gnsi.jpg as .\rips\reddit_sub_astrophotography\79ndne-Yd8gnsi.jpg
    Downloading file: https://farm5.staticflickr.com/4492/37313649864_e1c35ac358_k.jpg Retry #1
    Retrieving https://imgur.com/a/vqISE/all
[!] Unable to rip URL: http://www.astrobin.com/full/318693/0/
[!] Unable to rip URL: http://astrob.in/318370/B/
[+] Saved https://farm5.staticflickr.com/4492/37313649864_e1c35ac358_k.jpg as .\rips\reddit_sub_astrophotography\79mwry-37313649864_e1c35ac358_k.jpg
    Downloading file: https://i.imgur.com/DCZszsL.jpg Retry #1
[+] Saved https://i.imgur.com/DCZszsL.jpg as .\rips\reddit_sub_astrophotography\79lslw-DCZszsL.jpg
    Downloading file: https://i.redd.it/kyax3xjllwuz.jpg Retry #1
[!] Unable to rip URL: http://www.astrobin.com/317352/
    Retrieving https://imgur.com/a/PDdpn/all
[!] Unable to rip URL: http://api.arturas.space/Images/Melotte15_SHOv3.png
[!] Unable to rip URL: http://www.astrobin.com/full/316823/0/
    Retrieving https://imgur.com/a/6lLvn/all
    Retrieving https://imgur.com/a/ot1gM/all
[!] Unable to rip URL: http://www.astrobin.com/315939/0/?nc=user
[+] Saved https://i.redd.it/kyax3xjllwuz.jpg as .\rips\reddit_sub_astrophotography\79lsjv-kyax3xjllwuz.jpg
    Downloading file: https://farm5.staticflickr.com/4453/26252173809_5027638586_o.jpg Retry #1
    Retrieving https://imgur.com/a/t8IA3/all
[!] Unable to rip URL: http://www.astrobin.com/full/315245/0/?nc=gonzodaruler
[!] Unable to rip URL: http://www.astrobin.com/full/315227/0/
[+] Saved https://farm5.staticflickr.com/4453/26252173809_5027638586_o.jpg as .\rips\reddit_sub_astrophotography\79l13x-26252173809_5027638586_o.jpg
    Downloading file: http://i.imgur.com/Ioz5Axx.jpg Retry #1
[+] Saved http://i.imgur.com/Ioz5Axx.jpg as .\rips\reddit_sub_astrophotography\79k779-Ioz5Axx.jpg
    Downloading file: http://i.imgur.com/qWvKNam.jpg Retry #1
    Retrieving https://imgur.com/a/7vpY6/all
    Retrieving https://imgur.com/a/H1FBB/all
[+] Saved http://i.imgur.com/qWvKNam.jpg as .\rips\reddit_sub_astrophotography\79k779-qWvKNam.jpg
    Downloading file: http://i.imgur.com/NjYq1fE.jpg Retry #1
[!] Unable to rip URL: http://www.astrobin.com/314845/
[!] Unable to rip URL: http://www.astrobin.com/full/314833/0/?nc=j_n_dubya&real=&mod=
[+] Saved http://i.imgur.com/NjYq1fE.jpg as .\rips\reddit_sub_astrophotography\79k779-NjYq1fE.jpg
    Downloading file: http://i.imgur.com/8c0p4SZ.jpg Retry #1
[+] Saved http://i.imgur.com/8c0p4SZ.jpg as .\rips\reddit_sub_astrophotography\79k779-8c0p4SZ.jpg
    Downloading file: https://i.redd.it/2l74wgctduuz.jpg Retry #1
[+] Saved https://i.redd.it/2l74wgctduuz.jpg as .\rips\reddit_sub_astrophotography\79jhzf-2l74wgctduuz.jpg
    Downloading file: https://i.redd.it/ocjx5dvgbuuz.jpg Retry #1
[+] Saved https://i.redd.it/ocjx5dvgbuuz.jpg as .\rips\reddit_sub_astrophotography\79jf6e-ocjx5dvgbuuz.jpg
    Downloading file: https://i.redd.it/6xn20m5dhtuz.jpg Retry #1
[!] Unable to rip URL: http://astrob.in/313791/0/
[!] Unable to rip URL: http://www.astrobin.com/313622/
[!] Unable to rip URL: http://astrob.in/full/313627/0/
    Retrieving https://imgur.com/a/CjnMY/all
[+] Saved https://i.redd.it/6xn20m5dhtuz.jpg as .\rips\reddit_sub_astrophotography\79idlj-6xn20m5dhtuz.jpg
    Downloading file: https://i.redd.it/vldir7ay7tuz.png Retry #1
Retrieving https://gfycat.com/gifs/detail/DeliriousCornyFeline
Exception while retrieving gfycat page:
java.io.IOException: Could not find source#mp4source at https://gfycat.com/gifs/detail/DeliriousCornyFeline
	at com.rarchives.ripme.ripper.rippers.video.GfycatRipper.getVideoURL(GfycatRipper.java:70)
	at com.rarchives.ripme.utils.RipUtils.getFilesFromURL(RipUtils.java:64)
	at com.rarchives.ripme.ripper.rippers.RedditRipper.handleURL(RedditRipper.java:190)
	at com.rarchives.ripme.ripper.rippers.RedditRipper.parseJsonChild(RedditRipper.java:157)
	at com.rarchives.ripme.ripper.rippers.RedditRipper.getAndParseAndReturnNext(RedditRipper.java:89)
	at com.rarchives.ripme.ripper.rippers.RedditRipper.rip(RedditRipper.java:64)
	at com.rarchives.ripme.App.rip(App.java:67)
	at com.rarchives.ripme.App.ripURL(App.java:177)
	at com.rarchives.ripme.App.handleArguments(App.java:169)
	at com.rarchives.ripme.App.main(App.java:56)
[!] Unable to rip URL: http://astrob.in/313115/0/
    Retrieving https://imgur.com/a/mVfzX/all
[!] Unable to rip URL: https://github.com/BenJuan26/OpenSkyStacker/releases/latest
[!] Unable to rip URL: https://github.com/BenJuan26/OpenSkyStacker/issues).
[!] Unable to rip URL: http://api.arturas.space/Images/ngc6888_hhoo.png
    Retrieving https://imgur.com/a/mHRep/all
[+] Saved https://i.redd.it/vldir7ay7tuz.png as .\rips\reddit_sub_astrophotography\79i1xh-vldir7ay7tuz.png
    Downloading file: https://i.redd.it/jots640l1tuz.jpg Retry #1
    Retrieving http://imgur.com/a/kRrGa/all
[+] Saved https://i.redd.it/jots640l1tuz.jpg as .\rips\reddit_sub_astrophotography\79hv6j-jots640l1tuz.jpg
    Downloading file: https://i.redd.it/yrdgfztgvsuz.jpg Retry #1
[+] Saved https://i.redd.it/yrdgfztgvsuz.jpg as .\rips\reddit_sub_astrophotography\79hm3t-yrdgfztgvsuz.jpg
    Downloading file: https://i.redd.it/4345kp5dpsuz.jpg Retry #1
[+] Saved https://i.redd.it/4345kp5dpsuz.jpg as .\rips\reddit_sub_astrophotography\79hewb-4345kp5dpsuz.jpg
    Downloading file: https://i.redd.it/7m2xbgapsruz.jpg Retry #1
[+] Saved https://i.redd.it/7m2xbgapsruz.jpg as .\rips\reddit_sub_astrophotography\79gg4a-7m2xbgapsruz.jpg
    Downloading file: https://farm5.staticflickr.com/4475/26226885359_adc75ac307_k.jpg Retry #1
[!] Unable to rip URL: https://v.redd.it/1lfnyl2mvqkz
[!] Unable to rip URL: http://www.astrobin.com/309348/?nc=user
[+] Saved https://farm5.staticflickr.com/4475/26226885359_adc75ac307_k.jpg as .\rips\reddit_sub_astrophotography\79epmt-26226885359_adc75ac307_k.jpg
    Downloading file: https://i.redd.it/oh1g64lg5puz.png Retry #1
[!] Unable to rip URL: http://www.astrobin.com/full/311215/0/
[!] Unable to rip URL: https://drive.google.com/file/d/0B0p6nS9Q_vZcZmwtVjJZUXFHWnc/view?usp=drivesdk
[!] Unable to rip URL: http://www.astrobin.com/311103/?nc=user
[!] Unable to rip URL: https://www.youtube.com/attribution_link?a=nTuNuYdPrJQ&u=%2Fwatch%3Fv%3Dia9ZZ0dCrWE%26feature%3Dshare
[!] Unable to rip URL: http://api.arturas.space/Images/M16_gold_cyan.png
[!] Unable to rip URL: https://i.imgur.com/8oW1D3p.gifv
[!] Unable to rip URL: http://astrob.in/310710/0/
Retrieving https://gfycat.com/KnobbyVacantFlyingfox
[!] Unable to rip URL: https://www.youtube.com/watch?v=Eh_k8KL4KT8
[!] Unable to rip URL: https://www.youtube.com/watch?v=pDzG8oqXUZ8
[!] Unable to rip URL: https://youtu.be/tg8k9vnakJ0
[!] Unable to rip URL: http://www.astrobin.com/full/310005/0/?nc=user
[!] Unable to rip URL: http://www.astrobin.com/full/309583/0/?nc=user
[!] Unable to rip URL: http://www.astrobin.com/309507/C/?nc=user
[!] Unable to rip URL: http://www.astrobin.com/full/309504/0/
[+] Saved https://i.redd.it/oh1g64lg5puz.png as .\rips\reddit_sub_astrophotography\79eor6-oh1g64lg5puz.png
    Downloading file: https://i.imgur.com/K6GczLS.jpg Retry #1
[+] Saved https://i.imgur.com/K6GczLS.jpg as .\rips\reddit_sub_astrophotography\79e3ei-K6GczLS.jpg
    Downloading file: https://i.imgur.com/kv1SPjL.jpg Retry #1
[+] Saved https://i.imgur.com/kv1SPjL.jpg as .\rips\reddit_sub_astrophotography\79dcpf-kv1SPjL.jpg
    Downloading file: https://i.redd.it/jqug9wveonuz.jpg Retry #1
[+] Saved https://i.redd.it/jqug9wveonuz.jpg as .\rips\reddit_sub_astrophotography\79dcka-jqug9wveonuz.jpg
    Downloading file: https://i.redd.it/oba0eddofnuz.jpg Retry #1
[!] Unable to rip URL: http://www.astrobin.com/full/308856/
[!] Unable to rip URL: http://www.astrobin.com/full/309218/
[!] Unable to rip URL: http://www.astrobin.com/full/308983/
[!] Unable to rip URL: https://www.flickr.com/gp/125624813@N07/7h3706
[!] Unable to rip URL: https://www.flickr.com/gp/125624813@N07/pU2oer
    Retrieving http://imgur.com/a/zMWQR/all
[!] Unable to rip URL: http://www.astrobin.com/full/308945/0/?nc=user
[+] Saved https://i.redd.it/oba0eddofnuz.jpg as .\rips\reddit_sub_astrophotography\79d4p8-oba0eddofnuz.jpg
    Downloading file: https://i.redd.it/mo1ux1u38nuz.jpg Retry #1
[!] Unable to rip URL: http://www.astrobin.com/306492/C
[!] Unable to rip URL: http://www.aicccd.com/.
[!] Unable to rip URL: http://www.aicccd.com/2017/AIC2017-AGENDA.pdf
[+] Saved https://i.redd.it/mo1ux1u38nuz.jpg as .\rips\reddit_sub_astrophotography\79cvxs-mo1ux1u38nuz.jpg
    Downloading file: http://i.imgur.com/sgaYSzx.jpg Retry #1
[+] Saved http://i.imgur.com/sgaYSzx.jpg as .\rips\reddit_sub_astrophotography\79bhqs-sgaYSzx.jpg
    Downloading file: https://i.imgur.com/uBaNRwB.jpg Retry #1
    Retrieving http://imgur.com/a/M60LA/all
[+] Saved https://i.imgur.com/uBaNRwB.jpg as .\rips\reddit_sub_astrophotography\79akxm-uBaNRwB.jpg
    Downloading file: https://i.redd.it/f69qt2v3hkuz.png Retry #1
[!] Unable to rip URL: https://i.imgur.com/dS5S9UK.gifv
[!] Unable to rip URL: http://www.astrobin.com/308394/?nc=user
    Retrieving https://imgur.com/a/M2ITS/all
[+] Saved https://i.redd.it/f69qt2v3hkuz.png as .\rips\reddit_sub_astrophotography\799wr7-f69qt2v3hkuz.png
    Downloading file: https://i.redd.it/c1nlxb4d2juz.png Retry #1
    Retrieving http://imgur.com/a/Wa9Sh/all
[!] Error
org.jsoup.HttpStatusException: HTTP error fetching URL. Status=404, URL=https://imgur.com/tyFyYyv
	at org.jsoup.helper.HttpConnection$Response.execute(HttpConnection.java:459)
	at org.jsoup.helper.HttpConnection$Response.execute(HttpConnection.java:475)
	at org.jsoup.helper.HttpConnection$Response.execute(HttpConnection.java:434)
	at org.jsoup.helper.HttpConnection.execute(HttpConnection.java:181)
	at org.jsoup.helper.HttpConnection.get(HttpConnection.java:170)
	at com.rarchives.ripme.utils.RipUtils.getFilesFromURL(RipUtils.java:126)
	at com.rarchives.ripme.ripper.rippers.RedditRipper.handleURL(RedditRipper.java:190)
	at com.rarchives.ripme.ripper.rippers.RedditRipper.parseJsonChild(RedditRipper.java:157)
	at com.rarchives.ripme.ripper.rippers.RedditRipper.getAndParseAndReturnNext(RedditRipper.java:89)
	at com.rarchives.ripme.ripper.rippers.RedditRipper.rip(RedditRipper.java:64)
	at com.rarchives.ripme.App.rip(App.java:67)
	at com.rarchives.ripme.App.ripURL(App.java:177)
	at com.rarchives.ripme.App.handleArguments(App.java:169)
	at com.rarchives.ripme.App.main(App.java:56)
[!] Unable to rip URL: http://imgur.com/tyFyYyv
[!] Unable to rip URL: https://www.youtube.com/watch?v=qRKst5MJBW8
    Retrieving http://imgur.com/a/zpHna/all
    Retrieving http://imgur.com/a/AbxKA/all
    Retrieving http://imgur.com/a/Mh3mH/all
    Retrieving http://imgur.com/a/nyiRv/all
    Retrieving http://imgur.com/a/1zm5g/all
[!] Unable to rip URL: https://youtu.be/tF1WCRkDjW0
Retrieving https://gfycat.com/ScaryIllinformedHog
[!] Unable to rip URL: https://www.youtube.com/watch?v=_gj8rxD0XX4&feature=youtu.be
    Retrieving http://imgur.com/a/1uRQ4/all
Retrieving https://gfycat.com/gifs/detail/SecondDeafeningBighornedsheep
Exception while retrieving gfycat page:
java.io.IOException: Could not find source#mp4source at https://gfycat.com/gifs/detail/SecondDeafeningBighornedsheep
	at com.rarchives.ripme.ripper.rippers.video.GfycatRipper.getVideoURL(GfycatRipper.java:70)
	at com.rarchives.ripme.utils.RipUtils.getFilesFromURL(RipUtils.java:64)
	at com.rarchives.ripme.ripper.rippers.RedditRipper.handleURL(RedditRipper.java:190)
	at com.rarchives.ripme.ripper.rippers.RedditRipper.parseJsonChild(RedditRipper.java:157)
	at com.rarchives.ripme.ripper.rippers.RedditRipper.getAndParseAndReturnNext(RedditRipper.java:89)
	at com.rarchives.ripme.ripper.rippers.RedditRipper.rip(RedditRipper.java:64)
	at com.rarchives.ripme.App.rip(App.java:67)
	at com.rarchives.ripme.App.ripURL(App.java:177)
	at com.rarchives.ripme.App.handleArguments(App.java:169)
	at com.rarchives.ripme.App.main(App.java:56)
[!] Unable to rip URL: https://youtu.be/jQL34Yxkiso
    Retrieving http://imgur.com/a/SVc7f/all
[+] Saved https://i.redd.it/c1nlxb4d2juz.png as .\rips\reddit_sub_astrophotography\798zjn-c1nlxb4d2juz.png
    Downloading file: https://i.redd.it/y3rg2ioe8duz.png Retry #1
[!] Unable to rip URL: http://astrob.in/308181/0/
[!] Unable to rip URL: https://streamable.com/e726j
[!] Unable to rip URL: https://v.redd.it/t56asj1ep5hz
    Retrieving https://imgur.com/a/MvAb6/all
    Retrieving http://imgur.com/a/3Myt0/all
[+] Saved https://i.redd.it/y3rg2ioe8duz.png as .\rips\reddit_sub_astrophotography\792vxi-y3rg2ioe8duz.png
    Downloading file: https://farm5.staticflickr.com/4467/26182312929_77150ff1bc_k.jpg Retry #1
[+] Saved https://farm5.staticflickr.com/4467/26182312929_77150ff1bc_k.jpg as .\rips\reddit_sub_astrophotography\792g9h-26182312929_77150ff1bc_k.jpg
    Downloading file: https://i.redd.it/frj8q047qcuz.png Retry #1
    Retrieving http://imgur.com/a/TSk0s/all
[!] Unable to rip URL: https://www.reddit.com/live/zersmomw72dw/
[!] Unable to rip URL: http://www.eclipse2017.org/2017/american.htm

I stopped it there cuz there was no telling how long it'd keep ripping. I had 31 files IIRC.

My theories:

  1. DNS caching is persisting. Fix=power down network devices without a battery and a power cable, and reboot computers.
  2. Too old Java.

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
None yet
Projects
None yet
Development

No branches or pull requests

3 participants