Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Help please! port 443 #291

Open
Irenik515 opened this issue May 13, 2024 · 8 comments
Open

Help please! port 443 #291

Irenik515 opened this issue May 13, 2024 · 8 comments

Comments

@Irenik515
Copy link

Help me please. I looked through it but I can’t understand anything. I downloaded it two months ago, everything worked. Now after the request it shows the following error: What should I do to download the site? I've been trying for a week now.

Getting snapshot pages.C:/Ruby33-x64/lib/ruby/3.3.0/net/http.rb:1603:in initialize': Failed to open TCP connection to web.archive.org:443 (No connection could be made because the target machine actively refused it. - connect(2) for "web.archive.org" port 443) (Errno::ECONNREFUSED) from C:/Ruby33-x64/lib/ruby/3.3.0/net/http.rb:1603:in open'
from C:/Ruby33-x64/lib/ruby/3.3.0/net/http.rb:1603:in block in connect' from C:/Ruby33-x64/lib/ruby/3.3.0/timeout.rb:186:in block in timeout'
from C:/Ruby33-x64/lib/ruby/3.3.0/timeout.rb:193:in timeout' from C:/Ruby33-x64/lib/ruby/3.3.0/net/http.rb:1601:in connect'
from C:/Ruby33-x64/lib/ruby/3.3.0/net/http.rb:1580:in do_start' from C:/Ruby33-x64/lib/ruby/3.3.0/net/http.rb:1569:in start'
from C:/Ruby33-x64/lib/ruby/3.3.0/open-uri.rb:334:in open_http' from C:/Ruby33-x64/lib/ruby/3.3.0/open-uri.rb:770:in buffer_open'
from C:/Ruby33-x64/lib/ruby/3.3.0/open-uri.rb:220:in block in open_loop' from C:/Ruby33-x64/lib/ruby/3.3.0/open-uri.rb:218:in catch'
from C:/Ruby33-x64/lib/ruby/3.3.0/open-uri.rb:218:in open_loop' from C:/Ruby33-x64/lib/ruby/3.3.0/open-uri.rb:158:in open_uri'
from C:/Ruby33-x64/lib/ruby/3.3.0/open-uri.rb:750:in open' from C:/Users/User/.local/share/gem/ruby/3.3.0/gems/wayback_machine_downloader-2.3.1/lib/wayback_machine_downloader/archive_api.rb:13:in get_raw_list_from_api'
from C:/Users/User/.local/share/gem/ruby/3.3.0/gems/wayback_machine_downloader-2.3.1/lib/wayback_machine_downloader.rb:92:in block in get_all_snapshots_to_consider' from <internal:numeric>:237:in times'
from C:/Users/User/.local/share/gem/ruby/3.3.0/gems/wayback_machine_downloader-2.3.1/lib/wayback_machine_downloader.rb:91:in get_all_snapshots_to_consider' from C:/Users/User/.local/share/gem/ruby/3.3.0/gems/wayback_machine_downloader-2.3.1/lib/wayback_machine_downloader.rb:105:in get_file_list_curated'
from C:/Users/User/.local/share/gem/ruby/3.3.0/gems/wayback_machine_downloader-2.3.1/lib/wayback_machine_downloader.rb:164:in get_file_list_by_timestamp' from C:/Users/User/.local/share/gem/ruby/3.3.0/gems/wayback_machine_downloader-2.3.1/lib/wayback_machine_downloader.rb:309:in file_list_by_timestamp'
from C:/Users/User/.local/share/gem/ruby/3.3.0/gems/wayback_machine_downloader-2.3.1/lib/wayback_machine_downloader.rb:192:in download_files' from C:/Users/User/.local/share/gem/ruby/3.3.0/gems/wayback_machine_downloader-2.3.1/bin/wayback_machine_downloader:72:in <top (required)>'
from C:/Ruby33-x64/bin/wayback_machine_downloader:32:in load' from C:/Ruby33-x64/bin/wayback_machine_downloader:32:in

'

@rezinkin
Copy link

Same error

`Getting snapshot pages................../usr/lib/ruby/3.1.0/socket.rb:1214:in __connect_nonblock': Failed to open TCP connection to web.archive.org:443 (Connection refused - connect(2) for 207.241.237.3:443) (Errno::ECONNREFUSED) from /usr/lib/ruby/3.1.0/socket.rb:1214:in connect_nonblock'
from /usr/lib/ruby/3.1.0/socket.rb:56:in connect_internal' from /usr/lib/ruby/3.1.0/socket.rb:137:in connect'
from /usr/lib/ruby/3.1.0/socket.rb:642:in block in tcp' from /usr/lib/ruby/3.1.0/socket.rb:227:in each'
from /usr/lib/ruby/3.1.0/socket.rb:227:in foreach' from /usr/lib/ruby/3.1.0/socket.rb:632:in tcp'
from /usr/lib/ruby/3.1.0/net/http.rb:998:in connect' from /usr/lib/ruby/3.1.0/net/http.rb:976:in do_start'
from /usr/lib/ruby/3.1.0/net/http.rb:965:in start' from /usr/lib/ruby/3.1.0/open-uri.rb:323:in open_http'
from /usr/lib/ruby/3.1.0/open-uri.rb:741:in buffer_open' from /usr/lib/ruby/3.1.0/open-uri.rb:212:in block in open_loop'
from /usr/lib/ruby/3.1.0/open-uri.rb:210:in catch' from /usr/lib/ruby/3.1.0/open-uri.rb:210:in open_loop'
from /usr/lib/ruby/3.1.0/open-uri.rb:151:in open_uri' from /usr/lib/ruby/3.1.0/open-uri.rb:721:in open'
from /var/lib/gems/3.1.0/gems/wayback_machine_downloader-2.3.1/lib/wayback_machine_downloader/archive_api.rb:13:in get_raw_list_from_api' from /var/lib/gems/3.1.0/gems/wayback_machine_downloader-2.3.1/lib/wayback_machine_downloader.rb:92:in block in get_all_snapshots_to_consider'
from /var/lib/gems/3.1.0/gems/wayback_machine_downloader-2.3.1/lib/wayback_machine_downloader.rb:91:in times' from /var/lib/gems/3.1.0/gems/wayback_machine_downloader-2.3.1/lib/wayback_machine_downloader.rb:91:in get_all_snapshots_to_consider'
from /var/lib/gems/3.1.0/gems/wayback_machine_downloader-2.3.1/lib/wayback_machine_downloader.rb:105:in get_file_list_curated' from /var/lib/gems/3.1.0/gems/wayback_machine_downloader-2.3.1/lib/wayback_machine_downloader.rb:164:in get_file_list_by_timestamp'
from /var/lib/gems/3.1.0/gems/wayback_machine_downloader-2.3.1/lib/wayback_machine_downloader.rb:309:in file_list_by_timestamp' from /var/lib/gems/3.1.0/gems/wayback_machine_downloader-2.3.1/lib/wayback_machine_downloader.rb:192:in download_files'
from /var/lib/gems/3.1.0/gems/wayback_machine_downloader-2.3.1/bin/wayback_machine_downloader:72:in <top (required)>' from /usr/local/bin/wayback_machine_downloader:25:in load'
from /usr/local/bin/wayback_machine_downloader:25:in

' /usr/lib/ruby/3.1.0/socket.rb:1214:in __connect_nonblock': Connection refused - connect(2) for 207.241.237.3:443 (Errno::ECONNREFUSED)
from /usr/lib/ruby/3.1.0/socket.rb:1214:in connect_nonblock' from /usr/lib/ruby/3.1.0/socket.rb:56:in connect_internal'
from /usr/lib/ruby/3.1.0/socket.rb:137:in connect' from /usr/lib/ruby/3.1.0/socket.rb:642:in block in tcp'
from /usr/lib/ruby/3.1.0/socket.rb:227:in each' from /usr/lib/ruby/3.1.0/socket.rb:227:in foreach'
from /usr/lib/ruby/3.1.0/socket.rb:632:in tcp' from /usr/lib/ruby/3.1.0/net/http.rb:998:in connect'
from /usr/lib/ruby/3.1.0/net/http.rb:976:in do_start' from /usr/lib/ruby/3.1.0/net/http.rb:965:in start'
from /usr/lib/ruby/3.1.0/open-uri.rb:323:in open_http' from /usr/lib/ruby/3.1.0/open-uri.rb:741:in buffer_open'
from /usr/lib/ruby/3.1.0/open-uri.rb:212:in block in open_loop' from /usr/lib/ruby/3.1.0/open-uri.rb:210:in catch'
from /usr/lib/ruby/3.1.0/open-uri.rb:210:in open_loop' from /usr/lib/ruby/3.1.0/open-uri.rb:151:in open_uri'
from /usr/lib/ruby/3.1.0/open-uri.rb:721:in open' from /var/lib/gems/3.1.0/gems/wayback_machine_downloader-2.3.1/lib/wayback_machine_downloader/archive_api.rb:13:in get_raw_list_from_api'
from /var/lib/gems/3.1.0/gems/wayback_machine_downloader-2.3.1/lib/wayback_machine_downloader.rb:92:in block in get_all_snapshots_to_consider' from /var/lib/gems/3.1.0/gems/wayback_machine_downloader-2.3.1/lib/wayback_machine_downloader.rb:91:in times'
from /var/lib/gems/3.1.0/gems/wayback_machine_downloader-2.3.1/lib/wayback_machine_downloader.rb:91:in get_all_snapshots_to_consider' from /var/lib/gems/3.1.0/gems/wayback_machine_downloader-2.3.1/lib/wayback_machine_downloader.rb:105:in get_file_list_curated'
from /var/lib/gems/3.1.0/gems/wayback_machine_downloader-2.3.1/lib/wayback_machine_downloader.rb:164:in get_file_list_by_timestamp' from /var/lib/gems/3.1.0/gems/wayback_machine_downloader-2.3.1/lib/wayback_machine_downloader.rb:309:in file_list_by_timestamp'
from /var/lib/gems/3.1.0/gems/wayback_machine_downloader-2.3.1/lib/wayback_machine_downloader.rb:192:in download_files' from /var/lib/gems/3.1.0/gems/wayback_machine_downloader-2.3.1/bin/wayback_machine_downloader:72:in <top (required)>'
from /usr/local/bin/wayback_machine_downloader:25:in load' from /usr/local/bin/wayback_machine_downloader:25:in

'`

@invest63
Copy link

Same error.

@adops-qvant
Copy link

adops-qvant commented May 15, 2024

.C:/Ruby31-x64/lib/ruby/3.1.0/net/http.rb:1001:in rescue in connect': Failed to open TCP connection to web.archive.org:443 (A connection attempt failed because the connected party did not properly respond after a period of time, or established connection failed because connected host has failed to respond. - user specified timeout) (Net::OpenTimeout) from C:/Ruby31-x64/lib/ruby/3.1.0/net/http.rb:997:in connect'
from C:/Ruby31-x64/lib/ruby/3.1.0/net/http.rb:976:in do_start' from C:/Ruby31-x64/lib/ruby/3.1.0/net/http.rb:965:in start'
from C:/Ruby31-x64/lib/ruby/3.1.0/open-uri.rb:323:in open_http' from C:/Ruby31-x64/lib/ruby/3.1.0/open-uri.rb:741:in buffer_open'
from C:/Ruby31-x64/lib/ruby/3.1.0/open-uri.rb:212:in block in open_loop' from C:/Ruby31-x64/lib/ruby/3.1.0/open-uri.rb:210:in catch'
from C:/Ruby31-x64/lib/ruby/3.1.0/open-uri.rb:210:in open_loop' from C:/Ruby31-x64/lib/ruby/3.1.0/open-uri.rb:151:in open_uri'
from C:/Ruby31-x64/lib/ruby/3.1.0/open-uri.rb:721:in open' from C:/Ruby31-x64/lib/ruby/gems/3.1.0/gems/wayback_machine_downloader-2.3.1/lib/wayback_machine_downloader/archive_api.rb:13:in get_raw_list_from_api'
from C:/Ruby31-x64/lib/ruby/gems/3.1.0/gems/wayback_machine_downloader-2.3.1/lib/wayback_machine_downloader.rb:92:in block in get_all_snapshots_to_consider' from C:/Ruby31-x64/lib/ruby/gems/3.1.0/gems/wayback_machine_downloader-2.3.1/lib/wayback_machine_downloader.rb:91:in times'
from C:/Ruby31-x64/lib/ruby/gems/3.1.0/gems/wayback_machine_downloader-2.3.1/lib/wayback_machine_downloader.rb:91:in get_all_snapshots_to_consider' from C:/Ruby31-x64/lib/ruby/gems/3.1.0/gems/wayback_machine_downloader-2.3.1/lib/wayback_machine_downloader.rb:105:in get_file_list_curated'
from C:/Ruby31-x64/lib/ruby/gems/3.1.0/gems/wayback_machine_downloader-2.3.1/lib/wayback_machine_downloader.rb:164:in get_file_list_by_timestamp' from C:/Ruby31-x64/lib/ruby/gems/3.1.0/gems/wayback_machine_downloader-2.3.1/lib/wayback_machine_downloader.rb:309:in file_list_by_timestamp'
from C:/Ruby31-x64/lib/ruby/gems/3.1.0/gems/wayback_machine_downloader-2.3.1/lib/wayback_machine_downloader.rb:192:in download_files' from C:/Ruby31-x64/lib/ruby/gems/3.1.0/gems/wayback_machine_downloader-2.3.1/bin/wayback_machine_downloader:72:in <top (required)>'
from C:/Ruby31-x64/bin/wayback_machine_downloader:32:in load' from C:/Ruby31-x64/bin/wayback_machine_downloader:32:in

'
C:/Ruby31-x64/lib/ruby/3.1.0/socket.rb:61:in connect_internal': A connection attempt failed because the connected party did not properly respond after a period of time, or established connection failed because connected host has failed to respond. - user specified timeout (Errno::ETIMEDOUT) from C:/Ruby31-x64/lib/ruby/3.1.0/socket.rb:137:in connect'
from C:/Ruby31-x64/lib/ruby/3.1.0/socket.rb:642:in block in tcp' from C:/Ruby31-x64/lib/ruby/3.1.0/socket.rb:227:in each'
from C:/Ruby31-x64/lib/ruby/3.1.0/socket.rb:227:in foreach' from C:/Ruby31-x64/lib/ruby/3.1.0/socket.rb:632:in tcp'
from C:/Ruby31-x64/lib/ruby/3.1.0/net/http.rb:998:in connect' from C:/Ruby31-x64/lib/ruby/3.1.0/net/http.rb:976:in do_start'
from C:/Ruby31-x64/lib/ruby/3.1.0/net/http.rb:965:in start' from C:/Ruby31-x64/lib/ruby/3.1.0/open-uri.rb:323:in open_http'
from C:/Ruby31-x64/lib/ruby/3.1.0/open-uri.rb:741:in buffer_open' from C:/Ruby31-x64/lib/ruby/3.1.0/open-uri.rb:212:in block in open_loop'
from C:/Ruby31-x64/lib/ruby/3.1.0/open-uri.rb:210:in catch' from C:/Ruby31-x64/lib/ruby/3.1.0/open-uri.rb:210:in open_loop'
from C:/Ruby31-x64/lib/ruby/3.1.0/open-uri.rb:151:in open_uri' from C:/Ruby31-x64/lib/ruby/3.1.0/open-uri.rb:721:in open'
from C:/Ruby31-x64/lib/ruby/gems/3.1.0/gems/wayback_machine_downloader-2.3.1/lib/wayback_machine_downloader/archive_api.rb:13:in get_raw_list_from_api' from C:/Ruby31-x64/lib/ruby/gems/3.1.0/gems/wayback_machine_downloader-2.3.1/lib/wayback_machine_downloader.rb:92:in block in get_all_snapshots_to_consider'
from C:/Ruby31-x64/lib/ruby/gems/3.1.0/gems/wayback_machine_downloader-2.3.1/lib/wayback_machine_downloader.rb:91:in times' from C:/Ruby31-x64/lib/ruby/gems/3.1.0/gems/wayback_machine_downloader-2.3.1/lib/wayback_machine_downloader.rb:91:in get_all_snapshots_to_consider'
from C:/Ruby31-x64/lib/ruby/gems/3.1.0/gems/wayback_machine_downloader-2.3.1/lib/wayback_machine_downloader.rb:105:in get_file_list_curated' from C:/Ruby31-x64/lib/ruby/gems/3.1.0/gems/wayback_machine_downloader-2.3.1/lib/wayback_machine_downloader.rb:164:in get_file_list_by_timestamp'
from C:/Ruby31-x64/lib/ruby/gems/3.1.0/gems/wayback_machine_downloader-2.3.1/lib/wayback_machine_downloader.rb:309:in file_list_by_timestamp' from C:/Ruby31-x64/lib/ruby/gems/3.1.0/gems/wayback_machine_downloader-2.3.1/lib/wayback_machine_downloader.rb:192:in download_files'
from C:/Ruby31-x64/lib/ruby/gems/3.1.0/gems/wayback_machine_downloader-2.3.1/bin/wayback_machine_downloader:72:in <top (required)>' from C:/Ruby31-x64/bin/wayback_machine_downloader:32:in load'
from C:/Ruby31-x64/bin/wayback_machine_downloader:32:in `'

@ckought
Copy link

ckought commented May 16, 2024

I was having this problem. I fought with it for several days before getting to a combo of things that worked.

I added the sleep line that's mentioned in an earlier thread, but I had to make it 10 instead of 3. Also, I couldn't use the switch to download multiple pages at the same time. And, finally, I had to wait about 12 hours so that whatever blocks archive.org was doing was reset and allowed me to connect again.

Since doing those things, I've been pulling pages from a large site for more than 12 hours with no errors.

@adops-qvant
Copy link

Looks like I've solved the problem.
The solution from here worked for me:

  1. a2d34b7
  2. b813813

@gingerbeardman
Copy link

See #280

@NoEffinIdea
Copy link

Thankyou thankyou thankyou to everyone who's worked on this.

I finally got the downloader working again, so I'll try to explain it for non-ruby people like me who were totally lost.

  1. Download ShiftaDeband's zip file unzip it to where your existing gems are (that's the directory you'll use below).
  2. I then entered (in Power Shell) >gem build --local C:\Ruby30-x64\lib\ruby\gems\3.0.0\gems\wayback-machine-downloader-feature-httpGet\wayback_machine_downloader.gemspec to create the gem file
  3. I then entered >gem install --local C:\Ruby30-x64\lib\ruby\gems\3.0.0\gems\wayback-machine-downloader-feature-httpGet\wayback_machine_downloader-2.3.2.gem
    and it installed version 2.3.2. This then ran fine. I'm so relieved. I don't use it too often, but I don't want to not use it ever again...

There are possibly other ways to do this but I have no idea. (see my username).

@gingerbeardman
Copy link

gingerbeardman commented May 23, 2024

My method, perhaps much easier as it only requires easy file download/copy/paste:

  1. install wayback_machine_downloader the recommended way
  2. replace the local versions of the following two files at ~/.gem/ruby/3.3.0/gems/wayback_machine_downloader-2.3.1/lib/
    with these updated copies, from #280
    1. wayback_machine_downloader.rb
    2. archive_api.rb
  3. don't update wayback_machine_downloader using gem

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
None yet
Projects
None yet
Development

No branches or pull requests

7 participants