Scrapes the given website for internal links and saves the found ones into web.archive.org
I assume you have already installed go. (Go installation manual)
Download the dependecies via go get
Execute the following two commands:
go get -u github.com/simonfrey/proxyfy
go get -u github.com/PuerkitoBio/goquery
Just clone the git repo
git clone https://github.com/simonfrey/save_to_web.archive.org.git
Navigate into the directory of the git repo.
Execute with:
Please Replace http[s]://[yourwebsite.com] with the url of the website you want to scrape and save.
go run main.go http[s]://[yourwebsite.com]
