Front-end and stats: https://hpa.emre.ca
NodeJS script to submit latest HackerNews posts to Archive.is via Puppeteer and Firebase HackerNews API.
Coded in around 3 hours. Testing took a lot.
Archive.is doesn't have a public API or anything that makes programatically archiving websites easier. At least this is what I thought before finding some code bits on Github and eventually this Wikipedia article. If I didn't see this, I was going to use Puppeteer which was my initial plan. Everything is too easy now, I kinda feel down. Archive.is doesn't allow remote GET requests, so I decided to go with Puppeteer.
Firebase HN API uses Firebase specific snapshot feature instead of Websocket to update the requester automatically. So I decided not to lose time on using their specific way of doing things and just used setInterval().
This script is created to assist my hnn project. But I guess it helps humanity as a side effect by archiving the web.
- Download the repo
- Open the terminal,
cdinto the folder. node appto run the script indefinitely.
- Download the repo
cdintoclientnpm startto view the front-end locally. (It receives the data from Firestore)
