A web crawler that crawls the fountain pens listing
Switch branches/tags
Nothing to show
Clone or download
Fetching latest commit…
Cannot retrieve the latest commit at this time.
Permalink
Type Name Latest commit message Commit time
Failed to load latest commit information.
files
README.md
client_secret.json
gmail.py
penspider.py
penspider.service

README.md

Penspider

Penspider is a web cralwer that can crawls the fountain pens listing at a website that periodically presents vintage fountain pens for sale. Usually those new listing of fountain pens would get sold really fast, as shown in the screenshot below:

test

I didn't want to check the website every once in a while, therefore I decided to write a web crawler that would do the job for me. Hence penspider is created. After deploying it on ubuntu, penspider would send me emails indicating new listing of fountain pens, as shown in the screenshot below:

test tes

gtestes

If you decide to use penspider, please replace client_secret.json with your own version generated by Google. Notice the current client_secret.json in the repo has expired (so don't try to use my client_secret to do various things :) ).