Skip to content
This repository has been archived by the owner on Jun 18, 2020. It is now read-only.
/ kickshirts Public archive

Scrapes data from kickstarter and presents kickstarters that offer T-shirts, sorted by price. Nobody wanted that, but I bet you have a use for the scraping logic... or you just want to get better at node development!

Notifications You must be signed in to change notification settings

punkave/kickshirts

Folders and files

NameName
Last commit message
Last commit date

Latest commit

 

History

42 Commits
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 

Repository files navigation

kickshirts

This node-powered web app displays all the Kickstarter projects that feature T-shirts as reward items. We thought people would go nuts for it, but... not so much. So we're open-sourcing the code to benefit those who are interested in scraping data from Kickstarter and/or scraping data with Node in general.

Setup

First, get node installed if you don't have it already.

Then you can run:

npm install

There are two scripts: build.js and server.js. The build.js script builds a database in data/shirts.json. But you don't want to wait for that, so just do:

mkdir -p data
cp shirts.json.gz data
cd data
gunzip shirts.json.gz
cd ..

Running kickshirts

Now you can launch the site:

node server.js

Now connect:

http://localhost:3000/

Be aware that template edits (the views folder) are not active until you restart the site. CSS edits do not have this restriction.

Scraping new data

If you do decide to run build.js, be aware it fetches only 10 projects by default. If you really want to do a full run, you can do:

node build.js 1000

PLEASE RUN THIS RESPONSIBLY, do not schedule it to run more than once a day or so at most.

Deployment

sc-deploy production

Have fun!

-The team at P'unk Avenue

About

Scrapes data from kickstarter and presents kickstarters that offer T-shirts, sorted by price. Nobody wanted that, but I bet you have a use for the scraping logic... or you just want to get better at node development!

Resources

Stars

Watchers

Forks

Releases

No releases published

Packages

No packages published