gofundme-scraper

Startup

   npm install
   node server

MongoDB database name is 'gofundme'. Be sure to create an admin user for the db if you are using a mongo-admin

Running without waiting periods or timeouts will result in an instant ban from GoFundMe.com

safe period appears to be 2-3 cycles in 5 minutes of 50 page scrapes per IP/Proxy
ip-rotation/proxy implementation is needed for massive scrapes.

Name		Name	Last commit message	Last commit date
Latest commit History 18 Commits
config_db		config_db
proxy		proxy
public		public
ruby		ruby
temp		temp
test-environment		test-environment
workers		workers
zipcodes		zipcodes
README.md		README.md
alt-start.js		alt-start.js
commander.js		commander.js
get-search.js		get-search.js
ngrok.exe		ngrok.exe
package.json		package.json
post-contact.js		post-contact.js
postal.txt		postal.txt
proxy-scraper.js		proxy-scraper.js
proxy_config.js		proxy_config.js
routes.js		routes.js
server.js		server.js
startscraper.js		startscraper.js
test.js		test.js
test.rb		test.rb
us_postal_codes.csv		us_postal_codes.csv