city-data-crawler

Tool for aggregating REI data from city-data.com

git clone https://github.com/SamPetering/city-data-crawler.git to clone the repository

cd city-data-crawler to enter the directory

yarn to install dependencies

configuration:

uncomment the states you want to crawl in states.ts
set the POPULATION_LIMIT constant in index.ts to whatever your personal threshold is
save changes

yarn dev to run

ctrl+c once the script has completed

the results will be written to ./results/

Name		Name	Last commit message	Last commit date
Latest commit History 19 Commits
.gitignore		.gitignore
README.md		README.md
api.ts		api.ts
extractors.ts		extractors.ts
getters.ts		getters.ts
index.ts		index.ts
package.json		package.json
states.ts		states.ts
tsconfig.json		tsconfig.json
types.ts		types.ts
utility.ts		utility.ts
yarn.lock		yarn.lock

Provide feedback