Skip to content

colinjianingxie/USATT-Data-Scraping

Folders and files

NameName
Last commit message
Last commit date

Latest commit

 

History

5 Commits
 
 
 
 

Repository files navigation

USATT-Data-Scraping

This Python program scrapes USATT Data.

Pre-requisites

  • Python Installed
  • Scrapy Installed

How to run the scraper

  1. Pull this repository.
  2. navigate to the project's top level directory in the terminal.
  3. Run the crawler by typing: scrapy crawl profiles

Issues

One of the main issues is the USATT link constantly changing. If that is the case, you must edit the usatt/spiders/usatt_spider.py file with the correct link.

About

This Python program scrapes USATT Data.

Resources

Stars

Watchers

Forks

Releases

No releases published

Packages

No packages published

Languages