Skip to content
This repository has been archived by the owner on Aug 16, 2023. It is now read-only.

Scrapy doo #3

Merged
merged 6 commits into from
Mar 13, 2016
Merged

Scrapy doo #3

merged 6 commits into from
Mar 13, 2016

Commits on Mar 6, 2016

  1. Initial scapy setup.

    @ttowncompiled @groovecoder
    ttowncompiled authored and groovecoder committed Mar 6, 2016
    Configuration menu
    Copy the full SHA
    adcc591 View commit details
    Browse the repository at this point in the history

  2. Adds spider for 'city.org' and 'govtech.com'.

    @ttowncompiled @groovecoder
    ttowncompiled authored and groovecoder committed Mar 6, 2016
    Configuration menu
    Copy the full SHA
    778b421 View commit details
    Browse the repository at this point in the history

  3. Modifies parse method so that the city spider can crawl the links pre… 

    …sent on each page.
    @ttowncompiled @groovecoder
    ttowncompiled authored and groovecoder committed Mar 6, 2016
    Configuration menu
    Copy the full SHA
    07da18e View commit details
    Browse the repository at this point in the history

  4. Adds a ScrapyCityItem to represent each crawled page.

    @ttowncompiled @groovecoder
    ttowncompiled authored and groovecoder committed Mar 6, 2016
    Configuration menu
    Copy the full SHA
    322d98c View commit details
    Browse the repository at this point in the history

  5. remove committed *.pyc files

    @groovecoder
    groovecoder committed Mar 6, 2016
    Configuration menu
    Copy the full SHA
    87d37ab View commit details
    Browse the repository at this point in the history

  6. add *.pyc to .gitignore

    @groovecoder
    groovecoder committed Mar 6, 2016
    Configuration menu
    Copy the full SHA
    d6e3554 View commit details
    Browse the repository at this point in the history