Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

Sign up for GitHub

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Jump to bottom

Use Scrapy items #383

Merged
merged 6 commits into from
May 27, 2020
Merged

Use Scrapy items #383

merged 6 commits into from
May 27, 2020

Commits on May 27, 2020

  1. Add build_file_error_from_response and update all spiders

    @jpmckinney
    jpmckinney committed May 27, 2020
    Configuration menu
    Copy the full SHA
    9a864d3 View commit details
    Browse the repository at this point in the history

  2. Rename save_response_to_disk to build_file_from_response, save_data_t… 

    …o_disk to build_file, _build_file_item to build_file_item. Update all spiders.
    @jpmckinney
    jpmckinney committed May 27, 2020
    Configuration menu
    Copy the full SHA
    d8fabea View commit details
    Browse the repository at this point in the history

  3. Use Scrapy items instead of dicts

    @jpmckinney
    jpmckinney committed May 27, 2020
    Configuration menu
    Copy the full SHA
    9de01e7 View commit details
    Browse the repository at this point in the history

  4. Run autopep8 --max-line-length 119 --in-place -r .

    @jpmckinney
    jpmckinney committed May 27, 2020
    Configuration menu
    Copy the full SHA
    958370b View commit details
    Browse the repository at this point in the history

  5. Use isinstance check instead of key check

    @jpmckinney
    jpmckinney committed May 27, 2020
    Configuration menu
    Copy the full SHA
    806a3b5 View commit details
    Browse the repository at this point in the history

  6. Update docs to not use old methods

    @jpmckinney
    jpmckinney committed May 27, 2020
    Configuration menu
    Copy the full SHA
    0e3c335 View commit details
    Browse the repository at this point in the history