Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

Sign up for GitHub

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Jump to bottom

[WIP] Split large files with ijson #366

Merged
merged 17 commits into from
Apr 30, 2020
Merged

[WIP] Split large files with ijson #366

merged 17 commits into from
Apr 30, 2020

Commits on Apr 23, 2020

  1. [WIP] Split large files with ijson 

    Signed-off-by: Yohanna Lisnichuk <yohanitalisnichuk@gmail.com>
    @yolile
    yolile committed Apr 23, 2020
    Configuration menu
    Copy the full SHA
    334bbdc View commit details
    Browse the repository at this point in the history

Commits on Apr 24, 2020

  1. Merge branch 'master' of github.com:open-contracting/kingfisher-scrap… 

    …e into 154-fix-buenos-aires

Signed-off-by: Yohanna Lisnichuk <yohanitalisnichuk@gmail.com>
    @yolile
    yolile committed Apr 24, 2020
    Configuration menu
    Copy the full SHA
    274866c View commit details
    Browse the repository at this point in the history

Commits on Apr 27, 2020

  1. Add package each X releases 

    Signed-off-by: Yohanna Lisnichuk <yohanitalisnichuk@gmail.com>
    @yolile
    yolile committed Apr 27, 2020
    Configuration menu
    Copy the full SHA
    2cec7bb View commit details
    Browse the repository at this point in the history

  2. Merge branch 'master' of github.com:open-contracting/kingfisher-scrap… 

    …e into 154-fix-buenos-aires

Signed-off-by: Yohanna Lisnichuk <yohanitalisnichuk@gmail.com>
    @yolile
    yolile committed Apr 27, 2020
    Configuration menu
    Copy the full SHA
    31eaecc View commit details
    Browse the repository at this point in the history

  3. Remove extra print 

    Signed-off-by: Yohanna Lisnichuk <yohanitalisnichuk@gmail.com>
    @yolile
    yolile committed Apr 27, 2020
    Configuration menu
    Copy the full SHA
    78f61d8 View commit details
    Browse the repository at this point in the history

  4. Update base_spider 

    Signed-off-by: Yohanna Lisnichuk <yohanitalisnichuk@gmail.com>
    @yolile
    yolile committed Apr 27, 2020
    Configuration menu
    Copy the full SHA
    4446890 View commit details
    Browse the repository at this point in the history

  5. Fix base spider 

    Signed-off-by: Yohanna Lisnichuk <yohanitalisnichuk@gmail.com>
    @yolile
    yolile committed Apr 27, 2020
    Configuration menu
    Copy the full SHA
    95c4968 View commit details
    Browse the repository at this point in the history

  6. Add tests 

    Signed-off-by: Yohanna Lisnichuk <yohanitalisnichuk@gmail.com>
    @yolile
    yolile committed Apr 27, 2020
    Configuration menu
    Copy the full SHA
    5673f2a View commit details
    Browse the repository at this point in the history

  7. Removed unused methods 

    Signed-off-by: Yohanna Lisnichuk <yohanitalisnichuk@gmail.com>
    @yolile
    yolile committed Apr 27, 2020
    Configuration menu
    Copy the full SHA
    7053168 View commit details
    Browse the repository at this point in the history

Commits on Apr 29, 2020

  1. Update parse array method 

    Signed-off-by: Yohanna Lisnichuk <yohanitalisnichuk@gmail.com>
    @yolile
    yolile committed Apr 29, 2020
    Configuration menu
    Copy the full SHA
    7d40674 View commit details
    Browse the repository at this point in the history

  2. Merge branch 'master' of github.com:open-contracting/kingfisher-scrap… 

    …e into 154-fix-buenos-aires
    @yolile
    yolile committed Apr 29, 2020
    Configuration menu
    Copy the full SHA
    c95fdf5 View commit details
    Browse the repository at this point in the history

Commits on Apr 30, 2020

  1. Update docs 

    Signed-off-by: Yohanna Lisnichuk <yohanitalisnichuk@gmail.com>
    @yolile
    yolile committed Apr 30, 2020
    Configuration menu
    Copy the full SHA
    6744a91 View commit details
    Browse the repository at this point in the history

  2. Update docs 

    Signed-off-by: Yohanna Lisnichuk <yohanitalisnichuk@gmail.com>
    @yolile
    yolile committed Apr 30, 2020
    Configuration menu
    Copy the full SHA
    317250b View commit details
    Browse the repository at this point in the history

  3. Add ijson to requirements 

    Signed-off-by: Yohanna Lisnichuk <yohanitalisnichuk@gmail.com>
    @yolile
    yolile committed Apr 30, 2020
    Configuration menu
    Copy the full SHA
    cfba69b View commit details
    Browse the repository at this point in the history

  4. Fix :const: syntax

    @jpmckinney
    jpmckinney committed Apr 30, 2020
    Configuration menu
    Copy the full SHA
    3980170 View commit details
    Browse the repository at this point in the history

  5. Use identical whitespace to original ijson method, for easier visual … 

    …comparison
    @jpmckinney
    jpmckinney committed Apr 30, 2020
    Configuration menu
    Copy the full SHA
    5dc636c View commit details
    Browse the repository at this point in the history

  6. Upgrade pip-tools

    @jpmckinney
    jpmckinney committed Apr 30, 2020
    Configuration menu
    Copy the full SHA
    f64e296 View commit details
    Browse the repository at this point in the history