Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

Sign up for GitHub

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Jump to bottom

Replace the old scraping code with new WebFlux-based scraping actions #411

Merged
merged 15 commits into from
Jul 18, 2020
Merged

Replace the old scraping code with new WebFlux-based scraping actions #411

merged 15 commits into from
Jul 18, 2020

Commits on Jul 18, 2020

  1. Added new dependencies for scraper testing [comixed#301] 

     - Added dependencies on okhttp and mockwebserver
 - Upgraded the DbUnit dependency to 2.7.0.
    @mcpierce
    mcpierce committed Jul 18, 2020
    Configuration menu
    Copy the full SHA
    3d6d0be View commit details
    Browse the repository at this point in the history

  2. Added an application properties file for scraper testing [comixed#301]

    @mcpierce
    mcpierce committed Jul 18, 2020
    Configuration menu
    Copy the full SHA
    f243797 View commit details
    Browse the repository at this point in the history

  3. Changed the scraping data model [comixed#301]

    @mcpierce
    mcpierce committed Jul 18, 2020
    Configuration menu
    Copy the full SHA
    4872cfe View commit details
    Browse the repository at this point in the history

  4. Added ScrapingCache and ScrapingCacheEntry plus migrations [comixed#301]

    @mcpierce
    mcpierce committed Jul 18, 2020
    Configuration menu
    Copy the full SHA
    c2c58b1 View commit details
    Browse the repository at this point in the history

  5. Added ScrapingCacheRepository [comixed#301]

    @mcpierce
    mcpierce committed Jul 18, 2020
    Configuration menu
    Copy the full SHA
    ccfc775 View commit details
    Browse the repository at this point in the history

  6. Added ScrapingCacheService [comixed#301]

    @mcpierce
    mcpierce committed Jul 18, 2020
    Configuration menu
    Copy the full SHA
    360df13 View commit details
    Browse the repository at this point in the history

  7. Added ScrapingAdaptor [comixed#301]

    @mcpierce
    mcpierce committed Jul 18, 2020
    Configuration menu
    Copy the full SHA
    7867e39 View commit details
    Browse the repository at this point in the history

  8. Added ComicVineGetVolumesAction [comixed#301] 

    This commit also provides the new classes for building additional scraping actions.
    @mcpierce
    mcpierce committed Jul 18, 2020
    Configuration menu
    Copy the full SHA
    6ca8f7a View commit details
    Browse the repository at this point in the history

  9. Added ComicVineGetIssuesAction [comixed#301]

    @mcpierce
    mcpierce committed Jul 18, 2020
    Configuration menu
    Copy the full SHA
    dacd6e3 View commit details
    Browse the repository at this point in the history

  10. Added ComicVineIssueDetailsAction [comixed#301]

    @mcpierce
    mcpierce committed Jul 18, 2020
    Configuration menu
    Copy the full SHA
    6918301 View commit details
    Browse the repository at this point in the history

  11. Added ComicVineGetVolumeDetailsAction [comixed#301]

    @mcpierce
    mcpierce committed Jul 18, 2020
    Configuration menu
    Copy the full SHA
    1140d70 View commit details
    Browse the repository at this point in the history

  12. Added ComicVineGetPublisherDetailsAction [comixed#301]

    @mcpierce
    mcpierce committed Jul 18, 2020
    Configuration menu
    Copy the full SHA
    e6ccf66 View commit details
    Browse the repository at this point in the history

  13. Added ComicVineScrapeComicAction [comixed#301]

    @mcpierce
    mcpierce committed Jul 18, 2020
    Configuration menu
    Copy the full SHA
    57ea6c4 View commit details
    Browse the repository at this point in the history

  14. Added ComicVineScrapingAdaptor [comixed#301]

    @mcpierce
    mcpierce committed Jul 18, 2020
    Configuration menu
    Copy the full SHA
    7c90ce0 View commit details
    Browse the repository at this point in the history

  15. Changed the scraping REST interface to use ScrapingAdaptor [comixed#301] 

     - Deleted all of the previous scraping classes.
 - Modified the requests to use Lombok annotations.
 - Added Javadoc to make the code better for new developers
    @mcpierce
    mcpierce committed Jul 18, 2020
    Configuration menu
    Copy the full SHA
    8cab39b View commit details
    Browse the repository at this point in the history