Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

Sign up for GitHub

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Jump to bottom

Simple management UI #241

Merged
merged 5 commits into from
Mar 16, 2023
Merged

Simple management UI #241

merged 5 commits into from
Mar 16, 2023

Commits on Mar 13, 2023

  1. Simple management UI 

    1. Allows to schedule/stop spiders
2. Allows to see counts of scraped items and scheduled requests
    @oltarasenko
    oltarasenko committed Mar 13, 2023
    Configuration menu
    Copy the full SHA
    3b05258 View commit details
    Browse the repository at this point in the history

Commits on Mar 15, 2023

  1. Make it possible to preview scheduled requests in the UI

    @oltarasenko
    oltarasenko committed Mar 15, 2023
    Configuration menu
    Copy the full SHA
    a5d34e7 View commit details
    Browse the repository at this point in the history

  2. Allow previewing items 

    1. Extend DataStorage with inspect function that allows inspecting states
2. Add Preview item pipeline that allows storing extracted items as a part of the state
   of DataStorage
3. Update html part so it's possible to navigate the preview
    @oltarasenko
    oltarasenko committed Mar 15, 2023
    Configuration menu
    Copy the full SHA
    82d58ea View commit details
    Browse the repository at this point in the history

  3. Add readme about the Management UI

    @oltarasenko
    oltarasenko committed Mar 15, 2023
    Configuration menu
    Copy the full SHA
    8ad87a0 View commit details
    Browse the repository at this point in the history

Commits on Mar 16, 2023

  1. Merge branch 'master' into simple_ui

    @oltarasenko
    oltarasenko committed Mar 16, 2023
    Configuration menu
    Copy the full SHA
    f2fe2e8 View commit details
    Browse the repository at this point in the history