Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

Sign up for GitHub

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Jump to bottom

Improve cookie handling #5463

Open
wants to merge 22 commits into
base: master
Choose a base branch
from
Open

Improve cookie handling #5463

wants to merge 22 commits into from

Commits on Apr 4, 2022

  1. Create AccessCookiesMiddleware that passes the cookie jar to the spid… 

    …er. Add metho to the spider to interact with the cookie
    @OrestisKan @farsene
    OrestisKan authored and farsene committed Apr 4, 2022
    Configuration menu
    Copy the full SHA
    b104c98 View commit details
    Browse the repository at this point in the history

  2. Remove singular get cookie method

    @OrestisKan @farsene
    OrestisKan authored and farsene committed Apr 4, 2022
    Configuration menu
    Copy the full SHA
    87deaac View commit details
    Browse the repository at this point in the history

  3. Add persistence of cookies when spider is closed

    @farsene
    farsene committed Apr 4, 2022
    Configuration menu
    Copy the full SHA
    0f22239 View commit details
    Browse the repository at this point in the history

  4. Add tests for storage

    @farsene
    farsene committed Apr 4, 2022
    Configuration menu
    Copy the full SHA
    417cfe3 View commit details
    Browse the repository at this point in the history

  5. Merge pull request #3 from OrestisKan/cookies_storage 

    Add persistence of cookies when spider is closed
    @OrestisKan @farsene
    OrestisKan authored and farsene committed Apr 4, 2022
    Configuration menu
    Copy the full SHA
    606cd3f View commit details
    Browse the repository at this point in the history

  6. updating branch

    @farsene
    atatabitovska authored and farsene committed Apr 4, 2022
    Configuration menu
    Copy the full SHA
    2e12447 View commit details
    Browse the repository at this point in the history

  7. fixed an issue w regards to the return of get cookies at spider, seei… 

    …ng as wrong method was being called. complex test not done yet - issues when sending multiple cookies as request header
    @farsene
    farsene committed Apr 4, 2022
    Configuration menu
    Copy the full SHA
    764cc71 View commit details
    Browse the repository at this point in the history

  8. temp

    @farsene
    atatabitovska authored and farsene committed Apr 4, 2022
    Configuration menu
    Copy the full SHA
    ab063fd View commit details
    Browse the repository at this point in the history

  9. to cookies

    @farsene
    farsene committed Apr 4, 2022
    Configuration menu
    Copy the full SHA
    b60cb1e View commit details
    Browse the repository at this point in the history

  10. changed get_cookies from from_dict to iter

    @farsene
    atatabitovska authored and farsene committed Apr 4, 2022
    Configuration menu
    Copy the full SHA
    6429e8c View commit details
    Browse the repository at this point in the history

  11. deleted extra methods

    @farsene
    atatabitovska authored and farsene committed Apr 4, 2022
    Configuration menu
    Copy the full SHA
    9067f2f View commit details
    Browse the repository at this point in the history

  12. change innit method, testing for accesscookiemiddleware working for a… 

    …ll cases
    @farsene
    atatabitovska authored and farsene committed Apr 4, 2022
    Configuration menu
    Copy the full SHA
    16e4c86 View commit details
    Browse the repository at this point in the history

  13. final cookie test working

    @farsene
    atatabitovska authored and farsene committed Apr 4, 2022
    Configuration menu
    Copy the full SHA
    334a315 View commit details
    Browse the repository at this point in the history

  14. remove prints

    @farsene
    atatabitovska authored and farsene committed Apr 4, 2022
    Configuration menu
    Copy the full SHA
    3ee3327 View commit details
    Browse the repository at this point in the history

  15. Revert "to cookies" 

    This reverts commit b60cb1e.
    @farsene
    farsene committed Apr 4, 2022
    Configuration menu
    Copy the full SHA
    1f5db64 View commit details
    Browse the repository at this point in the history

  16. Revert changes to conftest

    @farsene
    farsene committed Apr 4, 2022
    Configuration menu
    Copy the full SHA
    e2f90e8 View commit details
    Browse the repository at this point in the history

  17. Docs spiders.rst

    @TBG1998
    TBG1998 committed Apr 4, 2022
    Configuration menu
    Copy the full SHA
    85b3ea7 View commit details
    Browse the repository at this point in the history

  18. Docs downloader-middleware.rst update

    @TBG1998
    TBG1998 committed Apr 4, 2022
    Configuration menu
    Copy the full SHA
    83d07cd View commit details
    Browse the repository at this point in the history

  19. Add documentation storage.rst

    @TBG1998
    TBG1998 committed Apr 4, 2022
    Configuration menu
    Copy the full SHA
    5b3fa25 View commit details
    Browse the repository at this point in the history

  20. update Index.rst to include Storage

    @TBG1998
    TBG1998 committed Apr 4, 2022
    Configuration menu
    Copy the full SHA
    2c9c58a View commit details
    Browse the repository at this point in the history

  21. Fix storage.rst

    @TBG1998
    TBG1998 committed Apr 4, 2022
    Configuration menu
    Copy the full SHA
    4608083 View commit details
    Browse the repository at this point in the history

  22. Fix 2 storage.rst

    @TBG1998
    TBG1998 committed Apr 4, 2022
    Configuration menu
    Copy the full SHA
    3f279e8 View commit details
    Browse the repository at this point in the history