login with scrapy-playwright

[Alfin72]

I am new to scrapy-playwright soo there is a chance I have missed the option but I did try my best to make page.fill option work using PageCoroutine function but I am not successful basically I want to pass "page.fill('#to_date', '2021-12-17')" to the browser before I could collect response if it is possible with an existing solution please help me with an example to login to quotes to scrap using page.fill to enter user name and password it will help other newbies too.

[elacuesta]

Please, share what you have tried.

[elacuesta]

Without more context, all I'll venture to say is that PageCoroutine("fill", "#to_date", "2021-12-17") should produce the expected results.

[Alfin72]

sorry for disturbing you during the holiday season.

I am basically trying to log in using playwright and then send the response to scrapy.

Here is how my spider looks.

`import scrapy
from scrapy_playwright.page import PageCoroutine

class ScrollSpider(scrapy.Spider):
name = "quotes"

def start_requests(self):
    yield scrapy.Request(
        url="https://quotes.toscrape.com/login",
        meta=dict(
            playwright=True,
            playwright_include_page=True,
            playwright_context="new",
            playwright_page_coroutines=[
                PageCoroutine("fill", "#username", "2021-12-17"),
                PageCoroutine("fill", "#password", "2021-12-18"),
                PageCoroutine("click", selector="[type='submit']"),
                PageCoroutine("wait_for_timeout", 5000),
            ],
        ),
    )

def parse(self, response):
    # 'response' contains the page as seen by the browser
    yield {"url": response.url}  

Instead of login and returning "https://quotes.toscrape.com/"
I am getting {'url': 'https://quotes.toscrape.com/login'}

Here is the playwright code which I am trying to replicate using scrapy_playwright.

`from playwright.sync_api import sync_playwright

with sync_playwright() as p:
for browser_type in [p.chromium]:
browser = browser_type.launch(headless=False)
page = browser.new_page()
page.goto("https://quotes.toscrape.com/login")
page.fill('#username', '2021-12-16')
page.fill('#password', '2021-12-17')
page.wait_for_timeout(5000)
page.query_selector('[type="submit"]').click()
page.wait_for_timeout(15000)
browser.close()`

[Alfin72]

I tried the same code on a different website and the code works, I believe the bug might be in (https://quotes.toscrape.com/login) hence I will close this issue.