page.query_selector_all("#author-text > span")

[leungfukwong]

I have tried different ways of web scraping youtube comments. I am quite sure that the selector used is correct as attached verified.

The statement -- page.query_selector_all("#author-text > span") -- was used but could not get any result.
Would appreciate if someone can help!
Thanks a million

[h4nz4]

use page.locator("#author-text > span")

Why are you using it for scraping? Are you writing a test or?

[leungfukwong]

use page.locator("#author-text > span")

Why are you using it for scraping? Are you writing a test or?

Yes, I am writing a test.. whether playwright is better than Selenium for web scraping..

[h4nz4]

use page.locator("#author-text > span").first() to get the element. then you can do for example:

 let spanElement = page.locator("#author-text > span").first();
 let elementContent = await spanElement.innerHTML();
 await expect(elementContent).toBe("<p>Hello</p>");

[pavelfeldman]

I don't see anything actionable here for the Playwright team. If you are filing a bug, please state your steps, expected and actual results!