html() function of the DomCrawler doesn't returning anything after calling filter function

[gabrielspiteri-highlight]

We have noticed a change of behaviour since upgrading to chrome v91 as our client. The html function has an odd behaviour.

The below returns the html correctly:

dump($client->getCrawler()->html());

But then after appling a filter the html function always returns an empty string.

$client->getCrawler()->filter("table.statistic-table thead th")->each(
function (Crawler $tr) use (&$headers) {
dump($tr->html());
});

Anyone else is experiencing this? We have had to mitigate this by calling the text function instead. But that itself presents another problem because when the text is hidden in a scrollable section, the text function also returns and empty string.

[Boschman]

I'm experiencing the exact same problem since Chrome 91.

Have you found any workarounds?

[LoicBoursin]

I have the same issue. On my computer, tests are working because I have an older Chrome version. But when testing on GitHub Actions, filter + html returns empty.

[jbalatero]

Encountered this issue as well

[MartinsPaulo]

I also encounter this problem.

[Boschman]

Any news on this issue? How are people able to still use the DomCrawler with this problem? For me unfortunately Panther became practically useless.

[Boschman]

It's not a bug, it's a feature... I did some research and found a solution!

ChromeDriver 91 (and up) became compliant with the W3C standard regarding the "Get Element Attribute". That's nice, but unfortunately this breaks our tests. But: there's a simple solution. ChromeDriver only follows this W3C standard when the driver is in W3C mode. By disabling that mode Panther will work as before.

This will do the trick:

use Facebook\WebDriver\Chrome\ChromeOptions;

$chromeOptions = new ChromeOptions();
$chromeOptions->setExperimentalOption('w3c', false);

$this->client = static::createPantherClient([], [],
    [
        'capabilities' => [
            ChromeOptions::CAPABILITY => $chromeOptions,
        ],
    ]);

[eualexey]

It's not a bug, it's a feature... I did some research and found a solution!

ChromeDriver 91 (and up) became compliant with the W3C standard regarding the "Get Element Attribute". That's nice, but unfortunately this breaks our tests. But: there's a simple solution. ChromeDriver only follows this W3C standard when the driver is in W3C mode. By disabling that mode Panther will work as before.

This will do the trick:

use Facebook\WebDriver\Chrome\ChromeOptions;

$chromeOptions = new ChromeOptions();
$chromeOptions->setExperimentalOption('w3c', false);

$this->client = static::createPantherClient([], [],
    [
        'capabilities' => [
            ChromeOptions::CAPABILITY => $chromeOptions,
        ],
    ]);

Guys help me please where should I put above mentioned code in my code so I could fetch only data I need

<?php

use Symfony\Component\Panther\Client;
require 'vendor/autoload.php'; 
try {
    
    $client = Client::createChromeClient();
    $client->request('GET', 'https://websitename.com'); 
    $html = $client->getCrawler()->filter('div.options')->html();
    print_r($html);
....

Thank you!

[melkamar]

Into where you are initializing the client

$client = Client::createChromeClient([], [], [
        'capabilities' => [
            ChromeOptions::CAPABILITY => $chromeOptions,
        ],
    ]);