Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Website Agent CSS Selector giving no result #3233

Open
spencerskinner99 opened this issue Mar 14, 2023 · 1 comment
Open

Website Agent CSS Selector giving no result #3233

spencerskinner99 opened this issue Mar 14, 2023 · 1 comment

Comments

@spencerskinner99
Copy link

Hi

This is similar to #1646, I have been trying to simply check if the product listings on a page have changed, not any specific data but have not been able to do so.

I have tried several approaches using the selector tool or by simply checking main to see if there has been a change but it seems to be unable to return any values with relation to product listing. I am unsure what I am missing

{
  "expected_update_period_in_days": "2",
  "url": "https://www.sevenstore.com/sale/footwear/?category_default_codes=fm_footwear&size=10.5&size=11&size=11.5",
  "type": "html",
  "mode": "on_change",
  "extract": {
    "buybox": {
      "xpath": "//*[@id=\"nq-main-container\"]/div[1]/div",
      "value": "."
    }
  },
  "template": {
    "url": "{{ _url_ }}"
  }
}
[00:00:00] INFO -- : Dry Run started
[00:00:00] INFO -- : Fetching https://www.sevenstore.com/sale/footwear/?category_default_codes=fm_footwear&size=10.5&size=11&size=11.5
[00:00:03] INFO -- : Extracting html at //*[@id="nq-main-container"]/div[1]/div
[00:00:03] INFO -- : Values extracted: []
[00:00:03] INFO -- : Dry Run finished

Thanks

@gingerbeardman
Copy link

This website requires JavaScript to display the full page, and Website Agent does not support JavaScript.

You'll need to use PhantomJSCloud Agent (or self-hosted equivalent like Browserless) to get the full HTML after JavaScript and then pass this to Website Agent.

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Projects
None yet
Development

No branches or pull requests

3 participants