LiveHTML object corrupted after `$click()`

[mccarthy-m-g]

Brief description of the problem

I'm attempting to extract data from a paged table, but after using $click() the LiveHTML object becomes "corrupted". This may be an edge case with this specific website, as I was able to use $click() successfully from some other code examples in the Issues for this repo without this problem.

library(rvest)

sess <- read_html_live("https://www.cicic.ca/869/results.canada?search=&sect=2&int=3")
sess$click(".rgPageNext", n_clicks = 1)

sess
#> Error in onRejected(reason) : code: -32000
#>   message: Could not find node with given id

If you run this interactively with sess$view() you can see that the page loads successfully and the click works successfully, but after that sess seems to lose the information in html_elements (judging by the error).

Additional information

I asked on Mastodon and others were able to reproduce this error. I'm highlighting this because my initial thought was that this issue was caused by my browser being out of date due to OS restrictions, but that doesn't seem to be the case.

Software:

• rvest: v1.0.4
• R: v4.2.2
• Browser: Chromium legacy (latest)

[hadley]

Oh I bet this is because it loads a new page, and I have not update the ID of the root node. I think this will be a reasonably simple fix when I’m next working on rvest.

[ucb]

This is still a problem. After click(), you can access the page code, but nothing that will allow to click again. All and any selectors throw the error referenced above.

Is there anything that can be done through sess$session$...? To force it to update ids?

@hadley You mention refresh_root() here

Is it something to do here? If so, where is it exposed: I get lost in the "sess" tree structure

Edit: just to clarify "clicks" that corrupt are those that load a new page (but normally not those that update the current page), e.g. clicking on a link or a submit button that would load a new page.

[clhughes313]

I am experiencing this same issuel; I use sess$type() to fill out a login form and can successfully login to a user dashboard, but any use of sess$click() or sess$html_elements() on the dashboard page returns the error that it cannot find the node. Code below:

library(rvest)
library(chromote)
library(getPass)

## ArgosWeb login site
  url <- 'https://argos-system.clsamerica.com/argos-cwi2/login.html'

  sess <- read_html_live(url)
  
## Input user credentials   
  sess$type(css=' form > p > input[name = "username"]', 
                   text = getPass(msg="USERNAME"))
  
  sess$type(css=' form > p > input[name = "password"]', 
                   text = getPass(msg="PASSWORD"))
  
## Hit "Enter", redirects to user dashboard
  sess$click(css='input[name="Enter"]', n_clicks=1)
  
## open a dropdown menu
 sess$click(css='span#button-1014-btnInnerEl',
                  n_clicks=1)

#> Error in callback(...) : code: -32000
#>  message: Could not find node with given id