select not working

[novoxd]

My code:

function main(splash)
  assert(splash:go("http://google.com"))
  assert(splash:wait(0.5))
  return {
    a = splash:select("div"), 
    html = splash:html(),
    png = splash:png(),
    har = splash:har(),
  }
end

I get:

HTTP Error 400 (Bad Request)

Type: ScriptError -> LUA_ERROR

Error happened while executing Lua script

Lua error: [string "function main(splash)
..."]:5: attempt to call method 'select' (a nil value)

I used splash 2.3,2.2, master. Am I doing something wrong?

[kmike]

attempt to call method 'select' (a nil value) this should happen with Splash 2.2, but not in Spash 2.3 - the feature is new in Splash 2.3. Could you please check that the docker image is up to date?

[novoxd]

I use scrapinghub/splash:latest it should be 2.3, and it has 2.3 in web interface. Tested in scrapinghub/splash:2.3 the same thing.

[kmike]

For me Splash 2.3 returns the following error:

{
    "description": "Error happened while executing Lua script",
    "error": 400,
    "type": "ScriptError",
    "info": {
        "type": "BAD_MAIN_ERROR",
        "message": "'main' returned bad result. Lua function objects are not allowed."
    }
}

-- this happens because splash:select() returns a Lua object, and there is no default way to serialize it to JSON. You may want to return e.g. splash:select("div").node.outerHTML instead.

Hm, maybe .node.outerHTML is a good default for serializing splash:select results, and we should add it to Splash.

[kmike]

@novoxudonoser have you got it working? Can I close the ticket?

[ghost]

@kmike I came across a similar scenario and this "splash:select("div").node.outerHTML" works !

Thanks

[kmike]

Closing it in favor of #564.