trying to send url with encoding inside - page.open doesnt work #11188

Open
orrgal1 opened this Issue Mar 28, 2013 · 5 comments

Projects

None yet

3 participants

@orrgal1
orrgal1 commented Mar 28, 2013

hi,
i'm trying to do something like

page.open('http://www.bestbuy.com/site/Apple%26%23174%3B+-+MacBook+Pro%AE+-+13.3%22+Display+-+4GB+Memory+-+500GB+Hard+Drive/5430505.p?id=1218646127726&skuId=5430505#',function(status){}.....

but getting no response. its like the page doesnt even start loading.

i also have this in my code,

page.onError = function (msg, trace) {
var msgStack = [' ERROR: ' + msg];
if (trace) {
msgStack.push(' TRACE:');
trace.forEach(function (t) {
msgStack.push(' -> ' + t.file + ': ' + t.line + (t.function ? ' (in function "' + t.function + '")' : ''));
});
}
console.error(msgStack.join('\n'));
};

page.onLoadStarted = function () {
console.log(' >> NOW LOADING ' + page.url + ' ');
};

but nothing gets printed.

@JamesMGreene
Collaborator

Can you please include the response of a curl -v request sent to the same URL?

@orrgal1
orrgal1 commented Mar 28, 2013

this?

* About to connect() to www.bestbuy.com port 80 (#0)
*   Trying 89.149.151.201...
  % Total    % Received % Xferd  Average Speed   Time    Time     Time  Current
                                 Dload  Upload   Total   Spent    Left  Speed
  0     0    0     0    0     0      0      0 --:--:-- --:--:-- --:--:--     0* connected
* Connected to www.bestbuy.com (89.149.151.201) port 80 (#0)
> GET /site/Apple%26%23174%3B+-+MacBook+Pro%AE+-+13.3%22+Display+-+4GB+Memory+-+500GB+Hard+Drive/5430505.p?id=1218646127726&skuId=5430505 HTTP/1.1
> User-Agent: curl/7.27.0
> Host: www.bestbuy.com
> Accept: */*
> 
* additional stuff not fine transfer.c:1037: 0 0
* HTTP 1.1 or later with persistent connection, pipelining supported
< HTTP/1.1 200 OK
< Server: Apache-Coyote/1.1
< Content-Length: 152284
< Content-Type: text/html;charset=UTF-8
< Set-Cookie: cbc_lb_pdp=p-browse-e1b; Expires=Thu, 28-Mar-2013 19:16:41 GMT; Path=/
< Set-Cookie: akaau=1364499401~id=0f67de8853b431cad44c6fdd8315c2ec; path=/
< Set-Cookie: TLTSID=9FC9AD7E97DA1097E245EDE527D5BCAE; Path=/; Domain=.bestbuy.com
< Set-Cookie: olspsessid=2BD2166B410C49AFEDE7DCD862581191.bbolsp-app04-188; Domain=bestbuy.com; Path=/; HttpOnly
< Set-Cookie: TLTUID=9FC9AD7E97DA1097E245EDE527D5BCAE; Path=/; Domain=.bestbuy.com; Expires=Thu, 28-03-2023 19:06:41 GMT
< X-BBY-Instance-ID: f374919ec9
< Expires: Thu, 28 Mar 2013 19:06:41 GMT
< Pragma: no-cache
< Date: Thu, 28 Mar 2013 19:06:41 GMT
< Connection: keep-alive
< Cache-Control: no-store
< 
{ [data not shown]
100  148k  100  148k    0     0  78585      0  0:00:01  0:00:01 --:--:--  123k
* Connection #0 to host www.bestbuy.com left intact
* Closing connection #0
@JamesMGreene
Collaborator

Yup, that's good, thanks.

Does it work if you remove the encoded part of the URL? i.e.:
http://www.bestbuy.com/site/REDACTED/5430505.p?id=1218646127726&skuId=5430505

@orrgal1
orrgal1 commented Mar 29, 2013

yep. it gets past opening the page.

@dotjs
Contributor
dotjs commented Apr 18, 2013

I tried this against version 1.8.1 on OSX and it worked. I would suggest looking at the onResourceReceived and on ResourceRequested callbacks.

requested    http://www.bestbuy.com/site/Apple%26%23174%3B+-+MacBook+Pro%AE+-+13.3%22+Display+-+4GB+Memory+-+500GB+Hard+Drive/5430505.p?id=1218646127726&skuId=5430505#
received 200 http://www.bestbuy.com/site/Apple%26%23174%3B+-+MacBook+Pro%AE+-+13.3%22+Display+-+4GB+Memory+-+500GB+Hard+Drive/5430505.p?id=1218646127726&skuId=5430505#
received 200 http://www.bestbuy.com/site/Apple%26%23174%3B+-+MacBook+Pro%AE+-+13.3%22+Display+-+4GB+Memory+-+500GB+Hard+Drive/5430505.p?id=1218646127726&skuId=5430505#
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment