fetch error .status 599

[shenchuanli]

this error freak me out,my result saved in mysql,and if this is error come out,there is no data inserted.
what's 'retry' mean?
retris=10 well try 10 times?
will 'retry' will gone at the end of this project or become error?
how can I prevent 599?

[shenchuanli]

ACTIVE jd_allset.list_cate > http://list.jd.com/list.html?cat=737%2C752%2C882&ev=exbrand_%E6%B1%89%E7%BE%8E%E9%A9%B0%EF%BC%88Hamilton%20Beach%EF%BC%89%40&page=1&JL=3_%E5%93%81%E7%89%8C_%E6%B1%89%E7%BE%8E%E9%A9%B0%EF%BC%88Hamilton Beach%EF%BC%89 (3 minutes ago updated )

taskid
fef2f80e1a5553f86476676acd392c20
lastcrawltime
1437457672.06 (3 minutes ago)
updatetime
1437457672.06 (3 minutes ago)
exetime
1437457672.06 (3 minutes ago)
track.fetch 218762.45ms
{
"content": "",
"encoding": "unicode",
"error": "HTTP 599: Operation timed out after 119933 milliseconds with 38812 bytes received",
"headers": {},
"ok": false,
"redirect_url": "http://www.jd.com/?cdn4",
"status_code": 599,
"time": 218.76245498657227
}
track.process 0.42ms
None
it__.py", line 603, in fromstring
doc = document_fromstring(html, parser=parser, base_url=base_url, *_kw)
File "/usr/lib64/python2.6/site-packages/lxml/html/init.py", line 511, in document_fromstring
value = etree.fromstring(html, parser, *_kw)
File "lxml.etree.pyx", line 2532, in lxml.etree.fromstring (src/lxml/lxml.etree.c:48270)
File "parser.pxi", line 1545, in lxml.etree._parseMemoryDocument (src/lxml/lxml.etree.c:71812)
File "parser.pxi", line 1417, in lxml.etree._parseDoc (src/lxml/lxml.etree.c:70608)
File "parser.pxi", line 898, in lxml.etree._BaseParser._parseUnicodeDoc (src/lxml/lxml.etree.c:67148)
File "parser.pxi", line 539, in lxml.etree._ParserContext._handleParseResultDoc (src/lxml/lxml.etree.c:63824)
File "parser.pxi", line 625, in lxml.etree._handleParseResult (src/lxml/lxml.etree.c:64745)
File "parser.pxi", line 576, in lxml.etree._raiseParseError (src/lxml/lxml.etree.c:64260)
XMLSyntaxError: None

{
"exception": "None",
"follows": 0,
"logs": "it__.py", line 603, in fromstring\n doc = document_fromstring(html, parser=parser, base_url=base_url, *_kw)\n File "/usr/lib64/python2.6/site-packages/lxml/html/init.py", line 511, in document_fromstring\n value = etree.fromstring(html, parser, *_kw)\n File "lxml.etree.pyx", line 2532, in lxml.etree.fromstring (src/lxml/lxml.etree.c:48270)\n File "parser.pxi", line 1545, in lxml.etree._parseMemoryDocument (src/lxml/lxml.etree.c:71812)\n File "parser.pxi", line 1417, in lxml.etree._parseDoc (src/lxml/lxml.etree.c:70608)\n File "parser.pxi", line 898, in lxml.etree._BaseParser._parseUnicodeDoc (src/lxml/lxml.etree.c:67148)\n File "parser.pxi", line 539, in lxml.etree._ParserContext._handleParseResultDoc (src/lxml/lxml.etree.c:63824)\n File "parser.pxi", line 625, in lxml.etree._handleParseResult (src/lxml/lxml.etree.c:64745)\n File "parser.pxi", line 576, in lxml.etree._raiseParseError (src/lxml/lxml.etree.c:64260)\n XMLSyntaxError: None\n",
"ok": false,
"result": null,
"time": 0.00042104721069335938
}
schedule
{
"exetime": 1437457672.0611861,
"retried": 1
}
process
{
"callback": "list_cate"
}
fetch
{}

[binux]

Retry means it will try again.
Yes
It will become fail
From the log, 599 caused by timeout. Improve your network condition, or
just slow down.

On Tue, Jul 21, 2015, 1:51 PM 申传立 notifications@github.com wrote:

ACTIVE jd_allset.list_cate >
http://list.jd.com/list.html?cat=737%2C752%2C882&ev=exbrand_%E6%B1%89%E7%BE%8E%E9%A9%B0%EF%BC%88Hamilton%20Beach%EF%BC%89%40&page=1&JL=3_%E5%93%81%E7%89%8C_%E6%B1%89%E7%BE%8E%E9%A9%B0%EF%BC%88Hamilton
Beach%EF%BC%89 (3 minutes ago updated )

taskid
fef2f80e1a5553f86476676acd392c20
lastcrawltime
1437457672.06 (3 minutes ago)
updatetime
1437457672.06 (3 minutes ago)
exetime
1437457672.06 (3 minutes ago)
track.fetch 218762.45ms
{
"content": "",
"encoding": "unicode",
"error": "HTTP 599: Operation timed out after 119933 milliseconds with
38812 bytes received",
"headers": {},
"ok": false,
"redirect_url": "http://www.jd.com/?cdn4",
"status_code": 599,
"time": 218.76245498657227
}
track.process 0.42ms
None
it__.py", line 603, in fromstring
doc = document_fromstring(html, parser=parser, base_url=base_url, *

_kw) File "/usr/lib64/python2.6/site-packages/lxml/html/init.py", line
511, in document_fromstring value = etree.fromstring(html, parser, *_kw)
File "lxml.etree.pyx", line 2532, in lxml.etree.fromstring
(src/lxml/lxml.etree.c:48270)
File "parser.pxi", line 1545, in lxml.etree._parseMemoryDocument
(src/lxml/lxml.etree.c:71812)
File "parser.pxi", line 1417, in lxml.etree._parseDoc
(src/lxml/lxml.etree.c:70608)
File "parser.pxi", line 898, in lxml.etree._BaseParser._parseUnicodeDoc
(src/lxml/lxml.etree.c:67148)
File "parser.pxi", line 539, in
lxml.etree._ParserContext._handleParseResultDoc
(src/lxml/lxml.etree.c:63824)
File "parser.pxi", line 625, in lxml.etree._handleParseResult
(src/lxml/lxml.etree.c:64745)
File "parser.pxi", line 576, in lxml.etree._raiseParseError
(src/lxml/lxml.etree.c:64260)
XMLSyntaxError: None

{
"exception": "None",
"follows": 0,
"logs": "it__.py", line 603, in fromstring\n doc =
document_fromstring(html, parser=parser, base_url=base_url, *_kw)\n File
"/usr/lib64/python2.6/site-packages/lxml/html/init.py", line 511, in
document_fromstring\n value = etree.fromstring(html, parser, *_kw)\n File
"lxml.etree.pyx", line 2532, in lxml.etree.fromstring
(src/lxml/lxml.etree.c:48270)\n File "parser.pxi", line 1545, in
lxml.etree._parseMemoryDocument (src/lxml/lxml.etree.c:71812)\n File
"parser.pxi", line 1417, in lxml.etree._parseDoc
(src/lxml/lxml.etree.c:70608)\n File "parser.pxi", line 898, in
lxml.etree._BaseParser._parseUnicodeDoc (src/lxml/lxml.etree.c:67148)\n
File "parser.pxi", line 539, in
lxml.etree._ParserContext._handleParseResultDoc
(src/lxml/lxml.etree.c:63824)\n File "parser.pxi", line 625, in
lxml.etree._handleParseResult (src/lxml/lxml.etree.c:64745)\n File
"parser.pxi", line 576, in lxml.etree._raiseParseE rror
(src/lxml/lxml.etree.c:64260)\n XMLSyntaxError: None\n",
"ok": false,
"result": null,
"time": 0.00042104721069335938
}
schedule
{
"exetime": 1437457672.0611861,
"retried": 1
}
process
{
"callback": "list_cate"
}
fetch
{}

—
Reply to this email directly or view it on GitHub
#245 (comment).

[shenchuanli]

thx， it works.