You must download and parse an article before parsing it

[bitliner]

Here the stack trace:

[Parse lxml ERR] line 1045: Tag nav invalid
[Article parse ERR] http://www.cnet.com/products/apple-ipad-march-2012/
You must download and parse an article before parsing it!
Traceback (most recent call last):
  File "crawler.py", line 30, in <module>
    a.nlp()
  File "/root/.virtualenvs/cnet-crawler/local/lib/python2.7/site-packages/newspaper/article.py", line 276, in nlp
    raise ArticleException()
newspaper.article.ArticleException

I'm not using the concurrent version, I'm not building a newspaper from a url, but rather I have a list of all the articles and I build a new Article from them.

[codelucas]

I'll test this on my computer and get back to ya.

I've seen this error before. From my personal experience it occurs when the HTML you are trying to parse is much too "deformed" for lxml. (The error is complaining about a <nav> tag).

http://stackoverflow.com/questions/4967103/beautifulsoup-and-lxml-html-what-to-prefer

BeautifulSoup is preferred for "non well-formed" html. (You have the option of using both lxml or BeautifulSoup to parse, but lxml is much faster.

[Casyfill]

But how can I switch to bf parser? Can't find any documentation on that

[cesarandreslopez]

Same here. Not sure how to change the parsing to BeautifulSoup

[go2dmny]

Any update? Also looking for a solution