URL download and cleanup

[shyams80]

Don't see the code for downloading content from a url, removing the boilerplate etc... Can you point me to the section of the code that does that?

[tkroman]

I'm sorry, could you be more elaborate on that issue please? It's not clear for me what precisely do you want.

[shyams80]

The mashape api can take a URL input and return the summarized result. I
couldn't find the section of the code that provides this functionality. I
am assuming that when given a URL, you will need to download the entire
page, extract the main article (i.e. remove the boilerplate) and them pass
the article to the main summarizer routine. How and where is the code
handling this?

On Sat, Oct 26, 2013 at 11:20 PM, Roman Tkalenko
notifications@github.comwrote:

I'm sorry, could you be more elaborate on that issue please? It's not
clear for me what precisely do you want.

—
Reply to this email directly or view it on GitHubhttps://github.com//issues/19#issuecomment-27151513
.

http://about.me/sunder.struck/bio

[MojoJolo]

The code here in Github only accepts the text and the title. The API in Mashape has another layer to extract the text from the webpage. It was using Python Goose for it.