Crawl multipage articles

[Matthias84]

Issue details

(I know this might become a hard one)

Especially newspages create articles with pagination. It would be nice, if wallabag could detect < 1 2 3> links and combine them to one single combined text.

• W3C suggest rel="Next"
• Google suggests rel="next"

[tcitworld]

Well, normally wallabag already tries to do that. You can sent us links of where it should happen for us to fix it. :)

[Matthias84]

Ok will try to collect some links. Till then, feel free to close this issue 😃

[j0k3r]

We are using siteconfig file to better handle pagination.
For example, this config file for gsmarena.com tells the parser which link will be the next page (with next_page_link). The parser will concat page until it can't find the next page link.

But there isn't something like auto find the next page link.
I'll more than happy if you can provide few links with the Google / W3C suggestion. So we can investigate and try to implement that.

[j0k3r]

I don't think we'll handle auto link, next_page_link is the way to go in siteconfig.