cannot import very long article (v2)

[nkoehring]

Issue details

I try to import http://ledger-cli.org/3.0/doc/ledger3.html and it fails with a 500 (log says: readability.php exceeded the maximum execution time of 30s).

Is there any way to speed this up?

Environment

Wallabag v2.0.0-alpha.2
on Arch Linux ARM
with sqlite database

Steps to reproduce/test case

try to import http://ledger-cli.org/3.0/doc/ledger3.html

[j0k3r]

I agree that article is very long. I guess your server isn't that fast, right?
I tried on two different machine and, apart the fact that it took longer than usual, the content was well imported (http://v2.wallabag.org/view/4870).

I'll see if I can optimized few things on Readability side but I can't guarantee I'll find sth.
In the mean time, can you increase PHP max_execution_time on your server?
Also, could you share your server configuration (ram, cpu speed, etc..)

[tcitworld]

Is there a way we could timeout the graby query to Readability so that the exception would be caught to avoid a 500 error ?

[nkoehring]

It is not a big server. It's a dedicated ARMv7 with 4 cores clocked at 1.3GHz, sporting 2GB of RAM.

Is it maybe possible to separate the import process from the rendering process and both from the main thread? These long running things should run in the background.

[tcitworld]

These long running things should run in the background.

Yup, there's #1581 (comment) to implement this.