Protocols

Julien Nioche edited this page Oct 9, 2018 · 7 revisions

The following network protocols are implemented in storm-crawler:

File

HTTP/S

See HTTPProtocol for the effect of metadata content on protocol behaviour.

Feature grid

Features HTTPClient OKhttp Selenium
Basic authentication Y N N
proxy (w. credentials?) Y / Y Y / N ?
interruptible / trimmable #463 N / Y Y / Y Y / N
cookies Y Y N
response headers Y Y N
trust all certificates N Y N
HEAD method #485 Y N N
verbatim response header Y Y N
verbatim request header N Y N
navigation and javascript N N Y
You can’t perform that action at this time.
You signed in with another tab or window. Reload to refresh your session. You signed out in another tab or window. Reload to refresh your session.
Press h to open a hovercard with more details.