For some reason, Azure Web Job that is executing Scraper is throwing OutOfMemoryException every 10-15 minutes. It is recovering itself but still this is strange because locally this does not happen.
This might be somehow related to bitness of the processes. Also, per Process Explorer the amount of threads with time constantly increases (until app crashes).