Error 302 redirection with headers location starts with 3 slash #4032
when the 302 response return a headers's location startswith 3 slash, the scrapy redirect to a url different from what the browser do.
Steps to Reproduce
Reproduces how often:
Scrapy : 1.7.3
The behavior of scrapy is determined by redirect.py#L73, which will truncate
I'm wandering the differents betweent scarpy and browser...
The text was updated successfully, but these errors were encountered:
@Gallaecio The difference between Scrapy and a browser is that, when the
This is happening because we have
How can we know whether the URL should be relative w.r.t base URL or a completely new URL? should we make two calls one for the
@Gallaecio This fixes the issue:
Here I checked whether the location header contains a URL starting with multiple