-
Notifications
You must be signed in to change notification settings - Fork 10.4k
New issue
Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.
By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.
Already on GitHub? Sign in to your account
Set METAREFRESH_IGNORE_TAGS to ["noscript"] by default #6342
Comments
on it |
aisha-partha
added a commit
to aisha-partha/scrapy
that referenced
this issue
May 8, 2024
aisha-partha
added a commit
to aisha-partha/scrapy
that referenced
this issue
May 8, 2024
aisha-partha
added a commit
to aisha-partha/scrapy
that referenced
this issue
May 8, 2024
aisha-partha
added a commit
to aisha-partha/scrapy
that referenced
this issue
May 8, 2024
…efault value change
wRAR
added a commit
that referenced
this issue
May 10, 2024
Closes #6342. Setting METAREFRESH_IGNORE_TAGS to [‘noscript’] by default
Should we cherry-pick this to 2.11? |
+0.5 from me. It is technically backward-incompatible, but it should be so for the better in all scenarios I can think of. And it is trivial to override if that’s not the case. |
Sign up for free
to join this conversation on GitHub.
Already have an account?
Sign in to comment
I was wrong in #3844. The default value should be
["noscript"]
, to deal with antibot behaviors.Found by @mukthy.
The text was updated successfully, but these errors were encountered: