-
Notifications
You must be signed in to change notification settings - Fork 10.6k
New issue
Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.
By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.
Already on GitHub? Sign in to your account
Fix for issue #3798 LinkExtractor with Unique = False doesn't extract fully identical Links #3799
Conversation
…xtract fully identical Links
Codecov Report
@@ Coverage Diff @@
## master #3799 +/- ##
==========================================
+ Coverage 85.42% 85.43% +<.01%
==========================================
Files 169 169
Lines 9635 9637 +2
Branches 1433 1433
==========================================
+ Hits 8231 8233 +2
Misses 1156 1156
Partials 248 248
|
1 similar comment
Codecov Report
@@ Coverage Diff @@
## master #3799 +/- ##
==========================================
+ Coverage 85.42% 85.43% +<.01%
==========================================
Files 169 169
Lines 9635 9637 +2
Branches 1433 1433
==========================================
+ Hits 8231 8233 +2
Misses 1156 1156
Partials 248 248
|
There was a problem hiding this comment.
Choose a reason for hiding this comment
The reason will be displayed to describe this comment to others. Learn more.
The changes look good to me, but I don’t feel familiar enough with link extractors to approve them myself. Hopefully someone else will have a look soon.
@@ -15,7 +15,7 @@ | |||
from scrapy.utils.url import ( | |||
url_is_from_any_domain, url_has_any_extension, | |||
) | |||
|
|||
from scrapy.utils.python import unique as unique_list |
There was a problem hiding this comment.
Choose a reason for hiding this comment
The reason will be displayed to describe this comment to others. Learn more.
💄 Could you move it into the group of import above, keeping the alphabetical sorting?
Fixes #3798