Skip to content

Do not recode JPEG files in imagepipelines #4753

New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Merged
merged 22 commits into from
Nov 7, 2022
Merged

Conversation

drs-11
Copy link
Contributor

@drs-11 drs-11 commented Aug 25, 2020

This patch completes the last few suggestions on the pull request #3689.

Fixes #3055, closes #3689

@codecov
Copy link

codecov bot commented Aug 25, 2020

Codecov Report

Merging #4753 (bbe24d7) into master (77cd511) will increase coverage by 0.19%.
The diff coverage is 100.00%.

@@            Coverage Diff             @@
##           master    #4753      +/-   ##
==========================================
+ Coverage   88.67%   88.87%   +0.19%     
==========================================
  Files         162      162              
  Lines       11013    11026      +13     
  Branches     1802     1808       +6     
==========================================
+ Hits         9766     9799      +33     
+ Misses        966      947      -19     
+ Partials      281      280       -1     
Impacted Files Coverage Δ
scrapy/pipelines/images.py 97.05% <100.00%> (+1.93%) ⬆️
scrapy/robotstxt.py 97.53% <0.00%> (+22.22%) ⬆️

Copy link
Member

@Gallaecio Gallaecio left a comment

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

Nice take over!

The coverage data shows an issue, though: the tests only cover the change in convert_image, the change in get_images, which is the most significant, is not currently covered by tests for scenarios where the new parameter is missing.

@drs-11
Copy link
Contributor Author

drs-11 commented Sep 2, 2020

Hey @Gallaecio, I think the test cases cover get_images now. Can you review this?

Copy link
Member

@Gallaecio Gallaecio left a comment

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

Awesome!

@drs-11
Copy link
Contributor Author

drs-11 commented Sep 13, 2020

Ummm @kmike you requested some changes in the previous PR. This looks good to go now?

@kmike
Copy link
Member

kmike commented Oct 1, 2020

The implementation looks good to me overall @drs-11, thanks for picking it up! I haven't really checked the tests, but rely on you all to get them right :) +1 to merge after addressing a couple of comments about warning messages.

@drs-11 drs-11 requested a review from kmike October 5, 2020 18:40
@wRAR wRAR merged commit c56caaf into scrapy:master Nov 7, 2022
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
None yet
Projects
None yet
Development

Successfully merging this pull request may close these issues.

[bug] pillow will always recode images in imagepipieline
5 participants