Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Change proxy-agent to support http/https through http/https/socks/pac… #1839

Merged
merged 1 commit into from
Sep 4, 2018

Conversation

thor27
Copy link

@thor27 thor27 commented Aug 31, 2018

When using SCRAPER_PROXY_URL and the page with comments isn't HTTPS the asset title would be saved as "400 The plain HTTP request was sent to HTTPS port".

The solution proposed is to change the code to use the library "proxy-agent"[1]. That way we support more proxy types and also works with HTTP and HTTPS connections.

[1] - https://www.npmjs.com/package/proxy-agent

Copy link
Collaborator

@wyattjoh wyattjoh left a comment

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

Looks good to me!

@wyattjoh wyattjoh merged commit 382019d into coralproject:master Sep 4, 2018
@wyattjoh wyattjoh added this to the v4.6.3 milestone Sep 4, 2018
@wyattjoh wyattjoh removed the in review label Sep 4, 2018
@thor27 thor27 deleted the fix-proxy branch September 4, 2018 18:18
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
None yet
Projects
None yet
Development

Successfully merging this pull request may close these issues.

3 participants