setting HTTP_PROXY

[atomotic]

process.env.HTTP_PROXY is not being passed to puppeteer.launch(), tried with a running proxy and:

env HTTP_PROXY=localhost:8000 node crawl.js

[yujiosaka]

@atomotic
Thanks for filing an issue!
I see puppeteer's document confusing. I read puppeteer's code and I found it uses HTTP_PROXY for downloading Chromium but not for running it.

Actually, it provides another way of using a proxy in this example.

headless-chrome-crawler passes args option to puppeteer when launching and connecting to a Chromium instance.
So it should work in this way:

const HCCrawler = require('headless-chrome-crawler');

HCCrawler.launch({
  args: [ '--proxy-server=127.0.0.1:3128' ], // Pass proxy setting here
  onSuccess: (result => {
    console.log(`Requested ${result.options.url}.`);
  }),
})
  .then(crawler => {
    crawler.queue('https://example.com/');
    crawler.onIdle()
      .then(() => crawler.close());
  });

[atomotic]

good, thank you!
passing proxy in args works fine