feat(templates): use ImpitHttpClient and install optional deps in Docker by barjin · Pull Request #3603 · apify/crawlee

barjin · 2026-04-24T12:41:58Z

Soft-launches Impit as the default HTTP client in all Crawlee templates and removes --omit=optional from the production npm install in the template Dockerfiles so that impit's platform-specific native binaries — shipped via optionalDependencies — actually land in the image.

Closes #3601.

Wires ImpitHttpClient as the default httpClient for every template crawler and drops --omit=optional from the final-stage npm install so impit's platform-specific native binaries (shipped via optionalDependencies) land in the production image. The camoufox-ts template uses the Firefox fingerprint; the others use Chrome. Addresses #3601.

barjin · 2026-04-24T12:47:11Z

Here's the size comparison for different Docker images after dropping --omit-optional from the Dockerfiles.

For both cheerio and playwright, the difference is basically just impit, the puppeteer image also installs typescript due to a transitive dependency through cosmiconfig.

B4nan · 2026-04-24T13:18:48Z

It will be more important to do this in https://github.com/apify/actor-templates

Copilot

Pull request overview

This PR soft-launches Impit as the default HTTP client in Crawlee project templates and updates template Dockerfiles so Impit’s platform-specific native binaries (distributed via optionalDependencies) are installed in production images.

Changes:

Inject httpClient: new ImpitHttpClient(...) into crawler instantiations across templates.
Add @crawlee/impit-client to template dependencies.
Remove --omit=optional from template Dockerfile production installs so optional native binaries are included.

Reviewed changes

Copilot reviewed 31 out of 31 changed files in this pull request and generated 11 comments.

Show a summary per file

File	Description
packages/templates/templates/puppeteer-ts/src/main.ts	Configure `PuppeteerCrawler` to use `ImpitHttpClient`.
packages/templates/templates/puppeteer-ts/package.json	Add `@crawlee/impit-client` dependency.
packages/templates/templates/puppeteer-ts/Dockerfile	Install prod deps without omitting `optionalDependencies`.
packages/templates/templates/puppeteer-js/src/main.js	Configure `PuppeteerCrawler` to use `ImpitHttpClient`.
packages/templates/templates/puppeteer-js/package.json	Add `@crawlee/impit-client` dependency.
packages/templates/templates/puppeteer-js/Dockerfile	Install prod deps without omitting `optionalDependencies`.
packages/templates/templates/playwright-ts/src/main.ts	Configure `PlaywrightCrawler` to use `ImpitHttpClient`.
packages/templates/templates/playwright-ts/package.json	Add `@crawlee/impit-client` dependency.
packages/templates/templates/playwright-ts/Dockerfile	Install prod deps without omitting `optionalDependencies`.
packages/templates/templates/playwright-js/src/main.js	Configure `PlaywrightCrawler` to use `ImpitHttpClient`.
packages/templates/templates/playwright-js/package.json	Add `@crawlee/impit-client` dependency.
packages/templates/templates/playwright-js/Dockerfile	Install prod deps without omitting `optionalDependencies`.
packages/templates/templates/getting-started-ts/src/main.ts	Configure `PlaywrightCrawler` to use `ImpitHttpClient`.
packages/templates/templates/getting-started-ts/package.json	Add `@crawlee/impit-client` dependency.
packages/templates/templates/getting-started-ts/Dockerfile	Install prod deps without omitting `optionalDependencies`.
packages/templates/templates/getting-started-js/src/main.js	Configure `PlaywrightCrawler` to use `ImpitHttpClient`.
packages/templates/templates/getting-started-js/package.json	Add `@crawlee/impit-client` dependency.
packages/templates/templates/getting-started-js/Dockerfile	Install prod deps without omitting `optionalDependencies`.
packages/templates/templates/empty-ts/package.json	Add `@crawlee/impit-client` dependency.
packages/templates/templates/empty-ts/Dockerfile	Install prod deps without omitting `optionalDependencies`.
packages/templates/templates/empty-js/package.json	Add `@crawlee/impit-client` dependency.
packages/templates/templates/empty-js/Dockerfile	Install prod deps without omitting `optionalDependencies`.
packages/templates/templates/cheerio-ts/src/main.ts	Configure `CheerioCrawler` to use `ImpitHttpClient`.
packages/templates/templates/cheerio-ts/package.json	Add `@crawlee/impit-client` dependency.
packages/templates/templates/cheerio-ts/Dockerfile	Install prod deps without omitting `optionalDependencies`.
packages/templates/templates/cheerio-js/src/main.js	Configure `CheerioCrawler` to use `ImpitHttpClient`.
packages/templates/templates/cheerio-js/package.json	Add `@crawlee/impit-client` dependency.
packages/templates/templates/cheerio-js/Dockerfile	Install prod deps without omitting `optionalDependencies`.
packages/templates/templates/camoufox-ts/src/main.ts	Configure `PlaywrightCrawler` (Camoufox/Firefox) to use `ImpitHttpClient`.
packages/templates/templates/camoufox-ts/package.json	Add `@crawlee/impit-client` dependency.
packages/templates/templates/camoufox-ts/Dockerfile	Install prod deps without omitting `optionalDependencies`.

💡 Add Copilot custom instructions for smarter, more guided reviews. Learn how to get started.

Copilot · 2026-04-24T13:23:56Z

    "dependencies": {
+        "@crawlee/impit-client": "^3.0.0",
        "crawlee": "^3.0.0",
        "puppeteer": "*"


Adding @crawlee/impit-client introduces a Node.js >=20 requirement (the package declares engines.node >=20). This template package.json doesn’t declare an engines constraint, so users on Node 16/18 can hit install failures/warnings. Consider adding an engines field (or otherwise documenting/enforcing Node >=20 for templates using Impit).

Copilot · 2026-04-24T13:23:56Z

    "dependencies": {
+        "@crawlee/impit-client": "^3.0.0",
        "crawlee": "^3.0.0",
        "puppeteer": "*"


Adding @crawlee/impit-client introduces a Node.js >=20 requirement (the package declares engines.node >=20). This template package.json doesn’t declare an engines constraint, so users on Node 16/18 can hit install failures/warnings. Consider adding an engines field (or otherwise documenting/enforcing Node >=20 for templates using Impit).

Copilot · 2026-04-24T13:23:57Z

    "dependencies": {
+        "@crawlee/impit-client": "^3.0.0",
        "crawlee": "^3.0.0",
        "playwright": "1.58.2"


Adding @crawlee/impit-client introduces a Node.js >=20 requirement (the package declares engines.node >=20). This template package.json doesn’t declare an engines constraint, so users on Node 16/18 can hit install failures/warnings. Consider adding an engines field (or otherwise documenting/enforcing Node >=20 for templates using Impit).

Copilot · 2026-04-24T13:23:57Z

    "dependencies": {
+        "@crawlee/impit-client": "^3.0.0",
        "crawlee": "^3.0.0",
        "playwright": "1.58.2"


Adding @crawlee/impit-client introduces a Node.js >=20 requirement (the package declares engines.node >=20). This template package.json doesn’t declare an engines constraint, so users on Node 16/18 can hit install failures/warnings. Consider adding an engines field (or otherwise documenting/enforcing Node >=20 for templates using Impit).

Copilot · 2026-04-24T13:23:57Z

    "dependencies": {
+        "@crawlee/impit-client": "^3.0.0",
        "crawlee": "^3.0.0",
        "playwright": "1.58.2"


Adding @crawlee/impit-client introduces a Node.js >=20 requirement (the package declares engines.node >=20). This template package.json doesn’t declare an engines constraint, so users on Node 16/18 can hit install failures/warnings. Consider adding an engines field (or otherwise documenting/enforcing Node >=20 for templates using Impit).

Copilot · 2026-04-24T13:23:58Z

    "dependencies": {
+        "@crawlee/impit-client": "^3.0.0",
        "crawlee": "^3.0.0"
    },


Adding @crawlee/impit-client introduces a Node.js >=20 requirement (the package declares engines.node >=20). This template package.json doesn’t declare an engines constraint, so users on Node 16/18 can hit install failures/warnings. Consider adding an engines field (or otherwise documenting/enforcing Node >=20 for templates using Impit).

Copilot · 2026-04-24T13:23:58Z

    "dependencies": {
+        "@crawlee/impit-client": "^3.0.0",
        "crawlee": "^3.0.0"
    },


Adding @crawlee/impit-client introduces a Node.js >=20 requirement (the package declares engines.node >=20). This template package.json doesn’t declare an engines constraint, so users on Node 16/18 can hit install failures/warnings. Consider adding an engines field (or otherwise documenting/enforcing Node >=20 for templates using Impit).

Suggested change

},

},

"engines": {

"node": ">=20"

},

Copilot · 2026-04-24T13:23:59Z

    "dependencies": {
+        "@crawlee/impit-client": "^3.0.0",
        "camoufox-js": "^0.9.0",
        "crawlee": "^3.0.0",
        "playwright": "1.58.2"


Adding @crawlee/impit-client introduces a Node.js >=20 requirement (the package declares engines.node >=20). This template package.json doesn’t declare an engines constraint, so users on Node 16/18 can hit install failures/warnings. Consider adding an engines field (or otherwise documenting/enforcing Node >=20 for templates using Impit).

…plates The empty-* templates ship no crawler, so pulling in @crawlee/impit-client and re-enabling optional deps in their Dockerfile has no effect beyond bloating the install. Restore their original state.

github-actions Bot assigned barjin Apr 24, 2026

github-actions Bot added this to the 139th sprint - Tooling team milestone Apr 24, 2026

github-actions Bot added the t-tooling Issues with this label are in the ownership of the tooling team. label Apr 24, 2026

barjin requested a review from Copilot April 24, 2026 13:18

Copilot started reviewing on behalf of barjin April 24, 2026 13:19 View session

Copilot AI reviewed Apr 24, 2026

View reviewed changes

chore(templates): revert impit and optional-deps changes in empty tem…

57d0712

…plates The empty-* templates ship no crawler, so pulling in @crawlee/impit-client and re-enabling optional deps in their Dockerfile has no effect beyond bloating the install. Restore their original state.

barjin requested review from B4nan and janbuchar April 24, 2026 13:30

B4nan approved these changes Apr 28, 2026

View reviewed changes

Provide feedback

Saved searches

Use saved searches to filter your results more quickly

feat(templates): use ImpitHttpClient and install optional deps in Docker#3603

feat(templates): use ImpitHttpClient and install optional deps in Docker#3603
barjin wants to merge 2 commits intomasterfrom
feat/impit-templates-default-client

barjin commented Apr 24, 2026 •

edited

Loading

Uh oh!

barjin commented Apr 24, 2026

Uh oh!

B4nan commented Apr 24, 2026

Uh oh!

Copilot AI left a comment

Uh oh!

Copilot AI Apr 24, 2026

Uh oh!

Copilot AI Apr 24, 2026

Uh oh!

Copilot AI Apr 24, 2026

Uh oh!

Copilot AI Apr 24, 2026

Uh oh!

Copilot AI Apr 24, 2026

Uh oh!

Copilot AI Apr 24, 2026

Uh oh!

Copilot AI Apr 24, 2026

Uh oh!

Copilot AI Apr 24, 2026

Uh oh!

Uh oh!

Uh oh!

Reviewers

Assignees

Labels

Projects

Milestone

Development

Uh oh!

4 participants

-    },
+    },
+    "engines": {
+        "node": ">=20"
+    },

Conversation

barjin commented Apr 24, 2026 • edited Loading Uh oh! There was an error while loading. Please reload this page.

Uh oh!

Uh oh!

barjin commented Apr 24, 2026

Uh oh!

B4nan commented Apr 24, 2026

Uh oh!

Copilot AI left a comment

Choose a reason for hiding this comment

Pull request overview

Reviewed changes

Uh oh!

Copilot AI Apr 24, 2026

Choose a reason for hiding this comment

Uh oh!

Copilot AI Apr 24, 2026

Choose a reason for hiding this comment

Uh oh!

Copilot AI Apr 24, 2026

Choose a reason for hiding this comment

Uh oh!

Copilot AI Apr 24, 2026

Choose a reason for hiding this comment

Uh oh!

Copilot AI Apr 24, 2026

Choose a reason for hiding this comment

Uh oh!

Copilot AI Apr 24, 2026

Choose a reason for hiding this comment

Uh oh!

Copilot AI Apr 24, 2026

Choose a reason for hiding this comment

Uh oh!

Copilot AI Apr 24, 2026

Choose a reason for hiding this comment

Uh oh!

Uh oh!

Uh oh!

Reviewers

Assignees

Labels

Projects

Milestone

Development

Uh oh!

4 participants

barjin commented Apr 24, 2026 •

edited

Loading