feat: Use specialized Playwright docker images in templates by Pijukatel · Pull Request #1757 · apify/crawlee-python

Pijukatel · 2026-02-18T07:37:38Z

Description

Update templates to use a browser-specialized Playwright Docker image
Add specialized templates: playwright-chrome, playwright-firefox, playwright-webkit
Update e2e tests to include new templates
Update PlaywrightBrowserPlugin to not raise an Exception when browser type='chrome' and explicit executable_path is provided as well. Just add debug log instead.

Issues

Closes: Use new docker images in crawlee cli templates #1756

Testing

e2e tests

Checklist

CI passed

codecov · 2026-02-18T07:42:05Z

Codecov Report

❌ Patch coverage is 50.00000% with 2 lines in your changes missing coverage. Please review.
✅ Project coverage is 92.28%. Comparing base (7663404) to head (5dd7346).
⚠️ Report is 5 commits behind head on master.

Files with missing lines	Patch %	Lines
src/crawlee/browsers/_playwright_browser_plugin.py	50.00%	2 Missing ⚠️

Additional details and impacted files

@@            Coverage Diff             @@
##           master    #1757      +/-   ##
==========================================
- Coverage   92.31%   92.28%   -0.03%     
==========================================
  Files         156      156              
  Lines       10644    10645       +1     
==========================================
- Hits         9826     9824       -2     
- Misses        818      821       +3

Flag	Coverage Δ
unit	`92.28% <50.00%> (-0.03%)`	⬇️

Flags with carried forward coverage won't be shown. Click here to find out more.

☔ View full report in Codecov by Sentry.
📢 Have feedback on the report? Share it here.

🚀 New features to boost your workflow:

❄️ Test Analytics: Detect flaky tests, report on failures, and find test suite problems.
📦 JS Bundle Analysis: Save yourself from yourself by tracking and limiting bundle sizes in JS merges.

…images

…_path` by debug log

Pijukatel · 2026-02-18T09:32:14Z

E2E test from this branch: https://github.com/apify/crawlee-python/actions/runs/22134060453

Reason for changing the exception to debug log: https://apify.slack.com/archives/C07UBD2PZ5M/p1771406294667919?thread_ts=1771345683.896419&cid=C07UBD2PZ5M

Mantisus

LGTM

Copilot

Pull request overview

Updates Crawlee’s cookiecutter project templates to support browser-specific Playwright Docker images and adds dedicated Playwright template variants (Chrome/Firefox/WebKit), while relaxing PlaywrightBrowserPlugin behavior for browser_type='chrome' with an explicit executable_path.

Changes:

Add new cookiecutter template options and corresponding main_*.py templates for playwright-chrome, playwright-firefox, and playwright-webkit.
Update template routing/dependencies and Dockerfile base images to work consistently across all playwright* crawler types.
Expand e2e template coverage and scheduled CI matrix to include the new crawler template variants; adjust PlaywrightBrowserPlugin to log instead of raising for chrome + executable_path.

Reviewed changes

Copilot reviewed 12 out of 12 changed files in this pull request and generated 2 comments.

Show a summary per file

File	Description
tests/e2e/project_template/test_static_crawlers_templates.py	Adds e2e coverage for newly introduced Playwright crawler template types.
src/crawlee/project_template/{{cookiecutter.project_name}}/{{cookiecutter.__package_name}}/routes.py	Routes all `playwright*` templates to shared Playwright routes template.
src/crawlee/project_template/{{cookiecutter.project_name}}/requirements.txt	Ensures all `playwright*` templates select the `crawlee[playwright]` extra; keeps camoufox dependency conditional.
src/crawlee/project_template/{{cookiecutter.project_name}}/pyproject.toml	Aligns extras selection so all `playwright*` templates depend on `crawlee[playwright]`.
src/crawlee/project_template/{{cookiecutter.project_name}}/Dockerfile	Switches to browser-specialized Playwright base images for new template variants (and camoufox).
src/crawlee/project_template/templates/routes_playwright_camoufox.py	Removes redundant routes template (now shared via `routes_playwright.py`).
src/crawlee/project_template/templates/main_playwright_chrome.py	New template configuring `PlaywrightCrawler(browser_type="chrome")`.
src/crawlee/project_template/templates/main_playwright_firefox.py	New template configuring `PlaywrightCrawler(browser_type="firefox")`.
src/crawlee/project_template/templates/main_playwright_webkit.py	New template configuring `PlaywrightCrawler(browser_type="webkit")`.
src/crawlee/project_template/cookiecutter.json	Adds new crawler type choices for the specialized Playwright templates.
src/crawlee/browsers/_playwright_browser_plugin.py	Changes `chrome` + `executable_path` handling from raising to debug logging.
.github/workflows/on_schedule_tests.yaml	Expands scheduled e2e matrix to run against new crawler template variants.

💡 Add Copilot custom instructions for smarter, more guided reviews. Learn how to get started.

src/crawlee/browsers/_playwright_browser_plugin.py

Copilot

Pull request overview

Copilot reviewed 12 out of 12 changed files in this pull request and generated 2 comments.

💡 Add Copilot custom instructions for smarter, more guided reviews. Learn how to get started.

...lee/project_template/{{cookiecutter.project_name}}/{{cookiecutter.__package_name}}/routes.py

.github/workflows/on_schedule_tests.yaml

vdusek

Nice, 4 comments from claude, 2 are nits

.github/workflows/on_schedule_tests.yaml

vdusek · 2026-02-18T19:46:52Z

src/crawlee/browsers/_playwright_browser_plugin.py

+            if explicit_browser_launch_options.get(
+                'executable_path', default_launch_browser_options.get('executable_path')
+            ):
+                logger.debug(
+                    f'Using browser executable from {default_launch_browser_options["executable_path"]},'
+                    f" which takes precedence over 'chrome' channel."


Bug: Debug log message reports wrong executable path

File: src/crawlee/browsers/_playwright_browser_plugin.py

The condition checks explicit_browser_launch_options.get('executable_path',
default_launch_browser_options.get('executable_path')) to determine if an
executable path is set, but the log message always formats
default_launch_browser_options["executable_path"]. When the user passes
executable_path via browser_launch_options, the log will display the wrong
path (the default one, not the user-provided one).

Suggestion:

effective_path = explicit_browser_launch_options.get(
'executable_path', default_launch_browser_options.get('executable_path')
)
if effective_path:
logger.debug(
f"Using browser executable from {effective_path},"
f" which takes precedence over 'chrome' channel."
)

src/crawlee/project_template/{{cookiecutter.project_name}}/requirements.txt

vdusek · 2026-02-18T19:48:23Z

src/crawlee/project_template/templates/main_playwright_chrome.py

@@ -0,0 +1,14 @@
+# % extends 'main.py'


Nit: Closing parenthesis formatting

Files: templates/main_playwright_chrome.py,
templates/main_playwright_firefox.py, templates/main_playwright_webkit.py

The closing ) is on the same line as the last argument:

{{ self.http_client_instantiation() }})

Consider:

{{ self.http_client_instantiation() }}

)

vdusek

LGTM, but undo the "from -> rom" change

src/crawlee/project_template/cookiecutter.json

vdusek · 2026-02-19T16:32:06Z

src/crawlee/project_template/templates/routes_camoufox.py

@@ -1,4 +1,4 @@
-from crawlee.crawlers import PlaywrightCrawlingContext
+rom crawlee.crawlers import PlaywrightCrawlingContext


🙂

Suggested change

rom crawlee.crawlers import PlaywrightCrawlingContext

from crawlee.crawlers import PlaywrightCrawlingContext

Ohh, I remember deleting this file completely...

github-actions bot assigned Pijukatel Feb 18, 2026

github-actions bot added this to the 134th sprint - Tooling team milestone Feb 18, 2026

github-actions bot added t-tooling Issues with this label are in the ownership of the tooling team. tested Temporary label used only programatically for some analytics. labels Feb 18, 2026

Pijukatel force-pushed the use-specialized-pw-docker-images branch 3 times, most recently from 024d605 to e8abc7c Compare February 18, 2026 08:08

Update tesmplates and e2e tests to use specialized Playwright docker …

e360ccb

…images

Pijukatel force-pushed the use-specialized-pw-docker-images branch from e8abc7c to e360ccb Compare February 18, 2026 08:18

Replace exception when using chrome and having explicit `executable…

1e4a7ec

…_path` by debug log

Pijukatel marked this pull request as ready for review February 18, 2026 09:37

Pijukatel requested review from Mantisus and vdusek and removed request for vdusek February 18, 2026 09:38

Mantisus approved these changes Feb 18, 2026

View reviewed changes

vdusek requested a review from Copilot February 18, 2026 13:04

Copilot started reviewing on behalf of vdusek February 18, 2026 13:04 View session

Copilot AI reviewed Feb 18, 2026

View reviewed changes

src/crawlee/browsers/_playwright_browser_plugin.py Outdated Show resolved Hide resolved

src/crawlee/browsers/_playwright_browser_plugin.py Outdated Show resolved Hide resolved

ai review comments

5820e07

Pijukatel requested a review from Copilot February 18, 2026 15:45

Copilot started reviewing on behalf of Pijukatel February 18, 2026 15:46 View session

Copilot AI reviewed Feb 18, 2026

View reviewed changes

...lee/project_template/{{cookiecutter.project_name}}/{{cookiecutter.__package_name}}/routes.py Show resolved Hide resolved

.github/workflows/on_schedule_tests.yaml Show resolved Hide resolved

vdusek reviewed Feb 18, 2026

View reviewed changes

Review comments

42a89ef

Pijukatel requested a review from vdusek February 19, 2026 08:50

vdusek approved these changes Feb 19, 2026

View reviewed changes

Delete the redundant file finally

5dd7346

Pijukatel merged commit 747c0cf into master Feb 19, 2026
73 of 74 checks passed

Pijukatel deleted the use-specialized-pw-docker-images branch February 19, 2026 17:09

		@@ -1,4 +1,4 @@
		from crawlee.crawlers import PlaywrightCrawlingContext
		rom crawlee.crawlers import PlaywrightCrawlingContext

Conversation

Pijukatel commented Feb 18, 2026 • edited Loading Uh oh! There was an error while loading. Please reload this page.

Uh oh!

Description

Issues

Testing

Checklist

Uh oh!

codecov bot commented Feb 18, 2026 • edited Loading Uh oh! There was an error while loading. Please reload this page.

Uh oh!

Codecov Report

Uh oh!

Pijukatel commented Feb 18, 2026 • edited Loading Uh oh! There was an error while loading. Please reload this page.

Uh oh!

Uh oh!

Mantisus left a comment

Choose a reason for hiding this comment

Uh oh!

Copilot AI left a comment

Choose a reason for hiding this comment

Pull request overview

Reviewed changes

Uh oh!

Uh oh!

Uh oh!

Copilot AI left a comment

Choose a reason for hiding this comment

Pull request overview

Uh oh!

Uh oh!

Uh oh!

vdusek left a comment

Choose a reason for hiding this comment

Uh oh!

Uh oh!

vdusek Feb 18, 2026

Choose a reason for hiding this comment

Uh oh!

Pijukatel Feb 19, 2026

Choose a reason for hiding this comment

Uh oh!

Uh oh!

vdusek Feb 18, 2026

Choose a reason for hiding this comment

Uh oh!

Pijukatel Feb 19, 2026

Choose a reason for hiding this comment

Uh oh!

vdusek left a comment

Choose a reason for hiding this comment

Uh oh!

Uh oh!

vdusek Feb 19, 2026

Choose a reason for hiding this comment

Uh oh!

Pijukatel Feb 19, 2026

Choose a reason for hiding this comment

Uh oh!

Uh oh!

Reviewers

Assignees

Labels

Projects

Milestone

Development

Uh oh!

3 participants

Comments

Pijukatel commented Feb 18, 2026 •

edited

Loading

codecov bot commented Feb 18, 2026 •

edited

Loading

Pijukatel commented Feb 18, 2026 •

edited

Loading