Skip to content

Browser: create Playwright per agent session#313779

Merged
kycutler merged 2 commits into
mainfrom
kycutler/pwpersession
May 4, 2026
Merged

Browser: create Playwright per agent session#313779
kycutler merged 2 commits into
mainfrom
kycutler/pwpersession

Conversation

@kycutler
Copy link
Copy Markdown
Contributor

@kycutler kycutler commented May 1, 2026

No description provided.

Copilot AI review requested due to automatic review settings May 1, 2026 19:46
@kycutler kycutler self-assigned this May 1, 2026
Copy link
Copy Markdown
Contributor

Copilot AI left a comment

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

Pull request overview

This PR updates the integrated browser Playwright plumbing so that Playwright browser connections are created per agent/chat session, and are disposed when the corresponding chat session ends.

Changes:

  • Add a sessionId parameter to IPlaywrightService operations and thread it through all browser chat tools.
  • Refactor the shared-process Playwright implementation to manage per-session Playwright instances with inactivity-based disposal.
  • Dispose Playwright sessions on chat session disposal, and keep tracked browser-page sharing state consistent during view disposal.
Show a summary per file
File Description
src/vs/workbench/contrib/browserView/electron-browser/tools/typeBrowserTool.ts Passes session ID into Playwright invocations for typing/press actions.
src/vs/workbench/contrib/browserView/electron-browser/tools/screenshotBrowserTool.ts Passes session ID into raw Playwright invocation used for element bounding boxes.
src/vs/workbench/contrib/browserView/electron-browser/tools/runPlaywrightCodeTool.ts Routes deferred waits and code execution through session-scoped Playwright calls.
src/vs/workbench/contrib/browserView/electron-browser/tools/readBrowserTool.ts Reads page summary via session-scoped Playwright calls.
src/vs/workbench/contrib/browserView/electron-browser/tools/openBrowserTool.ts Opens/shares pages using session-scoped Playwright calls.
src/vs/workbench/contrib/browserView/electron-browser/tools/navigateBrowserTool.ts Routes navigation actions through session-scoped Playwright invocations.
src/vs/workbench/contrib/browserView/electron-browser/tools/hoverElementTool.ts Routes hover action through session-scoped Playwright invocations.
src/vs/workbench/contrib/browserView/electron-browser/tools/handleDialogBrowserTool.ts Routes dialog/file chooser replies through session-scoped Playwright calls.
src/vs/workbench/contrib/browserView/electron-browser/tools/dragElementTool.ts Routes drag-and-drop through session-scoped Playwright invocations.
src/vs/workbench/contrib/browserView/electron-browser/tools/clickBrowserTool.ts Routes click/double-click through session-scoped Playwright invocations.
src/vs/workbench/contrib/browserView/electron-browser/tools/browserTools.contribution.ts Disposes Playwright sessions when chat sessions are disposed.
src/vs/workbench/contrib/browserView/electron-browser/tools/browserToolHelpers.ts Adds getSessionId helper; updates Playwright helper invocations to accept session ID.
src/vs/workbench/contrib/browserView/common/browserView.ts Ensures tracked-pages set stays in sync by stopping tracking before view destruction.
src/vs/sessions/contrib/browserView/browser/sessionBrowserView.ts Updates browser view lifecycle tracking for the Sessions window based on browserView service events.
src/vs/platform/browserView/node/playwrightService.ts Major refactor: introduces per-session Playwright sessions, global page tracking replay, and inactivity disposal.
src/vs/platform/browserView/common/playwrightService.ts Updates IPlaywrightService API to require session IDs and adds disposeSession.
src/vs/platform/browserView/common/browserView.ts Extends IBrowserViewOwner with optional sessionId for attribution.

Copilot's findings

Comments suppressed due to low confidence (2)

src/vs/platform/browserView/node/playwrightService.ts:208

  • startTrackingPage is async but does not await the per-session group.addView calls. That means callers cannot rely on the page being present in all session groups when the promise resolves, and any rejection from addView can become unhandled. Suggest awaiting the operations (e.g. await Promise.all(...)) or explicitly handling errors for each session.
	async startTrackingPage(viewId: string): Promise<void> {
		// Update the canonical set directly so tracking works even when
		// no sessions exist yet. The Set makes the double-add from
		// the group's onDidAddView listener harmless.
		if (!this._trackedPages.has(viewId)) {
			this._trackedPages.add(viewId);
			this._fireTrackedPages();
		}
		for (const session of this._sessions.values()) {
			session.group.addView(viewId);
		}

src/vs/platform/browserView/node/playwrightService.ts:217

  • stopTrackingPage is async but does not await group.removeView for each session. Similar to startTrackingPage, this makes the returned promise resolve before groups are actually updated and can lead to unhandled rejections if removeView fails. Consider awaiting the removals (or explicitly handling failures) so the method's Promise<void> accurately reflects completion.
	async stopTrackingPage(viewId: string): Promise<void> {
		if (this._trackedPages.delete(viewId)) {
			this._fireTrackedPages();
		}
		for (const session of this._sessions.values()) {
			session.group.removeView(viewId);
		}
  • Files reviewed: 17/17 changed files
  • Comments generated: 4

Comment thread src/vs/workbench/contrib/browserView/electron-browser/tools/browserToolHelpers.ts Outdated
Comment thread src/vs/sessions/contrib/browserView/browser/sessionBrowserView.ts Outdated
Comment thread src/vs/platform/browserView/node/playwrightService.ts Outdated
@kycutler kycutler marked this pull request as ready for review May 4, 2026 15:50
@vs-code-engineering
Copy link
Copy Markdown
Contributor

📬 CODENOTIFY

The following users are being notified based on files changed in this PR:

@jruales

Matched files:

  • src/vs/platform/browserView/common/browserView.ts
  • src/vs/platform/browserView/common/playwrightService.ts
  • src/vs/platform/browserView/node/playwrightService.ts
  • src/vs/workbench/contrib/browserView/common/browserView.ts
  • src/vs/workbench/contrib/browserView/electron-browser/tools/browserToolHelpers.ts
  • src/vs/workbench/contrib/browserView/electron-browser/tools/browserTools.contribution.ts
  • src/vs/workbench/contrib/browserView/electron-browser/tools/clickBrowserTool.ts
  • src/vs/workbench/contrib/browserView/electron-browser/tools/dragElementTool.ts
  • src/vs/workbench/contrib/browserView/electron-browser/tools/handleDialogBrowserTool.ts
  • src/vs/workbench/contrib/browserView/electron-browser/tools/hoverElementTool.ts
  • src/vs/workbench/contrib/browserView/electron-browser/tools/navigateBrowserTool.ts
  • src/vs/workbench/contrib/browserView/electron-browser/tools/openBrowserTool.ts
  • src/vs/workbench/contrib/browserView/electron-browser/tools/readBrowserTool.ts
  • src/vs/workbench/contrib/browserView/electron-browser/tools/runPlaywrightCodeTool.ts
  • src/vs/workbench/contrib/browserView/electron-browser/tools/screenshotBrowserTool.ts
  • src/vs/workbench/contrib/browserView/electron-browser/tools/typeBrowserTool.ts

@kycutler kycutler merged commit 64bb671 into main May 4, 2026
26 checks passed
@kycutler kycutler deleted the kycutler/pwpersession branch May 4, 2026 16:36
@vs-code-engineering vs-code-engineering Bot added this to the 1.120.0 milestone May 4, 2026
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment

Labels

None yet

Projects

None yet

Development

Successfully merging this pull request may close these issues.

3 participants