playwright: enable trace viewer on CI #17641
ci.yml
on: pull_request
fast_tests_matrix_prep
0s
slow_tests_matrix_prep
0s
build
2m 4s
Matrix: test-integration
Matrix: test-unit
Matrix: test-e2e
Annotations
6 errors, 11 warnings, and 5 notices
command-edit.test.ts:39:3 › edit (fixup) task:
vscode/test/e2e/command-edit.test.ts#L111
1) command-edit.test.ts:39:3 › edit (fixup) task ─────────────────────────────────────────────────
Error: Timed out 5000ms waiting for expect(locator).toBeVisible()
Locator: getByText('>Goodbye FAIL Cody</')
Expected: visible
Received: <element(s) not found>
Call log:
- expect.toBeVisible with timeout 5000ms
- waiting for getByText('>Goodbye FAIL Cody</')
109 | await page.keyboard.press('Enter')
110 | await expect(page.getByText('>Hello Cody</')).not.toBeVisible()
> 111 | await expect(page.getByText('>Goodbye FAIL Cody</')).toBeVisible()
| ^
112 |
113 | // Retry: show the command palette with the previous instruction
114 | await expect(retryLens).toBeVisible()
at /home/runner/work/cody/cody/vscode/test/e2e/command-edit.test.ts:111:58
|
command-edit.test.ts:39:3 › edit (fixup) task:
vscode/test/e2e/command-edit.test.ts#L111
1) command-edit.test.ts:39:3 › edit (fixup) task ─────────────────────────────────────────────────
Retry #1 ───────────────────────────────────────────────────────────────────────────────────────
Error: Timed out 5000ms waiting for expect(locator).toBeVisible()
Locator: getByText('>Goodbye FAIL Cody</')
Expected: visible
Received: <element(s) not found>
Call log:
- expect.toBeVisible with timeout 5000ms
- waiting for getByText('>Goodbye FAIL Cody</')
109 | await page.keyboard.press('Enter')
110 | await expect(page.getByText('>Hello Cody</')).not.toBeVisible()
> 111 | await expect(page.getByText('>Goodbye FAIL Cody</')).toBeVisible()
| ^
112 |
113 | // Retry: show the command palette with the previous instruction
114 | await expect(retryLens).toBeVisible()
at /home/runner/work/cody/cody/vscode/test/e2e/command-edit.test.ts:111:58
|
command-edit.test.ts:126:1 › edit (fixup) input - range selection:
vscode/test/e2e/common.ts#L58
2) command-edit.test.ts:126:1 › edit (fixup) input - range selection ─────────────────────────────
Error: Timed out 5000ms waiting for expect(locator).toBeVisible()
Locator: getByText('Chat alongside your code, attach files,')
Expected: visible
Received: <element(s) not found>
Call log:
- expect.toBeVisible with timeout 5000ms
- waiting for getByText('Chat alongside your code, attach files,')
at common.ts:58
56 | export async function expectAuthenticated(page: Page) {
57 | await focusSidebar(page)
> 58 | await expect(page.getByText('Chat alongside your code, attach files,')).toBeVisible()
| ^
59 | }
60 |
61 | // Selector for the Explorer button in the sidebar that would match on Mac and Linux
at expectAuthenticated (/home/runner/work/cody/cody/vscode/test/e2e/common.ts:58:77)
at sidebarSignin (/home/runner/work/cody/cody/vscode/test/e2e/common.ts:32:5)
at /home/runner/work/cody/cody/vscode/test/e2e/command-edit.test.ts:128:5
|
command-edit.test.ts:164:1 › edit (fixup) input - model selection:
vscode/test/e2e/command-edit.test.ts#L180
3) command-edit.test.ts:164:1 › edit (fixup) input - model selection ─────────────────────────────
Error: expect.toBeVisible: Error: strict mode violation: getByText('Claude 3 Sonnet') resolved to 2 elements:
1) <span class="monaco-highlighted-label">…</span> aka getByLabel('check anthropic-logo Claude 3').locator('a')
2) <span class="monaco-highlighted-label">…</span> aka getByLabel('$(anthropic-logo) Claude 3').locator('a')
Call log:
- expect.toBeVisible with timeout 5000ms
- waiting for getByText('Claude 3 Sonnet')
178 | const modelItem = page.getByText('Claude 3 Sonnet')
179 | await nap()
> 180 | expect(modelItem).toBeVisible()
| ^
181 |
182 | // Open the model input and check it has the correct item selected
183 | await modelItem.click()
at /home/runner/work/cody/cody/vscode/test/e2e/command-edit.test.ts:180:23
|
initial-context.test.ts:64:82 › chat try-again actions:
vscode/test/e2e/common.ts#L58
4) initial-context.test.ts:64:82 › chat try-again actions ────────────────────────────────────────
Error: Timed out 5000ms waiting for expect(locator).toBeVisible()
Locator: getByText('Chat alongside your code, attach files,')
Expected: visible
Received: <element(s) not found>
Call log:
- expect.toBeVisible with timeout 5000ms
- waiting for getByText('Chat alongside your code, attach files,')
at common.ts:58
56 | export async function expectAuthenticated(page: Page) {
57 | await focusSidebar(page)
> 58 | await expect(page.getByText('Chat alongside your code, attach files,')).toBeVisible()
| ^
59 | }
60 |
61 | // Selector for the Explorer button in the sidebar that would match on Mac and Linux
at expectAuthenticated (/home/runner/work/cody/cody/vscode/test/e2e/common.ts:58:77)
at sidebarSignin (/home/runner/work/cody/cody/vscode/test/e2e/common.ts:32:5)
at /home/runner/work/cody/cody/vscode/test/e2e/initial-context.test.ts:67:9
|
test-e2e (ubuntu, 4/5)
Process completed with exit code 1.
|
Slow Test:
vscode/update-notice.test.ts#L1
vscode/update-notice.test.ts took 21.9s
|
Slow Test:
vscode/support-menu-items.test.ts#L1
vscode/support-menu-items.test.ts took 17.6s
|
Slow Test:
vscode/chat-atFile.test.ts#L1
vscode/chat-atFile.test.ts took 1.1m
|
Slow Test:
vscode/attribution.test.ts#L1
vscode/attribution.test.ts took 21.1s
|
Slow Test:
vscode/chat-input.test.ts#L1
vscode/chat-input.test.ts took 51.7s
|
Slow Test:
vscode/chat-rateLimit.test.ts#L1
vscode/chat-rateLimit.test.ts took 30.9s
|
Slow Test:
vscode/code-actions.test.ts#L1
vscode/code-actions.test.ts took 29.4s
|
Slow Test:
vscode/chat-keyboard-shortcuts.test.ts#L1
vscode/chat-keyboard-shortcuts.test.ts took 16.3s
|
Slow Test:
vscode/command-custom.test.ts#L1
vscode/command-custom.test.ts took 53.7s
|
Slow Test:
vscode/command-core.test.ts#L1
vscode/command-core.test.ts took 40.4s
|
Slow Test:
vscode/cody-ignore.test.ts#L1
vscode/cody-ignore.test.ts took 15.2s
|
🎭 Playwright Run Summary
2 skipped
5 passed (55.9s)
|
🎭 Playwright Run Summary
10 passed (2.1m)
|
🎭 Playwright Run Summary
11 passed (2.4m)
|
🎭 Playwright Run Summary
9 passed (2.1m)
|
🎭 Playwright Run Summary
1 failed
command-edit.test.ts:39:3 › edit (fixup) task ──────────────────────────────────────────────────
3 flaky
command-edit.test.ts:126:1 › edit (fixup) input - range selection ──────────────────────────────
command-edit.test.ts:164:1 › edit (fixup) input - model selection ──────────────────────────────
initial-context.test.ts:64:82 › chat try-again actions ─────────────────────────────────────────
1 skipped
5 passed (3.0m)
|
Artifacts
Produced during runtime
Name | Size | |
---|---|---|
playwright-recordings ubuntu
Expired
|
2.39 MB |
|