Skip to content

chore: make tests OS agnostic #1269

chore: make tests OS agnostic

chore: make tests OS agnostic #1269

Triggered via pull request May 20, 2024 20:28
Status Failure
Total duration 14m 3s
Artifacts

tests.yml

on: pull_request
API Tests
36s
API Tests
Matrix: E2E Tests
Fit to window
Zoom out
Zoom in

Annotations

28 errors, 54 warnings, and 27 notices
[webkit] › async-validation.spec.ts:138:6 › With JS › Client Validation: tests/integration/async-validation.spec.ts#L118
1) [webkit] › async-validation.spec.ts:138:6 › With JS › Client Validation ─────────────────────── Error: Timed out 5000ms waiting for expect(locator).toHaveText(expected) Locator: locator('body').locator('main p') - Expected - 1 + Received + 1 Array [ "Email is already used", - "", + "Title is required", ] Call log: - expect.toHaveText with timeout 5000ms - waiting for locator('body').locator('main p') - locator resolved to 2 elements - locator resolved to 2 elements - locator resolved to 2 elements - locator resolved to 2 elements - locator resolved to 2 elements - locator resolved to 2 elements - locator resolved to 2 elements - locator resolved to 2 elements - locator resolved to 2 elements 116 | } 117 | > 118 | await expect(playground.error).toHaveText(['Email is already used', '']); | ^ 119 | 120 | await selectAll(fieldset.email); 121 | await fieldset.email.press('ArrowRight'); at runTest (/home/runner/work/conform/conform/tests/integration/async-validation.spec.ts:118:33) at /home/runner/work/conform/conform/tests/integration/async-validation.spec.ts:140:3
[firefox] › async-validation.spec.ts:148:6 › With JS › Form reset: tests/integration/async-validation.spec.ts#L170
1) [firefox] › async-validation.spec.ts:148:6 › With JS › Form reset ───────────────────────────── Error: Timed out 5000ms waiting for expect(locator).toHaveText(expected) Locator: locator('body').locator('main p') - Expected - 1 + Received + 1 Array [ - "", + "Email is already used", "", ] Call log: - expect.toHaveText with timeout 5000ms - waiting for locator('body').locator('main p') - locator resolved to 2 elements - locator resolved to 2 elements - locator resolved to 2 elements - locator resolved to 2 elements - locator resolved to 2 elements - locator resolved to 2 elements - locator resolved to 2 elements - locator resolved to 2 elements - locator resolved to 2 elements 168 | 169 | await playground.reset.click(); > 170 | await expect(playground.error).toHaveText(['', '']); | ^ 171 | }); 172 | }); 173 | at /home/runner/work/conform/conform/tests/integration/async-validation.spec.ts:170:34
[firefox] › async-validation.spec.ts:138:6 › With JS › Client Validation: tests\integration\async-validation.spec.ts#L1
1) [firefox] › async-validation.spec.ts:138:6 › With JS › Client Validation ────────────────────── Test timeout of 30000ms exceeded.
[firefox] › async-validation.spec.ts:138:6 › With JS › Client Validation: tests\integration\async-validation.spec.ts#L121
1) [firefox] › async-validation.spec.ts:138:6 › With JS › Client Validation ────────────────────── Error: locator.press: Test timeout of 30000ms exceeded. Call log: - waiting for locator('body').locator('[name="email"]') 119 | 120 | await selectAll(fieldset.email); > 121 | await fieldset.email.press('ArrowRight'); | ^ 122 | await fieldset.email.type('e'); 123 | await playground.submit.click(); 124 | at runTest (D:\a\conform\conform\tests\integration\async-validation.spec.ts:121:23) at D:\a\conform\conform\tests\integration\async-validation.spec.ts:140:3
[webkit] › conform-validitystate.spec.ts:462:6 › With JS › color input: tests\integration\conform-validitystate.spec.ts#L472
1) [webkit] › conform-validitystate.spec.ts:462:6 › With JS › color input ──────────────────────── Error: Timed out 5000ms waiting for expect(locator).toHaveText(expected) Locator: locator('body').locator('main p') - Expected - 3 + Received + 1 - Array [ - "", - ] + Array [] Call log: - expect.toHaveText with timeout 5000ms - waiting for locator('body').locator('main p') - locator resolved to 0 elements - locator resolved to 0 elements - locator resolved to 0 elements - locator resolved to 0 elements - locator resolved to 0 elements - locator resolved to 0 elements - locator resolved to 0 elements - locator resolved to 0 elements 470 | 471 | await submit.click(); > 472 | await expect(error).toHaveText(['']); | ^ 473 | 474 | // color input will always have a default value 475 | at D:\a\conform\conform\tests\integration\conform-validitystate.spec.ts:472:23
[webkit] › conform-validitystate.spec.ts:462:6 › With JS › color input: tests\integration\conform-validitystate.spec.ts#L472
1) [webkit] › conform-validitystate.spec.ts:462:6 › With JS › color input ──────────────────────── Retry #1 ─────────────────────────────────────────────────────────────────────────────────────── Error: Timed out 5000ms waiting for expect(locator).toHaveText(expected) Locator: locator('body').locator('main p') - Expected - 3 + Received + 1 - Array [ - "", - ] + Array [] Call log: - expect.toHaveText with timeout 5000ms - waiting for locator('body').locator('main p') - locator resolved to 0 elements - locator resolved to 0 elements - locator resolved to 0 elements - locator resolved to 0 elements - locator resolved to 0 elements - locator resolved to 0 elements - locator resolved to 0 elements - locator resolved to 0 elements - locator resolved to 0 elements 470 | 471 | await submit.click(); > 472 | await expect(error).toHaveText(['']); | ^ 473 | 474 | // color input will always have a default value 475 | at D:\a\conform\conform\tests\integration\conform-validitystate.spec.ts:472:23
[webkit] › conform-validitystate.spec.ts:462:6 › With JS › color input: tests\integration\conform-validitystate.spec.ts#L472
1) [webkit] › conform-validitystate.spec.ts:462:6 › With JS › color input ──────────────────────── Retry #2 ─────────────────────────────────────────────────────────────────────────────────────── Error: Timed out 5000ms waiting for expect(locator).toHaveText(expected) Locator: locator('body').locator('main p') - Expected - 3 + Received + 1 - Array [ - "", - ] + Array [] Call log: - expect.toHaveText with timeout 5000ms - waiting for locator('body').locator('main p') - locator resolved to 0 elements - locator resolved to 0 elements - locator resolved to 0 elements - locator resolved to 0 elements - locator resolved to 0 elements - locator resolved to 0 elements - locator resolved to 0 elements - locator resolved to 0 elements - locator resolved to 0 elements 470 | 471 | await submit.click(); > 472 | await expect(error).toHaveText(['']); | ^ 473 | 474 | // color input will always have a default value 475 | at D:\a\conform\conform\tests\integration\conform-validitystate.spec.ts:472:23
[webkit] › conform-validitystate.spec.ts:462:6 › No JS › color input: tests\integration\conform-validitystate.spec.ts#L472
2) [webkit] › conform-validitystate.spec.ts:462:6 › No JS › color input ────────────────────────── Error: Timed out 5000ms waiting for expect(locator).toHaveText(expected) Locator: locator('body').locator('main p') - Expected - 3 + Received + 1 - Array [ - "", - ] + Array [] Call log: - expect.toHaveText with timeout 5000ms - waiting for locator('body').locator('main p') - locator resolved to 0 elements - locator resolved to 0 elements - locator resolved to 0 elements - locator resolved to 0 elements - locator resolved to 0 elements - locator resolved to 0 elements - locator resolved to 0 elements - locator resolved to 0 elements - locator resolved to 0 elements 470 | 471 | await submit.click(); > 472 | await expect(error).toHaveText(['']); | ^ 473 | 474 | // color input will always have a default value 475 | at D:\a\conform\conform\tests\integration\conform-validitystate.spec.ts:472:23
[webkit] › conform-validitystate.spec.ts:462:6 › No JS › color input: tests\integration\conform-validitystate.spec.ts#L472
2) [webkit] › conform-validitystate.spec.ts:462:6 › No JS › color input ────────────────────────── Retry #1 ─────────────────────────────────────────────────────────────────────────────────────── Error: Timed out 5000ms waiting for expect(locator).toHaveText(expected) Locator: locator('body').locator('main p') - Expected - 3 + Received + 1 - Array [ - "", - ] + Array [] Call log: - expect.toHaveText with timeout 5000ms - waiting for locator('body').locator('main p') - locator resolved to 0 elements - locator resolved to 0 elements - locator resolved to 0 elements - locator resolved to 0 elements - locator resolved to 0 elements - locator resolved to 0 elements - locator resolved to 0 elements - locator resolved to 0 elements 470 | 471 | await submit.click(); > 472 | await expect(error).toHaveText(['']); | ^ 473 | 474 | // color input will always have a default value 475 | at D:\a\conform\conform\tests\integration\conform-validitystate.spec.ts:472:23
[webkit] › conform-validitystate.spec.ts:462:6 › No JS › color input: tests\integration\conform-validitystate.spec.ts#L472
2) [webkit] › conform-validitystate.spec.ts:462:6 › No JS › color input ────────────────────────── Retry #2 ─────────────────────────────────────────────────────────────────────────────────────── Error: Timed out 5000ms waiting for expect(locator).toHaveText(expected) Locator: locator('body').locator('main p') - Expected - 3 + Received + 1 - Array [ - "", - ] + Array [] Call log: - expect.toHaveText with timeout 5000ms - waiting for locator('body').locator('main p') - locator resolved to 0 elements - locator resolved to 0 elements - locator resolved to 0 elements - locator resolved to 0 elements - locator resolved to 0 elements - locator resolved to 0 elements - locator resolved to 0 elements - locator resolved to 0 elements - locator resolved to 0 elements 470 | 471 | await submit.click(); > 472 | await expect(error).toHaveText(['']); | ^ 473 | 474 | // color input will always have a default value 475 | at D:\a\conform\conform\tests\integration\conform-validitystate.spec.ts:472:23
E2E Tests (windows-latest, webkit, 18)
Process completed with exit code 1.
[webkit] › conform-validitystate.spec.ts:462:6 › With JS › color input: tests\integration\conform-validitystate.spec.ts#L472
1) [webkit] › conform-validitystate.spec.ts:462:6 › With JS › color input ──────────────────────── Error: Timed out 5000ms waiting for expect(locator).toHaveText(expected) Locator: locator('body').locator('main p') - Expected - 3 + Received + 1 - Array [ - "", - ] + Array [] Call log: - expect.toHaveText with timeout 5000ms - waiting for locator('body').locator('main p') - locator resolved to 0 elements - locator resolved to 0 elements - locator resolved to 0 elements - locator resolved to 0 elements - locator resolved to 0 elements - locator resolved to 0 elements - locator resolved to 0 elements - locator resolved to 0 elements 470 | 471 | await submit.click(); > 472 | await expect(error).toHaveText(['']); | ^ 473 | 474 | // color input will always have a default value 475 | at D:\a\conform\conform\tests\integration\conform-validitystate.spec.ts:472:23
[webkit] › conform-validitystate.spec.ts:462:6 › With JS › color input: tests\integration\conform-validitystate.spec.ts#L472
1) [webkit] › conform-validitystate.spec.ts:462:6 › With JS › color input ──────────────────────── Retry #1 ─────────────────────────────────────────────────────────────────────────────────────── Error: Timed out 5000ms waiting for expect(locator).toHaveText(expected) Locator: locator('body').locator('main p') - Expected - 3 + Received + 1 - Array [ - "", - ] + Array [] Call log: - expect.toHaveText with timeout 5000ms - waiting for locator('body').locator('main p') - locator resolved to 0 elements - locator resolved to 0 elements - locator resolved to 0 elements - locator resolved to 0 elements - locator resolved to 0 elements - locator resolved to 0 elements - locator resolved to 0 elements - locator resolved to 0 elements 470 | 471 | await submit.click(); > 472 | await expect(error).toHaveText(['']); | ^ 473 | 474 | // color input will always have a default value 475 | at D:\a\conform\conform\tests\integration\conform-validitystate.spec.ts:472:23
[webkit] › conform-validitystate.spec.ts:462:6 › With JS › color input: tests\integration\conform-validitystate.spec.ts#L472
1) [webkit] › conform-validitystate.spec.ts:462:6 › With JS › color input ──────────────────────── Retry #2 ─────────────────────────────────────────────────────────────────────────────────────── Error: Timed out 5000ms waiting for expect(locator).toHaveText(expected) Locator: locator('body').locator('main p') - Expected - 3 + Received + 1 - Array [ - "", - ] + Array [] Call log: - expect.toHaveText with timeout 5000ms - waiting for locator('body').locator('main p') - locator resolved to 0 elements - locator resolved to 0 elements - locator resolved to 0 elements - locator resolved to 0 elements - locator resolved to 0 elements - locator resolved to 0 elements - locator resolved to 0 elements - locator resolved to 0 elements - locator resolved to 0 elements 470 | 471 | await submit.click(); > 472 | await expect(error).toHaveText(['']); | ^ 473 | 474 | // color input will always have a default value 475 | at D:\a\conform\conform\tests\integration\conform-validitystate.spec.ts:472:23
[webkit] › conform-validitystate.spec.ts:462:6 › No JS › color input: tests\integration\conform-validitystate.spec.ts#L472
2) [webkit] › conform-validitystate.spec.ts:462:6 › No JS › color input ────────────────────────── Error: Timed out 5000ms waiting for expect(locator).toHaveText(expected) Locator: locator('body').locator('main p') - Expected - 3 + Received + 1 - Array [ - "", - ] + Array [] Call log: - expect.toHaveText with timeout 5000ms - waiting for locator('body').locator('main p') - locator resolved to 0 elements - locator resolved to 0 elements - locator resolved to 0 elements - locator resolved to 0 elements - locator resolved to 0 elements - locator resolved to 0 elements - locator resolved to 0 elements - locator resolved to 0 elements - locator resolved to 0 elements 470 | 471 | await submit.click(); > 472 | await expect(error).toHaveText(['']); | ^ 473 | 474 | // color input will always have a default value 475 | at D:\a\conform\conform\tests\integration\conform-validitystate.spec.ts:472:23
[webkit] › conform-validitystate.spec.ts:462:6 › No JS › color input: tests\integration\conform-validitystate.spec.ts#L472
2) [webkit] › conform-validitystate.spec.ts:462:6 › No JS › color input ────────────────────────── Retry #1 ─────────────────────────────────────────────────────────────────────────────────────── Error: Timed out 5000ms waiting for expect(locator).toHaveText(expected) Locator: locator('body').locator('main p') - Expected - 3 + Received + 1 - Array [ - "", - ] + Array [] Call log: - expect.toHaveText with timeout 5000ms - waiting for locator('body').locator('main p') - locator resolved to 0 elements - locator resolved to 0 elements - locator resolved to 0 elements - locator resolved to 0 elements - locator resolved to 0 elements - locator resolved to 0 elements - locator resolved to 0 elements - locator resolved to 0 elements 470 | 471 | await submit.click(); > 472 | await expect(error).toHaveText(['']); | ^ 473 | 474 | // color input will always have a default value 475 | at D:\a\conform\conform\tests\integration\conform-validitystate.spec.ts:472:23
[webkit] › conform-validitystate.spec.ts:462:6 › No JS › color input: tests\integration\conform-validitystate.spec.ts#L472
2) [webkit] › conform-validitystate.spec.ts:462:6 › No JS › color input ────────────────────────── Retry #2 ─────────────────────────────────────────────────────────────────────────────────────── Error: Timed out 5000ms waiting for expect(locator).toHaveText(expected) Locator: locator('body').locator('main p') - Expected - 3 + Received + 1 - Array [ - "", - ] + Array [] Call log: - expect.toHaveText with timeout 5000ms - waiting for locator('body').locator('main p') - locator resolved to 0 elements - locator resolved to 0 elements - locator resolved to 0 elements - locator resolved to 0 elements - locator resolved to 0 elements - locator resolved to 0 elements - locator resolved to 0 elements - locator resolved to 0 elements - locator resolved to 0 elements 470 | 471 | await submit.click(); > 472 | await expect(error).toHaveText(['']); | ^ 473 | 474 | // color input will always have a default value 475 | at D:\a\conform\conform\tests\integration\conform-validitystate.spec.ts:472:23
[webkit] › subscription.spec.ts:292:6 › Subscription › Client Validation: tests\integration\subscription.spec.ts#L51
3) [webkit] › subscription.spec.ts:292:6 › Subscription › Client Validation ────────────────────── Error: Timed out 5000ms waiting for expect(locator).toHaveText(expected) Locator: locator('body').locator('li') - Expected - 26 + Received + 26 Array [ - "form.id: 1", - "form.errorId: 1", - "form.descriptionId: 1", - "form.initialValue: 1", + "form.id: 2", + "form.errorId: 2", + "form.descriptionId: 2", + "form.initialValue: 2", "form.value: 7", - "form.key: 1", + "form.key: 2", "form.dirty: 2", - "form.valid: 1", - "form.errors: 1", - "form.allErrors: 1", - "name.id: 1", - "name.formId: 1", - "name.errorId: 1", - "name.descriptionId: 1", - "name.initialValue: 1", + "form.valid: 2", + "form.errors: 2", + "form.allErrors: 2", + "name.id: 2", + "name.formId: 2", + "name.errorId: 2", + "name.descriptionId: 2", + "name.initialValue: 2", "name.value: 7", - "name.key: 1", + "name.key: 2", "name.dirty: 2", - "name.valid: 1", - "name.errors: 1", - "message.id: 1", - "message.formId: 1", - "message.errorId: 1", - "message.descriptionId: 1", - "message.initialValue: 1", - "message.value: 1", - "message.key: 1", - "message.dirty: 1", - "message.valid: 1", - "message.errors: 1", + "name.valid: 2", + "name.errors: 2", + "message.id: 2", + "message.formId: 2", + "message.errorId: 2", + "message.descriptionId: 2", + "message.initialValue: 2", + "message.value: 2", + "message.key: 2", + "message.dirty: 2", + "message.valid: 2", + "message.errors: 2", ] Call log: - expect.toHaveText with timeout 5000ms - waiting for locator('body').locator('li') - locator resolved to 30 elements - locator resolved to 30 elements - locator resolved to 30 elements - locator resolved to 30 elements - locator resolved to 30 elements - locator resolved to 30 elements - locator resolved to 30 elements - locator resolved to 30 elements - locator resolved to 30 elements 49 | 50 | await fieldset.name.pressSequentially('Edmund'); > 51 | await expect(fieldset.logs).toHaveText([ | ^ 52 | 'form.id: 1', 53 | 'form.errorId: 1', 54 | 'form.descriptionId: 1', at runTest (D:\a\conform\conform\tests\integration\subscription.spec.ts:51:30) at D:\a\conform\conform\tests\integration\subscription.spec.ts:294:3
[webkit] › subscription.spec.ts:297:6 › Subscription › Server Validation: tests\integration\subscription.spec.ts#L51
4) [webkit] › subscription.spec.ts:297:6 › Subscription › Server Validation ────────────────────── Error: Timed out 5000ms waiting for expect(locator).toHaveText(expected) Locator: locator('body').locator('li') - Expected - 26 + Received + 26 Array [ - "form.id: 1", - "form.errorId: 1", - "form.descriptionId: 1", - "form.initialValue: 1", + "form.id: 2", + "form.errorId: 2", + "form.descriptionId: 2", + "form.initialValue: 2", "form.value: 7", - "form.key: 1", + "form.key: 2", "form.dirty: 2", - "form.valid: 1", - "form.errors: 1", - "form.allErrors: 1", - "name.id: 1", - "name.formId: 1", - "name.errorId: 1", - "name.descriptionId: 1", - "name.initialValue: 1", + "form.valid: 2", + "form.errors: 2", + "form.allErrors: 2", + "name.id: 2", + "name.formId: 2", + "name.errorId: 2", + "name.descriptionId: 2", + "name.initialValue: 2", "name.value: 7", - "name.key: 1", + "name.key: 2", "name.dirty: 2", - "name.valid: 1", - "name.errors: 1", - "message.id: 1", - "message.formId: 1", - "message.errorId: 1", - "message.descriptionId: 1", - "message.initialValue: 1", - "message.value: 1", - "message.key: 1", - "message.dirty: 1", - "message.valid: 1", - "message.errors: 1", + "name.valid: 2", + "name.errors: 2", + "message.id: 2", + "message.formId: 2", + "message.errorId: 2", + "message.descriptionId: 2", + "message.initialValue: 2", + "message.value: 2", + "message.key: 2", + "message.dirty: 2", + "message.valid: 2", + "message.errors: 2", ] Call log: - expect.toHaveText with timeout 5000ms - waiting for locator('body').locator('li') - locator resolved to 30 elements - locator resolved to 30 elements - locator resolved to 30 elements - locator resolved to 30 elements - locator resolved to 30 elements - locator resolved to 30 elements - locator resolved to 30 elements - locator resolved to 30 elements - locator resolved to 30 elements 49 | 50 | await fieldset.name.pressSequentially('Edmund'); > 51 | await expect(fieldset.logs).toHaveText([ | ^ 52 | 'form.id: 1', 53 | 'form.errorId: 1', 54 | 'form.descriptionId: 1', at runTest (D:\a\conform\conform\tests\integration\subscription.spec.ts:51:30) at D:\a\conform\conform\tests\integration\subscription.spec.ts:299:3
E2E Tests (windows-latest, webkit, 20)
Process completed with exit code 1.
[webkit] › conform-validitystate.spec.ts:462:6 › With JS › color input: tests\integration\conform-validitystate.spec.ts#L472
1) [webkit] › conform-validitystate.spec.ts:462:6 › With JS › color input ──────────────────────── Error: Timed out 5000ms waiting for expect(locator).toHaveText(expected) Locator: locator('body').locator('main p') - Expected - 3 + Received + 1 - Array [ - "", - ] + Array [] Call log: - expect.toHaveText with timeout 5000ms - waiting for locator('body').locator('main p') - locator resolved to 0 elements - locator resolved to 0 elements - locator resolved to 0 elements - locator resolved to 0 elements - locator resolved to 0 elements - locator resolved to 0 elements - locator resolved to 0 elements - locator resolved to 0 elements 470 | 471 | await submit.click(); > 472 | await expect(error).toHaveText(['']); | ^ 473 | 474 | // color input will always have a default value 475 | at D:\a\conform\conform\tests\integration\conform-validitystate.spec.ts:472:23
[webkit] › conform-validitystate.spec.ts:462:6 › With JS › color input: tests\integration\conform-validitystate.spec.ts#L472
1) [webkit] › conform-validitystate.spec.ts:462:6 › With JS › color input ──────────────────────── Retry #1 ─────────────────────────────────────────────────────────────────────────────────────── Error: Timed out 5000ms waiting for expect(locator).toHaveText(expected) Locator: locator('body').locator('main p') - Expected - 3 + Received + 1 - Array [ - "", - ] + Array [] Call log: - expect.toHaveText with timeout 5000ms - waiting for locator('body').locator('main p') - locator resolved to 0 elements - locator resolved to 0 elements - locator resolved to 0 elements - locator resolved to 0 elements - locator resolved to 0 elements - locator resolved to 0 elements - locator resolved to 0 elements - locator resolved to 0 elements 470 | 471 | await submit.click(); > 472 | await expect(error).toHaveText(['']); | ^ 473 | 474 | // color input will always have a default value 475 | at D:\a\conform\conform\tests\integration\conform-validitystate.spec.ts:472:23
[webkit] › conform-validitystate.spec.ts:462:6 › With JS › color input: tests\integration\conform-validitystate.spec.ts#L472
1) [webkit] › conform-validitystate.spec.ts:462:6 › With JS › color input ──────────────────────── Retry #2 ─────────────────────────────────────────────────────────────────────────────────────── Error: Timed out 5000ms waiting for expect(locator).toHaveText(expected) Locator: locator('body').locator('main p') - Expected - 3 + Received + 1 - Array [ - "", - ] + Array [] Call log: - expect.toHaveText with timeout 5000ms - waiting for locator('body').locator('main p') - locator resolved to 0 elements - locator resolved to 0 elements - locator resolved to 0 elements - locator resolved to 0 elements - locator resolved to 0 elements - locator resolved to 0 elements - locator resolved to 0 elements - locator resolved to 0 elements - locator resolved to 0 elements 470 | 471 | await submit.click(); > 472 | await expect(error).toHaveText(['']); | ^ 473 | 474 | // color input will always have a default value 475 | at D:\a\conform\conform\tests\integration\conform-validitystate.spec.ts:472:23
[webkit] › conform-validitystate.spec.ts:462:6 › No JS › color input: tests\integration\conform-validitystate.spec.ts#L472
2) [webkit] › conform-validitystate.spec.ts:462:6 › No JS › color input ────────────────────────── Error: Timed out 5000ms waiting for expect(locator).toHaveText(expected) Locator: locator('body').locator('main p') - Expected - 3 + Received + 1 - Array [ - "", - ] + Array [] Call log: - expect.toHaveText with timeout 5000ms - waiting for locator('body').locator('main p') - locator resolved to 0 elements - locator resolved to 0 elements - locator resolved to 0 elements - locator resolved to 0 elements - locator resolved to 0 elements - locator resolved to 0 elements - locator resolved to 0 elements - locator resolved to 0 elements - locator resolved to 0 elements 470 | 471 | await submit.click(); > 472 | await expect(error).toHaveText(['']); | ^ 473 | 474 | // color input will always have a default value 475 | at D:\a\conform\conform\tests\integration\conform-validitystate.spec.ts:472:23
[webkit] › conform-validitystate.spec.ts:462:6 › No JS › color input: tests\integration\conform-validitystate.spec.ts#L472
2) [webkit] › conform-validitystate.spec.ts:462:6 › No JS › color input ────────────────────────── Retry #1 ─────────────────────────────────────────────────────────────────────────────────────── Error: Timed out 5000ms waiting for expect(locator).toHaveText(expected) Locator: locator('body').locator('main p') - Expected - 3 + Received + 1 - Array [ - "", - ] + Array [] Call log: - expect.toHaveText with timeout 5000ms - waiting for locator('body').locator('main p') - locator resolved to 0 elements - locator resolved to 0 elements - locator resolved to 0 elements - locator resolved to 0 elements - locator resolved to 0 elements - locator resolved to 0 elements - locator resolved to 0 elements - locator resolved to 0 elements - locator resolved to 0 elements 470 | 471 | await submit.click(); > 472 | await expect(error).toHaveText(['']); | ^ 473 | 474 | // color input will always have a default value 475 | at D:\a\conform\conform\tests\integration\conform-validitystate.spec.ts:472:23
[webkit] › conform-validitystate.spec.ts:462:6 › No JS › color input: tests\integration\conform-validitystate.spec.ts#L472
2) [webkit] › conform-validitystate.spec.ts:462:6 › No JS › color input ────────────────────────── Retry #2 ─────────────────────────────────────────────────────────────────────────────────────── Error: Timed out 5000ms waiting for expect(locator).toHaveText(expected) Locator: locator('body').locator('main p') - Expected - 3 + Received + 1 - Array [ - "", - ] + Array [] Call log: - expect.toHaveText with timeout 5000ms - waiting for locator('body').locator('main p') - locator resolved to 0 elements - locator resolved to 0 elements - locator resolved to 0 elements - locator resolved to 0 elements - locator resolved to 0 elements - locator resolved to 0 elements - locator resolved to 0 elements - locator resolved to 0 elements - locator resolved to 0 elements 470 | 471 | await submit.click(); > 472 | await expect(error).toHaveText(['']); | ^ 473 | 474 | // color input will always have a default value 475 | at D:\a\conform\conform\tests\integration\conform-validitystate.spec.ts:472:23
[webkit] › subscription.spec.ts:297:6 › Subscription › Server Validation: tests\integration\subscription.spec.ts#L51
3) [webkit] › subscription.spec.ts:297:6 › Subscription › Server Validation ────────────────────── Error: Timed out 5000ms waiting for expect(locator).toHaveText(expected) Locator: locator('body').locator('li') - Expected - 26 + Received + 26 Array [ - "form.id: 1", - "form.errorId: 1", - "form.descriptionId: 1", - "form.initialValue: 1", + "form.id: 2", + "form.errorId: 2", + "form.descriptionId: 2", + "form.initialValue: 2", "form.value: 7", - "form.key: 1", + "form.key: 2", "form.dirty: 2", - "form.valid: 1", - "form.errors: 1", - "form.allErrors: 1", - "name.id: 1", - "name.formId: 1", - "name.errorId: 1", - "name.descriptionId: 1", - "name.initialValue: 1", + "form.valid: 2", + "form.errors: 2", + "form.allErrors: 2", + "name.id: 2", + "name.formId: 2", + "name.errorId: 2", + "name.descriptionId: 2", + "name.initialValue: 2", "name.value: 7", - "name.key: 1", + "name.key: 2", "name.dirty: 2", - "name.valid: 1", - "name.errors: 1", - "message.id: 1", - "message.formId: 1", - "message.errorId: 1", - "message.descriptionId: 1", - "message.initialValue: 1", - "message.value: 1", - "message.key: 1", - "message.dirty: 1", - "message.valid: 1", - "message.errors: 1", + "name.valid: 2", + "name.errors: 2", + "message.id: 2", + "message.formId: 2", + "message.errorId: 2", + "message.descriptionId: 2", + "message.initialValue: 2", + "message.value: 2", + "message.key: 2", + "message.dirty: 2", + "message.valid: 2", + "message.errors: 2", ] Call log: - expect.toHaveText with timeout 5000ms - waiting for locator('body').locator('li') - locator resolved to 30 elements - locator resolved to 30 elements - locator resolved to 30 elements - locator resolved to 30 elements - locator resolved to 30 elements - locator resolved to 30 elements - locator resolved to 30 elements - locator resolved to 30 elements - locator resolved to 30 elements 49 | 50 | await fieldset.name.pressSequentially('Edmund'); > 51 | await expect(fieldset.logs).toHaveText([ | ^ 52 | 'form.id: 1', 53 | 'form.errorId: 1', 54 | 'form.descriptionId: 1', at runTest (D:\a\conform\conform\tests\integration\subscription.spec.ts:51:30) at D:\a\conform\conform\tests\integration\subscription.spec.ts:299:3
E2E Tests (windows-latest, webkit, 22)
Process completed with exit code 1.
🎭 Playwright Run Summary
9 skipped 100 passed (58.6s)
🎭 Playwright Run Summary
9 skipped 100 passed (48.3s)
🎭 Playwright Run Summary
9 skipped 100 passed (57.3s)
🎭 Playwright Run Summary
9 skipped 100 passed (54.9s)
🎭 Playwright Run Summary
9 skipped 100 passed (1.7m)
🎭 Playwright Run Summary
1 flaky [webkit] › async-validation.spec.ts:138:6 › With JS › Client Validation ──────────────────────── 9 skipped 99 passed (1.6m)
🎭 Playwright Run Summary
9 skipped 100 passed (1.6m)
🎭 Playwright Run Summary
9 skipped 100 passed (1.4m)
🎭 Playwright Run Summary
1 flaky [firefox] › async-validation.spec.ts:148:6 › With JS › Form reset ────────────────────────────── 9 skipped 99 passed (1.8m)
🎭 Playwright Run Summary
9 skipped 100 passed (53.0s)
🎭 Playwright Run Summary
9 skipped 100 passed (58.2s)
🎭 Playwright Run Summary
9 skipped 100 passed (1.1m)
🎭 Playwright Run Summary
9 skipped 100 passed (2.2m)
🎭 Playwright Run Summary
9 skipped 100 passed (1.4m)
🎭 Playwright Run Summary
9 skipped 100 passed (1.3m)
🎭 Playwright Run Summary
9 skipped 100 passed (2.5m)
🎭 Playwright Run Summary
9 skipped 100 passed (1.9m)
🎭 Playwright Run Summary
1 flaky [firefox] › async-validation.spec.ts:138:6 › With JS › Client Validation ─────────────────────── 9 skipped 99 passed (2.7m)
🎭 Playwright Run Summary
9 skipped 100 passed (1.4m)
🎭 Playwright Run Summary
9 skipped 100 passed (2.1m)
🎭 Playwright Run Summary
2 failed [webkit] › conform-validitystate.spec.ts:462:6 › With JS › color input ───────────────────────── [webkit] › conform-validitystate.spec.ts:462:6 › No JS › color input ─────────────────────────── 9 skipped 98 passed (4.1m)
🎭 Playwright Run Summary
2 failed [webkit] › conform-validitystate.spec.ts:462:6 › With JS › color input ───────────────────────── [webkit] › conform-validitystate.spec.ts:462:6 › No JS › color input ─────────────────────────── 2 flaky [webkit] › subscription.spec.ts:292:6 › Subscription › Client Validation ─────────────────────── [webkit] › subscription.spec.ts:297:6 › Subscription › Server Validation ─────────────────────── 9 skipped 96 passed (4.7m)
🎭 Playwright Run Summary
2 failed [webkit] › conform-validitystate.spec.ts:462:6 › With JS › color input ───────────────────────── [webkit] › conform-validitystate.spec.ts:462:6 › No JS › color input ─────────────────────────── 1 flaky [webkit] › subscription.spec.ts:297:6 › Subscription › Server Validation ─────────────────────── 9 skipped 97 passed (4.1m)
🎭 Playwright Run Summary
9 skipped 100 passed (9.9m)
🎭 Playwright Run Summary
9 skipped 100 passed (9.8m)
🎭 Playwright Run Summary
9 skipped 100 passed (10.0m)
🎭 Playwright Run Summary
9 skipped 100 passed (4.2m)
E2E Tests (ubuntu-latest, chromium, 18)
No files were found with the provided path: playwright-report/. No artifacts will be uploaded.
E2E Tests (macos-latest, chromium, 18)
No files were found with the provided path: playwright-report/. No artifacts will be uploaded.
E2E Tests (ubuntu-latest, chromium, 20)
No files were found with the provided path: playwright-report/. No artifacts will be uploaded.
E2E Tests (macos-latest, chromium, 20)
No files were found with the provided path: playwright-report/. No artifacts will be uploaded.
E2E Tests (ubuntu-latest, firefox, 18)
No files were found with the provided path: playwright-report/. No artifacts will be uploaded.
E2E Tests (ubuntu-latest, webkit, 18)
No files were found with the provided path: playwright-report/. No artifacts will be uploaded.
E2E Tests (ubuntu-latest, firefox, 22)
No files were found with the provided path: playwright-report/. No artifacts will be uploaded.
E2E Tests (ubuntu-latest, webkit, 20)
No files were found with the provided path: playwright-report/. No artifacts will be uploaded.
E2E Tests (ubuntu-latest, firefox, 20)
No files were found with the provided path: playwright-report/. No artifacts will be uploaded.
E2E Tests (ubuntu-latest, chromium, 22)
No files were found with the provided path: playwright-report/. No artifacts will be uploaded.
E2E Tests (macos-latest, chromium, 22)
No files were found with the provided path: playwright-report/. No artifacts will be uploaded.
E2E Tests (windows-latest, chromium, 22)
No files were found with the provided path: playwright-report/. No artifacts will be uploaded.
Slow Test: [firefox] › async-validation.spec.ts#L1
[firefox] › async-validation.spec.ts took 25.5s
E2E Tests (windows-latest, firefox, 18)
No files were found with the provided path: playwright-report/. No artifacts will be uploaded.
E2E Tests (ubuntu-latest, webkit, 22)
No files were found with the provided path: playwright-report/. No artifacts will be uploaded.
E2E Tests (windows-latest, chromium, 20)
No files were found with the provided path: playwright-report/. No artifacts will be uploaded.
E2E Tests (windows-latest, firefox, 20)
No files were found with the provided path: playwright-report/. No artifacts will be uploaded.
Slow Test: [firefox] › async-validation.spec.ts#L1
[firefox] › async-validation.spec.ts took 37.6s
E2E Tests (macos-latest, webkit, 18)
No files were found with the provided path: playwright-report/. No artifacts will be uploaded.
E2E Tests (windows-latest, firefox, 22)
No files were found with the provided path: playwright-report/. No artifacts will be uploaded.
Slow Test: [firefox] › custom-inputs.spec.ts#L1
[firefox] › custom-inputs.spec.ts took 15.5s
E2E Tests (windows-latest, chromium, 18)
No files were found with the provided path: playwright-report/. No artifacts will be uploaded.
E2E Tests (macos-latest, webkit, 22)
No files were found with the provided path: playwright-report/. No artifacts will be uploaded.
Slow Test: [webkit] › simple-list.spec.ts#L1
[webkit] › simple-list.spec.ts took 19.2s
Slow Test: [webkit] › custom-inputs.spec.ts#L1
[webkit] › custom-inputs.spec.ts took 15.8s
E2E Tests (windows-latest, webkit, 18)
No files were found with the provided path: playwright-report/. No artifacts will be uploaded.
Slow Test: [webkit] › simple-list.spec.ts#L1
[webkit] › simple-list.spec.ts took 21.6s
Slow Test: [webkit] › custom-inputs.spec.ts#L1
[webkit] › custom-inputs.spec.ts took 16.2s
E2E Tests (windows-latest, webkit, 20)
No files were found with the provided path: playwright-report/. No artifacts will be uploaded.
Slow Test: [webkit] › simple-list.spec.ts#L1
[webkit] › simple-list.spec.ts took 19.3s
Slow Test: [webkit] › custom-inputs.spec.ts#L1
[webkit] › custom-inputs.spec.ts took 15.7s
E2E Tests (windows-latest, webkit, 22)
No files were found with the provided path: playwright-report/. No artifacts will be uploaded.
Slow Test: [firefox] › simple-list.spec.ts#L1
[firefox] › simple-list.spec.ts took 38.2s
Slow Test: [firefox] › validation-flow.spec.ts#L1
[firefox] › validation-flow.spec.ts took 33.8s
Slow Test: [firefox] › input-event.spec.ts#L1
[firefox] › input-event.spec.ts took 32.7s
Slow Test: [firefox] › form-attributes.spec.ts#L1
[firefox] › form-attributes.spec.ts took 32.2s
Slow Test: [firefox] › input-attributes.spec.ts#L1
[firefox] › input-attributes.spec.ts took 28.0s
E2E Tests (macos-latest, firefox, 18)
No files were found with the provided path: playwright-report/. No artifacts will be uploaded.
E2E Tests (macos-latest, firefox, 22)
No files were found with the provided path: playwright-report/. No artifacts will be uploaded.
Slow Test: [firefox] › simple-list.spec.ts#L1
[firefox] › simple-list.spec.ts took 38.2s
Slow Test: [firefox] › validation-flow.spec.ts#L1
[firefox] › validation-flow.spec.ts took 33.8s
Slow Test: [firefox] › input-event.spec.ts#L1
[firefox] › input-event.spec.ts took 32.7s
Slow Test: [firefox] › form-attributes.spec.ts#L1
[firefox] › form-attributes.spec.ts took 32.1s
Slow Test: [firefox] › input-attributes.spec.ts#L1
[firefox] › input-attributes.spec.ts took 27.8s
E2E Tests (macos-latest, firefox, 20)
No files were found with the provided path: playwright-report/. No artifacts will be uploaded.
Slow Test: [firefox] › simple-list.spec.ts#L1
[firefox] › simple-list.spec.ts took 37.2s
Slow Test: [firefox] › validation-flow.spec.ts#L1
[firefox] › validation-flow.spec.ts took 33.1s
Slow Test: [firefox] › input-event.spec.ts#L1
[firefox] › input-event.spec.ts took 32.4s
Slow Test: [firefox] › form-attributes.spec.ts#L1
[firefox] › form-attributes.spec.ts took 32.4s
Slow Test: [firefox] › async-validation.spec.ts#L1
[firefox] › async-validation.spec.ts took 29.9s
E2E Tests (macos-latest, webkit, 20)
No files were found with the provided path: playwright-report/. No artifacts will be uploaded.
Slow Test: [webkit] › async-validation.spec.ts#L1
[webkit] › async-validation.spec.ts took 18.7s
Slow Test: [webkit] › simple-list.spec.ts#L1
[webkit] › simple-list.spec.ts took 17.6s
Slow Test: [webkit] › file-upload.spec.ts#L1
[webkit] › file-upload.spec.ts took 15.6s