Skip to content

test(producer): regenerate 8 stale regression baselines in Docker#1135

Merged
miguel-heygen merged 2 commits into
mainfrom
fix/regression-baseline-gsap-letters
May 30, 2026
Merged

test(producer): regenerate 8 stale regression baselines in Docker#1135
miguel-heygen merged 2 commits into
mainfrom
fix/regression-baseline-gsap-letters

Conversation

@miguel-heygen
Copy link
Copy Markdown
Collaborator

@miguel-heygen miguel-heygen commented May 30, 2026

Root cause

b2828e48 ("defer __renderReady until root timeline is bound", May 24) corrected a race where the renderer started seeking before the GSAP timeline was bound. Several baselines were generated before that fix and are now stale.

Full suite run (51 tests) revealed 7 additional stale baselines beyond gsap-letters-render-compat.

Stale baselines — failure counts before regen

Suite Failed frames Threshold
gsap-letters-render-compat 85 0
many-cuts 1 0
overlay-montage-prod 1 0
pip-video-late-host 29 5
spanish-empire-cdn-inline 74 0
style-18-prod 24 0
style-7-prod 50 0
typegpu-adapter 75 0

All 51 suites pass locally after this commit.

Regeneration

All baselines regenerated inside Docker with the pinned chrome-headless-shell@148.0.7778.167:

bun run --cwd packages/producer docker:test:update <suite-name>

b2828e4 deferred __renderReady until the root timeline is bound (May 24).
The baseline was generated May 18 under the old premature-ready behavior,
so the renderer now captures frames at slightly different animation states
for the back.out(1.8) letter stagger.  85/100 checkpoints were below the
30 dB PSNR threshold.

Regenerated in Docker with the pinned chrome-headless-shell@148.0.7778.167.
Runtime changes since last baseline generation caused visual drift in 7 suites.
All regenerated with chrome-headless-shell@148.0.7778.167 inside Dockerfile.test.

Failures before regen:
- many-cuts: 1 frame
- overlay-montage-prod: 1 frame
- pip-video-late-host: 29 frames
- spanish-empire-cdn-inline: 74 frames
- style-18-prod: 24 frames
- style-7-prod: 50 frames
- typegpu-adapter: 75 frames

All 51 suites pass locally after this commit.
@miguel-heygen miguel-heygen changed the title test(producer): regenerate gsap-letters-render-compat baseline test(producer): regenerate 8 stale regression baselines in Docker May 30, 2026
@miguel-heygen miguel-heygen merged commit 100d355 into main May 30, 2026
40 of 58 checks passed
@miguel-heygen miguel-heygen deleted the fix/regression-baseline-gsap-letters branch May 30, 2026 15:26
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment

Labels

None yet

Projects

None yet

Development

Successfully merging this pull request may close these issues.

1 participant