test: refresh blog visual regression baselines (macOS + Linux)#329
Conversation
…ges) Pre-existing visual regression failures on master: - DesktopSiteTest#test_blog_index - MobileSiteTest#test_blog_index - MobileSiteTest#test_blog_post All 3 fail with identical difference_level: 0.062389564043209875. Root cause: baselines last captured 2026-04-14. Since then 5 intentional blog UI changes shipped without baseline updates: - 2026-04-30 fix(blog): index card tag taxonomy + ICP hero copy - 2026-05-02 Compact reading sections + 6 post engagement improvements - 2026-05-03 feat(blog): centered single-column typography (post + index) - 2026-05-04 Use explicit .post-description class for blog listing - 2026-05-05 fix(blog): show descriptions on mobile + fix overflow The drift is the cumulative effect of these intentional improvements. Refreshing macOS baselines via FORCE_SCREENSHOT_UPDATE=true. Linux baselines also need refresh — Docker daemon not available locally. Will fire on CI; follow-up needed once Docker is running, OR refresh through CI's FORCE_SCREENSHOT_UPDATE workflow if available. Co-Authored-By: Claude Opus 4.7 (1M context) <noreply@anthropic.com>
|
Important Review skippedReview was skipped due to path filters ⛔ Files ignored due to path filters (7)
CodeRabbit blocks several paths by default. You can override this behavior by explicitly including those paths in the path filters. For example, including ⚙️ Run configurationConfiguration used: Path: .coderabbit.yaml Review profile: CHILL Plan: Pro Run ID: You can disable this status message by setting the Use the checkbox below for a quick retry:
✨ Finishing Touches🧪 Generate unit tests (beta)
Thanks for using CodeRabbit! It's free for OSS, and your support helps us grow. If you like it, consider giving us a shout-out. Comment |
…mmit) Same root cause as the macOS refresh in 6321fe9 — Linux baselines also went stale through the same 5 intentional blog UI changes between 2026-04-14 and 2026-05-05. Captured via: docker compose run --env FORCE_SCREENSHOT_UPDATE=true t bundle exec ruby -Itest test/system/{desktop,mobile}_site_test.rb -n "/test_blog_index|test_blog_post/" Verified locally on macOS host (commit 6321fe9) and Linux Docker. Co-Authored-By: Claude Opus 4.7 (1M context) <noreply@anthropic.com>
Summary
Refreshes the 3 stale blog visual regression baselines on both macOS and Linux that have been failing on master with identical `difference_level: 0.062389564043209875`. Verified on both runners: all tests pass against new baselines.
Root cause
Baselines last captured 2026-04-14. Since then 5 intentional blog UI changes shipped without updating baselines:
Each shipped while the visual regression tests were already failing — the gate fired but nobody updated baselines. The 0.062 difference is the cumulative drift, not a single regression.
Investigation path
What changed
macOS baselines (commit `6321fe9e`):
Linux baselines (commit `918f8668`):
Test plan
Process improvement (for separate session)
The visual regression gate is supposed to fire BEFORE merge per CLAUDE.md. The fact that 5 commits shipped through it without anyone updating baselines suggests the gate isn't actually blocking merges. Worth investigating in a follow-up — the rule's intent is to catch drift at the boundary, not 3 weeks later.
🤖 Generated with Claude Code