Build failure with Jest snapshot errors

[mohanraj-r]

Build is failing with Jest snapshot errors saying they are not up-to-date - but the updated snapshots have been checked in and the tests pass locally after a clean build. Even checked out the branch to a diff clean location in my machine and tried out the CI commands - no issues 😕

Originally posted by @mohanraj-r in #13 (comment)

[mohanraj-r]

Replaced the --ci option to jest with --updateSnapshot to see what happens as a temp workaround and that causes the build to pass

$ jest --coverage --updateSnapshot
PASS packages/assert/__tests__/assert.test.ts
 › 4 snapshots updated.
PASS packages/jest/__tests__/matcher.test.ts
 › 4 snapshots updated.
PASS packages/test-utils/__tests__/test-utils.test.ts
 › 2 snapshots updated.
PASS packages/preset-rules/__tests__/rules.test.ts
PASS packages/jest/__tests__/setup.test.ts
PASS packages/format/__tests__/format.test.ts
 › 1 snapshot updated.
...
Snapshot Summary
 › 11 snapshots updated from 4 test suites.

Test Suites: 7 passed, 7 total
Tests:       38 passed, 38 total
Snapshots:   11 updated, 7 passed, 18 total
Time:        6.225 s
Ran all test suites in 2 projects.
Done in 13.35s.

But think --updateSnapshot isn't supposed to be used in CI and kind of defeats the purpose of snapshot testing? Doesn't it @trevor-bliss ?

[mohanraj-r]

Tried reverting

• unicode chars in err msg
• print received jest helper
• expected, received num of issues to the matcher hint msg

Same snapshot issues as before 😞
Guess it is good in a way that if one of these workarounds had worked, it would have raised more questions. But then the mystery continues ..

[trevor-bliss]

Yeah, definitely don't keep --updateSnapshot running in the CI :)

Something else I thought of to try... I see the CI is set to run on ubuntu. Are you generating the snapshots locally on a Mac? If so, let's try setting the runs-on value to:

runs-on: macos-latest

[mohanraj-r]

Thanks Trevor, I was thinking about the OS too.

• switching to mac-os doesn't fix the issue :(
• tried running the build locally in ubuntu container using nektos/act: Run your GitHub Actions locally 🚀 - it runs fine locally without any issue 😕

[mohanraj-r]

@trevor-bliss Resolved this issue by switching to circleci. Tests all pass now 😌
Have to figure out how to get codecov working with e.g. codecov.io - will do it after this PR
Will get back to taking care of the comments on the PR

[mohanraj-r]

Created Test workflow is failing with Jest snapshot errors · Issue #159 · actions/setup-node and also filed a github support ticket.

[trevor-bliss]

I'm a big fan of CircleCI so I don't think this is a huge loss :P

[mohanraj-r]

Good to know :)
Btw, ran into some issues trying to setup codecov.io for this repo - apparently because the repo is private - guess will have to wait till its open.