feat(dep-graph): introduce NX_DEPS_DIRECTORY env variable

[minijus]

Current Behavior

nxdeps.json is always stored inside cache directory. This becomes an issues when cache directory is shared/mounted in CI environment. Multiple parallel CI runs start sharing (and updating) same nxdeps.json which in turn produces false results/erros.

Expected Behavior

It should be possible to store nxdeps.json outside cache directory, so it could be unique/isolated per workspace in CI environment.

Fixes #10000

[nx-cloud]

☁️ Nx Cloud Report

CI is running/has finished running commands for commit c3ec068. As they complete they will appear below. Click to see the status, the terminal output, and the build insights.

📂 See all runs for this branch

---

✅ Successfully ran 12 targets

• nx affected --target=build --base=838170e2004bd0c27c68ba510b153edf951c0310 --head=c3ec068fb2e3cd8fb8249654292c334f10b28b4d --parallel=3
• nx affected --target=e2e --base=838170e2004bd0c27c68ba510b153edf951c0310 --head=c3ec068fb2e3cd8fb8249654292c334f10b28b4d --exclude=e2e-detox,e2e-js,e2e-next,e2e-workspace-create,e2e-workspace-integrations,e2e-workspace-core,e2e-react,e2e-web,e2e-angular-extensions,e2e-angular-core,e2e-cli,e2e-nx-plugin,e2e-cypress,e2e-node,e2e-linter,e2e-jest,e2e-a...
• nx affected --target=e2e --base=838170e2004bd0c27c68ba510b153edf951c0310 --head=c3ec068fb2e3cd8fb8249654292c334f10b28b4d --exclude=e2e-storybook,e2e-react-native,e2e-detox --parallel=1
• nx affected --target=lint --base=838170e2004bd0c27c68ba510b153edf951c0310 --head=c3ec068fb2e3cd8fb8249654292c334f10b28b4d --parallel=3
• nx affected --target=test --base=838170e2004bd0c27c68ba510b153edf951c0310 --head=c3ec068fb2e3cd8fb8249654292c334f10b28b4d --parallel=1
• nx build typedoc-theme
• nx-cloud record -- yarn check-commit
• nx-cloud record -- yarn check-imports
• nx-cloud record -- yarn depcheck
• nx-cloud record -- yarn documentation
• nx-cloud record -- yarn nx format:check --base=838170e2004bd0c27c68ba510b153edf951c0310 --head=c3ec068fb2e3cd8fb8249654292c334f10b28b4d
• nx-cloud record -- yarn nx workspace-lint

---

Sent with 💌 from NxCloud.

[vercel]

The latest updates on your projects. Learn more about Vercel for Git ↗︎

Name	Status	Preview	Updated
nx-dev	✅ Ready (Inspect)	Visit Preview	Jun 7, 2022 at 9:37AM (UTC)

[jonhamm]

You need to move Nx Daemon to use depsDir
Also need update of documentation
Need to make nx reset empty depsDir

I was developing this fix locally before seing your PR
It has these changes
Do you want a link to my PR to incorporate what you would find useful or should I just make another PR alongside yours?

[minijus]

@jonhamm let's work on this together!
I will not have a look at this PR earlier than Monday next week. If you intent to work during this time feel free to use what you see useful from this PR. Otherwise, I am glad to pull changes from your branch, just leave a link to it.

It would be really nice to get some feedback and general guidelines from Nx Team on this change before doing full implementation, cc @vsavkin @meeroslav @AgentEnder .

[FrozenPandaz]

Hey @minijus @jonhamm

Thank you for working on this! We discussed this and we're going to have an environment variable: $NX_PROJECT_GRAPH_CACHE_DIR that will override the existing cache dir. There will be no setting in nx.json for now and I think that's okay. Both the nxdeps.json and the daemon will go there.

I will take care of the implementation. I really appreciate the effort though. 🙏

Let me know what you think of the above.

EDIT: The environment variable will be NX_PROJECT_GRAPH_CACHE_DIRECTORY instead of previously mentioned NX_PROJECT_GRAPH_CACHE_DIR to match NX_CACHE_DIRECTORY.

[jonhamm]

@FrozenPandaz : thanks for the fix - it will be very helpful!
One note though: it would have been better with a config option or defaulting the project graph directory to something different from the cache directory which would lead to a zero-config in most situations as very few would want to move the project graph directory even if they move the cache directory
But that said, you solution will definitely work for us :-)

[github-actions]

This pull request has already been merged/closed. If you experience issues related to these changes, please open a new issue referencing this pull request.