Encountered "Failed to get cachix caches due to evaluation error" when running `devenv shell` command #1043

fangpenlin · 2024-03-22T23:24:21Z

Describe the bug

I follow the getting started guide and try to run a minimal devenv sample file like this

{ pkgs, ... }: {
  env.GREET = "determinism";

  packages = [ pkgs.git ];

  enterShell = "echo hello $GREET";
}

But I saw output like this

• Building shell ...
• Failed to get cachix caches due to evaluation error

While the devenv shell eventually built all the dependencies and enter the shell successfully, but it seems like the command is not using the cache as it supposes to be. I dug a bit deeper, and I realized that's caused by let ... in syntax used in the generated flake file by these lines:

devenv/devenv/src/flake.tmpl.nix

Lines 3 to 5 in 63c7109

    
           let 
        
             __DEVENV_VARS__ 
        
               in {

And if you looked at the generated flake file .devenv.flake.nix, it's like this

{
  inputs =
    let
      version = "1.0.1";
system = "x86_64-linux";
devenv_root = "/home/fangpen/workspace/playground/try-out-devenv2";
devenv_dotfile = ./.devenv;
devenv_dotfile_string = ".devenv";
container_name = null;
tmpdir = "/run/user/1000/";

        in {
...

Unfortunately, it appears that flake.nix is not using real nix language:

NixOS/nix#4945

As a result, if you take out the generated flake file at .devenv.flake.nix, renamed it as flake.nix and run the same command as in the code.

nix eval  .#devenv.cachix --json
error: expected a set but got a thunk at /nix/store/qny7kiz6ns713q8w2lgmjyrms3hg0jds-source/flake.nix:2:

It will show an error like that. It's the root cause of error message like Failed to get cachix caches due to evaluation error.

To reproduce

To reproduce, simply install devenv 1.0.1, then run devenv shell with sample file such as

{ pkgs, ... }: {
  env.GREET = "determinism";

  packages = [ pkgs.git ];

  enterShell = "echo hello $GREET";
}

Version

devenv 1.0.1 (x86_64-linux)

and the nix version is

nix (Nix) 2.18.1

The text was updated successfully, but these errors were encountered:

fangpenlin · 2024-03-22T23:30:40Z

I read the code of generated flake file by the command, it uses most of the syntax not really supported by flake according to NixOS/nix#4945 or my previous experience with flake, did I miss something when installing devenv? Is there a flag I should turn on for my nix to be able to make devenv uses cache without a problem?

domenkozar · 2024-03-23T14:32:05Z

That's really strange can you share devenv.lock?

fangpenlin · 2024-03-23T19:58:32Z

@domenkozar sure, here you go

{
  "nodes": {
    "devenv": {
      "locked": {
        "dir": "src/modules",
        "lastModified": 1711204516,
        "owner": "cachix",
        "repo": "devenv",
        "rev": "a30343f36e7c097d9f78d3387753d06986fdaae3",
        "treeHash": "7df9fc0b242a138ec44552558e179c1e7f072457",
        "type": "github"
      },
      "original": {
        "dir": "src/modules",
        "owner": "cachix",
        "repo": "devenv",
        "type": "github"
      }
    },
    "flake-compat": {
      "flake": false,
      "locked": {
        "lastModified": 1696426674,
        "owner": "edolstra",
        "repo": "flake-compat",
        "rev": "0f9255e01c2351cc7d116c072cb317785dd33b33",
        "treeHash": "2addb7b71a20a25ea74feeaf5c2f6a6b30898ecb",
        "type": "github"
      },
      "original": {
        "owner": "edolstra",
        "repo": "flake-compat",
        "type": "github"
      }
    },
    "flake-utils": {
      "inputs": {
        "systems": "systems"
      },
      "locked": {
        "lastModified": 1710146030,
        "owner": "numtide",
        "repo": "flake-utils",
        "rev": "b1d9ab70662946ef0850d488da1c9019f3a9752a",
        "treeHash": "bd263f021e345cb4a39d80c126ab650bebc3c10c",
        "type": "github"
      },
      "original": {
        "owner": "numtide",
        "repo": "flake-utils",
        "type": "github"
      }
    },
    "gitignore": {
      "inputs": {
        "nixpkgs": [
          "pre-commit-hooks",
          "nixpkgs"
        ]
      },
      "locked": {
        "lastModified": 1709087332,
        "owner": "hercules-ci",
        "repo": "gitignore.nix",
        "rev": "637db329424fd7e46cf4185293b9cc8c88c95394",
        "treeHash": "ca14199cabdfe1a06a7b1654c76ed49100a689f9",
        "type": "github"
      },
      "original": {
        "owner": "hercules-ci",
        "repo": "gitignore.nix",
        "type": "github"
      }
    },
    "nixpkgs": {
      "locked": {
        "lastModified": 1710796454,
        "owner": "cachix",
        "repo": "devenv-nixpkgs",
        "rev": "06fb0f1c643aee3ae6838dda3b37ef0abc3c763b",
        "treeHash": "9bb13f7f39e825a5d91bbe4139fbc129243b907d",
        "type": "github"
      },
      "original": {
        "owner": "cachix",
        "ref": "rolling",
        "repo": "devenv-nixpkgs",
        "type": "github"
      }
    },
    "nixpkgs-stable": {
      "locked": {
        "lastModified": 1711124224,
        "owner": "NixOS",
        "repo": "nixpkgs",
        "rev": "56528ee42526794d413d6f244648aaee4a7b56c0",
        "treeHash": "06fc80871a79146d86a73bbefc9a477ecdbce167",
        "type": "github"
      },
      "original": {
        "owner": "NixOS",
        "ref": "nixos-23.11",
        "repo": "nixpkgs",
        "type": "github"
      }
    },
    "pre-commit-hooks": {
      "inputs": {
        "flake-compat": "flake-compat",
        "flake-utils": "flake-utils",
        "gitignore": "gitignore",
        "nixpkgs": [
          "nixpkgs"
        ],
        "nixpkgs-stable": "nixpkgs-stable"
      },
      "locked": {
        "lastModified": 1710923068,
        "owner": "cachix",
        "repo": "pre-commit-hooks.nix",
        "rev": "e611897ddfdde3ed3eaac4758635d7177ff78673",
        "treeHash": "d7cff0ca3e7cdccd8ea9ef00f8534ef6b425cfc6",
        "type": "github"
      },
      "original": {
        "owner": "cachix",
        "repo": "pre-commit-hooks.nix",
        "type": "github"
      }
    },
    "root": {
      "inputs": {
        "devenv": "devenv",
        "nixpkgs": "nixpkgs",
        "pre-commit-hooks": "pre-commit-hooks"
      }
    },
    "systems": {
      "locked": {
        "lastModified": 1681028828,
        "owner": "nix-systems",
        "repo": "default",
        "rev": "da67096a3b9bf56a91d16901293e51ba5b49a27e",
        "treeHash": "cce81f2a0f0743b2eb61bc2eb6c7adbe2f2c6beb",
        "type": "github"
      },
      "original": {
        "owner": "nix-systems",
        "repo": "default",
        "type": "github"
      }
    }
  },
  "root": "root",
  "version": 7
}

tomtaylor · 2024-03-24T08:34:40Z

FWIW, I think I’m experiencing the same issue - let me know if I can provide any details too.

domenkozar · 2024-03-24T11:12:59Z

I'll look into this first thing in the morning tomorrow.

vigneshpai2003 · 2024-03-24T13:05:51Z

I fixed the error by adding cachix to nix.settings.substituters and nix.settings.trusted-public-keys as described here: https://nixos-and-flakes.thiscute.world/nixos-with-flakes/add-custom-cache-servers.

Not sure if related, but running devenv search <pkg> starts a long build process, the same thing that happened with devenv shell without the above workaround.

brizzbuzz · 2024-03-24T14:18:37Z

I'm running into what I think is a related problem. I'm going the flake route, and get the following when trying to launch my shell

nix develop --impure                                                                                                                 1 03/24/24 10:15:25 AM
warning: Git tree '/home/ryan/Workspace/brizzbuzz/scroll' is dirty
warning: ignoring untrusted substituter 'https://devenv.cachix.org', you are not a trusted user.
Run `man nix.conf` for more information on the `substituters` configuration option.

it then tries to build everything from source, but I think in my case I will resolve this when i figure out how to add myself as a trusted user in my host flake setup.

domenkozar · 2024-03-25T06:54:14Z

Can you guys run nix store ping and paste the output?

fangpenlin · 2024-03-25T06:57:56Z

sure

nix store ping
Store URL: daemon
Version: 2.18.1
Trusted: 0

domenkozar · 2024-03-25T06:58:58Z

Ah that's the issue, for some reason it's not detecting your user isn't trusted.

fangpenlin · 2024-03-25T07:06:05Z

  nix.settings = {
    experimental-features = ["nix-command" "flakes"];
    trusted-public-keys = ["devenv.cachix.org-1:w1cLUi8dv3hnoSPGAuibQv+f9TZLr6cv/Hm9XgU50cw="];
    substituters = ["https://devenv.cachix.org"];
    trusted-users = ["root" "fangpen"];
  };

I just added my username in trusted-users for nix settings and it seems to be working this time:

$devenv shell
• Building shell ...
• Using Cachix: devenv
• Trusting devenv.cachix.org on first use with the public key devenv.cachix.org-1:w1cLUi8dv3hnoSPGAuibQv+f9TZLr6cv/Hm9XgU50cw=
...

pretty awesome.

domenkozar · 2024-03-25T07:08:09Z

I'm working on a fix so this is properly detected, somehow it slipped in my testing.

domenkozar · 2024-03-25T07:10:10Z

I'd appreciate if someone can install the dev version nix profile install --accept-flake-config github:cachix/devenv/#devenv and run devenv -v shell which should print the reason it's barfing when setting up caches.

fangpenlin · 2024-03-25T07:12:44Z

okay, despite that the cache is working now, I think the second eval command is always going to fail regardless:

devenv/devenv/src/command.rs

Lines 243 to 246 in 63c7109

    
           let store = self.run_nix("nix", &["store", "ping", "--json"], &no_logging)?; 
        
           let caches_raw = 
        
               self.run_nix("nix", &["eval", ".#devenv.cachix", "--json"], &no_logging)?;

because

nix eval  .#devenv.cachix --json
error: expected a set but got a thunk at /nix/store/qny7kiz6ns713q8w2lgmjyrms3hg0jds-source/flake.nix:2:

as mentioned in the issue above, as far as I know flake.nix file is not real nix lang, it's a reduced version of it. the current generated flake contains syntax not included in the reduced version of nix lang. as a result, that command run is always going to fail. to avoid it from failing, we probably need to avoid using those syntax

domenkozar · 2024-03-25T07:13:49Z

devenv rewrites all nix command calls to it's own Nix that relaxes that constraint on flakes.

It would be helpful if you run the command I mentioned that should print what it barfs on.

fangpenlin · 2024-03-25T07:18:09Z

oh, okay, interesting, I didn't know devenv is using its own nix implementation. looks like it's not really complaining anything about that indeed:

$devenv -v shell
• Building shell ...
• Using Cachix: devenv
• Running command: nix --show-trace --extra-experimental-features nix-command --extra-experimental-features flakes --option warn-dirty false --option eval-cache false --keep-going --max-jobs 16 print-dev-env --profile /home/fangpen/workspace/playground/try-out-devenv/.devenv/gc/shell --option extra-substituters https://devenv.cachix.org --option extra-trusted-public-keys devenv.cachix.org-1:w1cLUi8dv3hnoSPGAuibQv+f9TZLr6cv/Hm9XgU50cw=
• Creating symlink /nix/store/ikgb4hjm3wf2r1zlsriddpy6w45yk99m-devenv-shell-env -> /home/fangpen/.local/share/devenv/gc/1711350483.119756652-shell
✔ Building shell in 0.9s.
• Entering shell
• Running command: nix --show-trace --extra-experimental-features nix-command --extra-experimental-features flakes --option warn-dirty false --option eval-cache false --keep-going --max-jobs 16 develop /home/fangpen/workspace/playground/try-out-devenv/.devenv/gc/shell
hello determinism

I think the problem is addressed, please feel free to close the issue.

domenkozar · 2024-03-25T08:18:56Z

I'd still like to fix for devenv to warn what you have to do.

For those that it doesn't work I'd appreciate running the development version and also paste the output of nix store ping --json.

tomtaylor · 2024-03-25T08:27:07Z

@domenkozar I've just started running nix profile install --accept-flake-config github:cachix/devenv/#devenv and it's building a lot of stuff from scratch - is that expected?

$ nix profile install --accept-flake-config github:cachix/devenv/#devenv
warning: ignoring untrusted substituter 'https://devenv.cachix.org', you are not a trusted user.
Run `man nix.conf` for more information on the `substituters` configuration option.
error: interrupted by the user

domenkozar · 2024-03-25T08:28:19Z

Yeah, you'll have to suffer through that until we fix this issue.

tomtaylor · 2024-03-25T08:29:32Z

Yeah, you'll have to suffer through that until we fix this issue.

OK, I'll come back to you once 782 packages have built! :)

domenkozar · 2024-03-25T11:38:51Z

Alright, let me know, I'd like to fix this and then we can release 1.0.2

domenkozar · 2024-03-25T12:35:32Z

@tomtaylor I found a way to reproduce it myself, fix incoming.

tomtaylor · 2024-03-25T13:04:17Z

Thanks @domenkozar. So, I removed my existing devenv profile and ran the following, but it's still trying to compile the world. Is that expected?

➜  ~ nix profile install github:cachix/devenv/v1.0.2
do you want to allow configuration setting 'extra-substituters' to be set to 'https://devenv.cachix.org' (y/N)? y
do you want to permanently mark this value as trusted (y/N)? y
do you want to allow configuration setting 'extra-trusted-public-keys' to be set to 'devenv.cachix.org-1:w1cLUi8dv3hnoSPGAuibQv+f9TZLr6cv/Hm9XgU50cw=' (y/N)? y
do you want to permanently mark this value as trusted (y/N)? y
warning: ignoring untrusted substituter 'https://devenv.cachix.org', you are not a trusted user.
Run `man nix.conf` for more information on the `substituters` configuration option.
[8/6/322 built, 0.4 MiB DL] building libgit2-1.7.2 (buildPhase): [ 27%] Building C object src/libgit2/CMakeFilerror: interrupted by the user
➜  ~ nix profile install github:cachix/devenv/v1.0.2
warning: ignoring untrusted substituter 'https://devenv.cachix.org', you are not a trusted user.
Run `man nix.conf` for more information on the `substituters` configuration option.
[8/5/316 built] building libpng-apng-1.6.40 (buildPhase): libtool: compile:  clang -DHAVE_CONFIG_H -I. -g -O2 error: interrupted by the user

domenkozar · 2024-03-25T23:36:04Z

nix profile install nixpkgs#devenv

…

On Mon, Mar 25, 2024 at 1:04 PM Tom Taylor ***@***.***> wrote: Thanks @domenkozar <https://github.com/domenkozar>. So, I removed my existing devenv profile and ran the following, but it's still trying to compile the world. Is that expected? ➜ ~ nix profile install github:cachix/devenv/v1.0.2do you want to allow configuration setting 'extra-substituters' to be set to 'https://devenv.cachix.org' (y/N)? ydo you want to permanently mark this value as trusted (y/N)? ydo you want to allow configuration setting 'extra-trusted-public-keys' to be set to 'devenv.cachix.org-1:w1cLUi8dv3hnoSPGAuibQv+f9TZLr6cv/Hm9XgU50cw=' (y/N)? ydo you want to permanently mark this value as trusted (y/N)? y warning: ignoring untrusted substituter 'https://devenv.cachix.org', you are not a trusted user. Run `man nix.conf` for more information on the `substituters` configuration option. [8/6/322 built, 0.4 MiB DL] building libgit2-1.7.2 (buildPhase): [ 27%] Building C object src/libgit2/CMakeFilerror: interrupted by the user ➜ ~ nix profile install github:cachix/devenv/v1.0.2 warning: ignoring untrusted substituter 'https://devenv.cachix.org', you are not a trusted user. Run `man nix.conf` for more information on the `substituters` configuration option. [8/5/316 built] building libpng-apng-1.6.40 (buildPhase): libtool: compile: clang -DHAVE_CONFIG_H -I. -g -O2 error: interrupted by the user — Reply to this email directly, view it on GitHub <#1043 (comment)>, or unsubscribe <https://github.com/notifications/unsubscribe-auth/AAA63AYFI57JS6UR2FUO4NTY2AOGPAVCNFSM6AAAAABFED24VWVHI2DSMVQWIX3LMV43OSLTON2WKQ3PNVWWK3TUHMZDAMJXHE3DKMJWGM> . You are receiving this because you were mentioned.Message ID: ***@***.***>

lplawlor · 2024-03-28T22:18:22Z

Just wanted to update in relation to my duplicate issue #1047.

I've been able to get devenv v1.0.2 from the nixos-unstable channel, and was met with the warning about being an untrusted user once I ran devenv init. I added my username to nix.settings.trusted-users in my NixOS config, and the package caching is working now.

Thanks for getting this fixed! 🎉

fangpenlin added the bug Something isn't working label Mar 22, 2024

domenkozar mentioned this issue Mar 25, 2024

Is initialization meant to take this long? #1047

Closed

domenkozar closed this as completed in 1b37a0b Mar 25, 2024

Provide feedback

Saved searches

Use saved searches to filter your results more quickly

Encountered "Failed to get cachix caches due to evaluation error" when running `devenv shell` command #1043

Encountered "Failed to get cachix caches due to evaluation error" when running `devenv shell` command #1043

fangpenlin commented Mar 22, 2024

fangpenlin commented Mar 22, 2024

domenkozar commented Mar 23, 2024

fangpenlin commented Mar 23, 2024

tomtaylor commented Mar 24, 2024

domenkozar commented Mar 24, 2024

vigneshpai2003 commented Mar 24, 2024 •

edited

brizzbuzz commented Mar 24, 2024

domenkozar commented Mar 25, 2024

fangpenlin commented Mar 25, 2024

domenkozar commented Mar 25, 2024

fangpenlin commented Mar 25, 2024

domenkozar commented Mar 25, 2024

domenkozar commented Mar 25, 2024

fangpenlin commented Mar 25, 2024

domenkozar commented Mar 25, 2024

fangpenlin commented Mar 25, 2024

domenkozar commented Mar 25, 2024

tomtaylor commented Mar 25, 2024

domenkozar commented Mar 25, 2024

tomtaylor commented Mar 25, 2024

domenkozar commented Mar 25, 2024

domenkozar commented Mar 25, 2024

tomtaylor commented Mar 25, 2024

domenkozar commented Mar 25, 2024 via email

lplawlor commented Mar 28, 2024

Encountered "Failed to get cachix caches due to evaluation error" when running devenv shell command #1043

Encountered "Failed to get cachix caches due to evaluation error" when running devenv shell command #1043

Comments

fangpenlin commented Mar 22, 2024

fangpenlin commented Mar 22, 2024

domenkozar commented Mar 23, 2024

fangpenlin commented Mar 23, 2024

tomtaylor commented Mar 24, 2024

domenkozar commented Mar 24, 2024

vigneshpai2003 commented Mar 24, 2024 • edited

brizzbuzz commented Mar 24, 2024

domenkozar commented Mar 25, 2024

fangpenlin commented Mar 25, 2024

domenkozar commented Mar 25, 2024

fangpenlin commented Mar 25, 2024

domenkozar commented Mar 25, 2024

domenkozar commented Mar 25, 2024

fangpenlin commented Mar 25, 2024

domenkozar commented Mar 25, 2024

fangpenlin commented Mar 25, 2024

domenkozar commented Mar 25, 2024

tomtaylor commented Mar 25, 2024

domenkozar commented Mar 25, 2024

tomtaylor commented Mar 25, 2024

domenkozar commented Mar 25, 2024

domenkozar commented Mar 25, 2024

tomtaylor commented Mar 25, 2024

domenkozar commented Mar 25, 2024 via email

lplawlor commented Mar 28, 2024

Encountered "Failed to get cachix caches due to evaluation error" when running `devenv shell` command #1043

Encountered "Failed to get cachix caches due to evaluation error" when running `devenv shell` command #1043

vigneshpai2003 commented Mar 24, 2024 •

edited