[Bug]: automatic upgrade (to v0.4.4) hit errors, resolved itself?

[altano]

Current Behavior (bug)
I opened my command prompt today and direnv loaded devbox. It looks like during the automatic upgrade to devbox 0.4.4 I got a bunch of errors. I opened another command prompt and got fewer errors. The third time I opened the prompt it opened just fine. It looks like the problem resolved itself.

first time:

direnv: loading ~/src/docker/coreos-configs/.envrc                                                                                                                                                                                     
direnv: using devbox
direnv: using nix .devbox/gen/shell.nix
direnv: ([/opt/homebrew/bin/direnv export zsh]) is taking a while to execute. Use CTRL-C to give up.
these 5 paths will be fetched (1.64 MiB download, 12.92 MiB unpacked):
  /nix/store/jcj1jmp0hq1xx8qyr53dwv0c7gaz4rrn-libobjc-11.0.0
  /nix/store/l9ql9nk7xm90sg3vza3wkg4nan4qvdvq-readline-8.2p1
  /nix/store/m96g2hz3srzl006mlcl0w78ip5kg93bb-apple-framework-CoreFoundation-11.0.0
  /nix/store/xmrc9har7k2z3a2j2zd82s0k4l4vz8pq-ncurses-6.4
  /nix/store/xzv575br516sbj3w3lhqcf7yw1r1n6gq-bash-interactive-5.2-p15
copying path '/nix/store/xmrc9har7k2z3a2j2zd82s0k4l4vz8pq-ncurses-6.4' from 'https://cache.nixos.org'...
copying path '/nix/store/jcj1jmp0hq1xx8qyr53dwv0c7gaz4rrn-libobjc-11.0.0' from 'https://cache.nixos.org'...
copying path '/nix/store/m96g2hz3srzl006mlcl0w78ip5kg93bb-apple-framework-CoreFoundation-11.0.0' from 'https://cache.nixos.org'...
copying path '/nix/store/l9ql9nk7xm90sg3vza3wkg4nan4qvdvq-readline-8.2p1' from 'https://cache.nixos.org'...
copying path '/nix/store/xzv575br516sbj3w3lhqcf7yw1r1n6gq-bash-interactive-5.2-p15' from 'https://cache.nixos.org'...
✓ Downloading version 0.4.4... [DONE]
✓ Verifying checksum... [DONE]
✓ Unpacking binary... [DONE]

Error: Command: /nix/var/nix/profiles/default/bin/nix print-dev-env /Users/alan/src/docker/coreos-configs/.devbox/gen/flake/flake.nix --extra-experimental-features ca-derivations --option experimental-features nix-command flakes --json: exit status 1

Error: There was an internal error. Run with DEVBOX_DEBUG=1 for a detailed error message, and consider reporting it at https://github.com/jetpack-io/devbox/issues
direnv: export +AR +AS +CC +CONFIG_SHELL +CXX +DETERMINISTIC_BUILD +DEVBOX_SHELL_ENABLED +HOST_PATH +IN_NIX_SHELL +LD +LD_DYLD_PATH +MACOSX_DEPLOYMENT_TARGET +NIX_BINTOOLS +NIX_BINTOOLS_WRAPPER_TARGET_HOST_aarch64_apple_darwin +NIX_BUILD_CORES +NIX_BUILD_TOP +NIX_CC +NIX_CC_WRAPPER_TARGET_HOST_aarch64_apple_darwin +NIX_CFLAGS_COMPILE +NIX_COREFOUNDATION_RPATH +NIX_DONT_SET_RPATH +NIX_DONT_SET_RPATH_FOR_BUILD +NIX_ENFORCE_NO_NATIVE +NIX_HARDENING_ENABLE +NIX_IGNORE_LD_THROUGH_GCC +NIX_INDENT_MAKE +NIX_LDFLAGS +NIX_NO_SELF_RPATH +NIX_STORE +NM +NODE_PATH +PATH_LOCALE +PYTHONHASHSEED +PYTHONNOUSERSITE +PYTHONPATH +RANLIB +SIZE +SOURCE_DATE_EPOCH +STRINGS +STRIP +TEMP +TEMPDIR +TMP +XDG_DATA_DIRS +__darwinAllowLocalNetworking +__impureHostDeps +__propagatedImpureHostDeps +__propagatedSandboxProfile +__sandboxProfile +__structuredAttrs +buildInputs +buildPhase +builder +cmakeFlags +configureFlags +depsBuildBuild +depsBuildBuildPropagated +depsBuildTarget +depsBuildTargetPropagated +depsHostHost +depsHostHostPropagated +depsTargetTarget +depsTargetTargetPropagated +doCheck +doInstallCheck +mesonFlags +name +nativeBuildInputs +out +outputs +patches +phases +propagatedBuildInputs +propagatedNativeBuildInputs +shell +shellHook +stdenv +strictDeps +system ~PATH ~TMPDIR

second time:

devbox shell
direnv: loading ~/src/docker/coreos-configs/.envrc                                                                                                                                                            
direnv: using devbox
direnv: using nix .devbox/gen/shell.nix
Error: Command: /nix/var/nix/profiles/default/bin/nix print-dev-env /Users/alan/src/docker/coreos-configs/.devbox/gen/flake/flake.nix --extra-experimental-features ca-derivations --option experimental-features nix-command flakes --json: exit status 1

Error: There was an internal error. Run with DEVBOX_DEBUG=1 for a detailed error message, and consider reporting it at https://github.com/jetpack-io/devbox/issues
direnv: export +AR +AS +CC +CONFIG_SHELL +CXX +DETERMINISTIC_BUILD +DEVBOX_SHELL_ENABLED +HOST_PATH +IN_NIX_SHELL +LD +LD_DYLD_PATH +MACOSX_DEPLOYMENT_TARGET +NIX_BINTOOLS +NIX_BINTOOLS_WRAPPER_TARGET_HOST_aarch64_apple_darwin +NIX_BUILD_CORES +NIX_BUILD_TOP +NIX_CC +NIX_CC_WRAPPER_TARGET_HOST_aarch64_apple_darwin +NIX_CFLAGS_COMPILE +NIX_COREFOUNDATION_RPATH +NIX_DONT_SET_RPATH +NIX_DONT_SET_RPATH_FOR_BUILD +NIX_ENFORCE_NO_NATIVE +NIX_HARDENING_ENABLE +NIX_IGNORE_LD_THROUGH_GCC +NIX_INDENT_MAKE +NIX_LDFLAGS +NIX_NO_SELF_RPATH +NIX_STORE +NM +NODE_PATH +PATH_LOCALE +PYTHONHASHSEED +PYTHONNOUSERSITE +PYTHONPATH +RANLIB +SIZE +SOURCE_DATE_EPOCH +STRINGS +STRIP +TEMP +TEMPDIR +TMP +XDG_DATA_DIRS +__darwinAllowLocalNetworking +__impureHostDeps +__propagatedImpureHostDeps +__propagatedSandboxProfile +__sandboxProfile +__structuredAttrs +buildInputs +buildPhase +builder +cmakeFlags +configureFlags +depsBuildBuild +depsBuildBuildPropagated +depsBuildTarget +depsBuildTargetPropagated +depsHostHost +depsHostHostPropagated +depsTargetTarget +depsTargetTargetPropagated +doCheck +doInstallCheck +mesonFlags +name +nativeBuildInputs +out +outputs +patches +phases +propagatedBuildInputs +propagatedNativeBuildInputs +shell +shellHook +stdenv +strictDeps +system ~PATH ~TMPDIR
➜  coreos-configs git:(master) ✗ devbox shell
Ensuring packages are installed.

Installing 4 packages: butane, nodejs, azure-cli, docker-client.

[1/4] butane
[1/4] butane: Success
[2/4] nodejs
[2/4] nodejs: Success
[3/4] azure-cli
[3/4] azure-cli: Success
[4/4] docker-client
[4/4] docker-client: Success
Starting a devbox shell...

3rd (and future) times:

devbox shell
direnv: loading ~/src/docker/coreos-configs/.envrc                                                                                                                                                            
direnv: using devbox
direnv: using nix .devbox/gen/shell.nix
direnv: export +AR +AS +CC +CONFIG_SHELL +CXX +DETERMINISTIC_BUILD +DEVBOX_OG_PATH +DEVBOX_SHELL_ENABLED +HOST_PATH +IN_NIX_SHELL +LAUNCHER_PATH +LAUNCHER_VERSION +LD +LD_DYLD_PATH +MACOSX_DEPLOYMENT_TARGET +NIX_BINTOOLS +NIX_BINTOOLS_WRAPPER_TARGET_HOST_aarch64_apple_darwin +NIX_BUILD_CORES +NIX_BUILD_TOP +NIX_CC +NIX_CC_WRAPPER_TARGET_HOST_aarch64_apple_darwin +NIX_CFLAGS_COMPILE +NIX_COREFOUNDATION_RPATH +NIX_DONT_SET_RPATH +NIX_DONT_SET_RPATH_FOR_BUILD +NIX_ENFORCE_NO_NATIVE +NIX_HARDENING_ENABLE +NIX_IGNORE_LD_THROUGH_GCC +NIX_INDENT_MAKE +NIX_LDFLAGS +NIX_NO_SELF_RPATH +NIX_STORE +NM +NODE_PATH +PATH_LOCALE +PYTHONHASHSEED +PYTHONNOUSERSITE +PYTHONPATH +RANLIB +SIZE +SOURCE_DATE_EPOCH +SSL_CERT_FILE +STRINGS +STRIP +SYSTEM_CERTIFICATE_PATH +TEMP +TEMPDIR +TMP +XDG_DATA_DIRS +__ETC_PROFILE_NIX_SOURCED +__darwinAllowLocalNetworking +__impureHostDeps +__propagatedImpureHostDeps +__propagatedSandboxProfile +__sandboxProfile +__structuredAttrs +buildInputs +buildPhase +builder +cmakeFlags +configureFlags +depsBuildBuild +depsBuildBuildPropagated +depsBuildTarget +depsBuildTargetPropagated +depsHostHost +depsHostHostPropagated +depsTargetTarget +depsTargetTargetPropagated +doCheck +doInstallCheck +dontAddDisableDepTrack +mesonFlags +name +nativeBuildInputs +out +outputs +patches +phases +propagatedBuildInputs +propagatedNativeBuildInputs +shell +shellHook +stdenv +strictDeps +system ~NIX_SSL_CERT_FILE ~PATH ~TMPDIR
➜  coreos-configs git:(master) ✗ devbox shell
Ensuring packages are installed.
Starting a devbox shell...

Expected Behavior (fix)
devbox upgrades without errors on first try

Additional context
devbox version -v

Version:     0.4.4
Platform:    darwin_arm64
Commit:      469cd559949b0d9f3af284a5056ea5606c0cf9ce
Commit Time: 2023-03-16T16:57:27Z
Go Version:  go1.19.7

devbox.json

{
  "packages": [
    "butane",
    "nodejs",
    "azure-cli",
    "docker-client"
  ],
  "shell": {
    "init_hook": null
  },
  "nixpkgs": {
    "commit": "f80ac848e3d6f0c12c52758c0f25c10c97ca3b62"
  }
}

.envrc

# Automatically sets up your devbox environment whenever you cd into this
# directory via our direnv integration:

use_devbox() {
    watch_file devbox.json
    if [ -f .devbox/gen/shell.nix ]; then
        DEVBOX_SHELL_ENABLED_BACKUP=$DEVBOX_SHELL_ENABLED
        use nix .devbox/gen/shell.nix
        eval $(devbox shell --print-env)
        export DEVBOX_SHELL_ENABLED=$DEVBOX_SHELL_ENABLED_BACKUP
    fi
}
use devbox

# check out https://www.jetpack.io/devbox/docs/ide_configuration/direnv/
# for more details

[Lagoja]

Thanks for reporting this. I think this may occur when there are changes to how Devbox generates or uses the underlying Nix derivations for a project. Usually they seem to resolve when people run devbox Shell to update the generated Nix derivation

We'll dig in. One solution could be to print a better error message, but we could also look into whether our direnv hook could update the derivation as well.

[tclain-pillar]

Github action is also broken since automatic 0.4.4 upgrade see #790

[Lagoja]

@altano We've improved our direnv integration in #830, which is now released in v0.4.5. This should prevent future version bumps or mismatches between the CLI and .devbox directory from breaking direnv integrations in the future.