Win 10 issue with Pkg/PlatformEngines no download agent failure

[zjwegert]

I have been trying to find a fix for this issue for awhile. Perhaps this is a bug or my Windows has an issue. I have Powershell/curl on path along with 7z and tar. Am on Win 10 machine. I am able to run powershell and 7z from cmd using powershell and 7z. Furthermore, I can run powershell and 7z inside Julia using run(powershell) and run(7z).

(@v1.4) pkg> add Example
   Updating registry at `C:\Users\Zac\.juliapro\JuliaPro_v1.4.2-1\registries\JuliaPro`
ERROR: No download engines found. We looked for: powershell, C:\WINDOWS\System32\WindowsPowerShell\v1.0\powershell.exe, curl, wget, fetch, busybox. Install one and ensure it  is available on the path.
No compression engines found. We looked for: C:\Users\Zac\AppData\Local\JuliaPro-1.4.2-1\Julia-1.4.2\bin\..\libexec\7z.exe, C:\Users\Zac\AppData\Local\JuliaPro-1.4.2-1\Julia-1.4.2\bin\7z.exe, 7z, tar, busybox. Install one and ensure it is available on the path.   

Stacktrace:
 [1] error(::String) at .\error.jl:33
 [2] probe_platform_engines!(; verbose::Bool) at C:\Users\julia\AppData\Local\Julia-1.4.2\share\julia\stdlib\v1.4\Pkg\src\PlatformEngines.jl:512
 [3] probe_platform_engines! at C:\Users\julia\AppData\Local\Julia-1.4.2\share\julia\stdlib\v1.4\Pkg\src\PlatformEngines.jl:176 [inlined]
 [4] pkg_server_registry_url(::Base.UUID) at C:\Users\julia\AppData\Local\Julia-1.4.2\share\julia\stdlib\v1.4\Pkg\src\Types.jl:873
 [5] update_registries(::Pkg.Types.Context, ::Array{Pkg.Types.RegistrySpec,1}; force::Bool) at C:\Users\julia\AppData\Local\Julia-1.4.2\share\julia\stdlib\v1.4\Pkg\src\Types.jl:1044
 [6] update_registries at C:\Users\julia\AppData\Local\Julia-1.4.2\share\julia\stdlib\v1.4\Pkg\src\Types.jl:1036 [inlined] (repeats 2 times)
 [7] add(::Pkg.Types.Context, ::Array{Pkg.Types.PackageSpec,1}; preserve::Pkg.Types.PreserveLevel, platform::Pkg.BinaryPlatforms.Windows, kwargs::Base.Iterators.Pairs{Union{},Union{},Tuple{},NamedTuple{(),Tuple{}}}) at C:\Users\julia\AppData\Local\Julia-1.4.2\share\julia\stdlib\v1.4\Pkg\src\API.jl:143
 [8] add(::Pkg.Types.Context, ::Array{Pkg.Types.PackageSpec,1}) at C:\Users\julia\AppData\Local\Julia-1.4.2\share\julia\stdlib\v1.4\Pkg\src\API.jl:112
 [9] #add#27 at C:\Users\julia\AppData\Local\Julia-1.4.2\share\julia\stdlib\v1.4\Pkg\src\API.jl:109 [inlined]
 [10] add(::Array{Pkg.Types.PackageSpec,1}) at C:\Users\julia\AppData\Local\Julia-1.4.2\share\julia\stdlib\v1.4\Pkg\src\API.jl:109
 [11] do_cmd!(::Pkg.REPLMode.Command, ::REPL.LineEditREPL) at C:\Users\julia\AppData\Local\Julia-1.4.2\share\julia\stdlib\v1.4\Pkg\src\REPLMode\REPLMode.jl:403
 [12] do_cmd(::REPL.LineEditREPL, ::String; do_rethrow::Bool) at C:\Users\julia\AppData\Local\Julia-1.4.2\share\julia\stdlib\v1.4\Pkg\src\REPLMode\REPLMode.jl:381
 [13] do_cmd at C:\Users\julia\AppData\Local\Julia-1.4.2\share\julia\stdlib\v1.4\Pkg\src\REPLMode\REPLMode.jl:376 [inlined]
 [14] (::Pkg.REPLMode.var"#24#27"{REPL.LineEditREPL,REPL.LineEdit.Prompt})(::REPL.LineEdit.MIState, ::Base.GenericIOBuffer{Array{UInt8,1}}, ::Bool) at C:\Users\julia\AppData\Local\Julia-1.4.2\share\julia\stdlib\v1.4\Pkg\src\REPLMode\REPLMode.jl:542
 [15] (::Atom.var"#4#15"{Pkg.REPLMode.var"#24#27"{REPL.LineEditREPL,REPL.LineEdit.Prompt}})(::REPL.LineEdit.MIState, ::Base.GenericIOBuffer{Array{UInt8,1}}, ::Bool) at C:\Users\Zac\.juliapro\JuliaPro_v1.4.2-1\packages\Atom\9h5Up\src\Atom.jl:31
 [16] #invokelatest#1 at .\essentials.jl:712 [inlined]
 [17] invokelatest at .\essentials.jl:711 [inlined]
 [18] run_interface(::REPL.Terminals.TextTerminal, ::REPL.LineEdit.ModalInterface, ::REPL.LineEdit.MIState) at C:\Users\julia\AppData\Local\Julia-1.4.2\share\julia\stdlib\v1.4\REPL\src\LineEdit.jl:2354
 [19] run_frontend(::REPL.LineEditREPL, ::REPL.REPLBackendRef) at C:\Users\julia\AppData\Local\Julia-1.4.2\share\julia\stdlib\v1.4\REPL\src\REPL.jl:1055
 [20] run_repl(::REPL.AbstractREPL, ::Any) at C:\Users\julia\AppData\Local\Julia-1.4.2\share\julia\stdlib\v1.4\REPL\src\REPL.jl:206
 [21] (::Base.var"#764#766"{Bool,Bool,Bool,Bool})(::Module) at .\client.jl:383
 [22] #invokelatest#1 at .\essentials.jl:712 [inlined]
 [23] invokelatest at .\essentials.jl:711 [inlined]
 [24] run_main_repl(::Bool, ::Bool, ::Bool, ::Bool, ::Bool) at .\client.jl:367
 [25] exec_options(::Base.JLOptions) at .\client.jl:305
 [26] _start() at .\client.jl:484

If we look at probe_platform_engines we get the following info:

julia> Pkg.PlatformEngines.probe_platform_engines!(; verbose=true)
[ Info: Probing for download engine...
[ Info: Probing powershell as a possibility...
[ Info: Probing C:\WINDOWS\System32\WindowsPowerShell\v1.0\powershell.exe as a possibility...
[ Info: Probing curl as a possibility...
[ Info: Probing wget as a possibility...
[ Info: Probing fetch as a possibility...
[ Info: Probing busybox as a possibility...
[ Info: Probing for compression engine...
[ Info: Probing C:\Users\Zac\AppData\Local\JuliaPro-1.4.2-1\Julia-1.4.2\bin\..\libexec\7z.exe as a possibility...
[ Info: Probing C:\Users\Zac\AppData\Local\JuliaPro-1.4.2-1\Julia-1.4.2\bin\7z.exe as a possibility...
[ Info: Probing 7z as a possibility...
[ Info: Probing tar as a possibility...
[ Info: Probing busybox as a possibility...
ERROR: No download engines found. We looked for: powershell, C:\WINDOWS\System32\WindowsPowerShell\v1.0\powershell.exe, curl, wget, fetch, busybox. Install one and ensure it  is available on the path.
No compression engines found. We looked for: C:\Users\Zac\AppData\Local\JuliaPro-1.4.2-1\Julia-1.4.2\bin\..\libexec\7z.exe, C:\Users\Zac\AppData\Local\JuliaPro-1.4.2-1\Julia-1.4.2\bin\7z.exe, 7z, tar, busybox. Install one and ensure it is available on the path.   

Stacktrace:
 [1] error(::String) at .\error.jl:33
 [2] probe_platform_engines!(; verbose::Bool) at C:\Users\julia\AppData\Local\Julia-1.4.2\share\julia\stdlib\v1.4\Pkg\src\PlatformEngines.jl:512
 [3] top-level scope at none:0

[musm]

What does gcm powershell say in a terminal?

[musm]

Does C:\WINDOWS\System32\WindowsPowerShell\v1.0\powershell.exe exist? The error message suggests no, which is quite surprising.

[zjwegert]

PS C:\Users\Zac> gcm powershell

CommandType     Name                                               Version    Source
-----------     ----                                               -------    ------
Application     powershell.exe                                     10.0.18... C:\WINDOWS\System32\WindowsPowerShell\...

It really strange. Especially since I can issue the command C:\Users\Zac>powershell in CMD and it launches with no issues.

[musm]

Is this only occuring when you use Julia Pro? Does regular Julia exhibit such an issue?

[musm]

It really strange. Especially since I can issue the command C:\Users\Zac>powershell in CMD and it launches with no issues.

Exactly, I'm having a hard time trying to figure out what could possible be causing the function not to find any download agent.

[zjwegert]

Is this only occuring when you use Julia Pro? Does regular Julia exhibit such an issue?

Yes, regular Julia has the same issue. Also if I try to utilize the ENV["BINARYPROVIDER_DOWNLOAD_ENGINE"] = "curl" it still returns a similar error.

[zjwegert]

Btw This was a suggestion to try from the discourse:

julia> success(Cmd(`powershell`))
ERROR: IOError: could not spawn `powershell`: no such file or directory (ENOENT)
Stacktrace:
 [1] _spawn_primitive(::String, ::Cmd, ::Array{Any,1}) at .\process.jl:99
 [2] #550 at .\process.jl:112 [inlined]
 [3] setup_stdios(::Base.var"#550#551"{Cmd}, ::Array{Any,1}) at .\process.jl:196
 [4] _spawn at .\process.jl:111 [inlined]
 [5] _spawn at .\process.jl:106 [inlined]
 [6] success(::Cmd) at .\process.jl:496
 [7] top-level scope at none:0

[musm]

ENV["BINARYPROVIDER_DOWNLOAD_ENGINE"] = "curl" that's not going to work unless you have curl downloaded and added to PATH.

I believe something is very wrong with the environment variables on you system. Can you screenshot

[zjwegert]

Also I might add that curl is installed and on the path.

[musm]

You have so many different julia verison in path. There's a clash there bound to be already happening.

Delete

And move to the top of the list

[zjwegert]

Still no luck. If it helps there was a suggestion on discourse:

julia> success(Cmd(`powershell`))
ERROR: IOError: could not spawn `powershell`: no such file or directory (ENOENT)
Stacktrace:
 [1] _spawn_primitive(::String, ::Cmd, ::Array{Any,1}) at .\process.jl:99
 [2] #550 at .\process.jl:112 [inlined]
 [3] setup_stdios(::Base.var"#550#551"{Cmd}, ::Array{Any,1}) at .\process.jl:196
 [4] _spawn at .\process.jl:111 [inlined]
 [5] _spawn at .\process.jl:106 [inlined]
 [6] success(::Cmd) at .\process.jl:496
 [7] top-level scope at none:0

Also have tried
julia> success(Cmd(`C:\\Windows\\System32\\WindowsPowerShell\\v1.0\\powershell.exe`))
and
julia> success(Cmd(`C:\\Windows\\System32\\WindowsPowerShell\\v1.0\\powershell`))

These should give true but instead they error.

[musm]

What happens if you type a back tick to enter the shell mode

# back tick
shell> powershell

also try

julia> run(`powershell`)

Please post output from

julia> ENV["PATH"]

And also Windows Version (winver.exe)

[zjwegert]