Error when running make

[Niubbo75]

Hi, I'm having thi issue when I run make:

fibernoc@velociraptor:~/velociraptor$ make
go run make.go -v autoDev
go: downloading github.com/magefile/mage v1.15.0
go: downloading github.com/Masterminds/semver/v3 v3.2.1
go: downloading github.com/Velocidex/json v0.0.0-20220224052537-92f3c0326e5a
go: downloading github.com/Velocidex/ordereddict v0.0.0-20230909174157-2aa49cc5d11d
go: downloading github.com/valyala/fastjson v1.6.4
go: downloading google.golang.org/protobuf v1.33.0
go: downloading www.velocidex.com/golang/vfilter v0.0.0-20240421183637-1454295e8546
go: downloading github.com/Velocidex/yaml/v2 v2.2.8
go: downloading github.com/alecthomas/participle v0.7.1
go: downloading github.com/pkg/errors v0.9.1
go: downloading golang.org/x/text v0.14.0
go: downloading github.com/alecthomas/repr v0.4.0
Running target: AutoDev
exec: fileb0x "crypto/b0x.yaml"
exec: go "install" "github.com/Velocidex/fileb0x@d54f4040016051dd9657ce04d0ae6f31eab99bc6"
go: downloading github.com/Velocidex/fileb0x v1.1.2-0.20200125141948-d54f40400160
go: downloading github.com/labstack/echo v3.2.1+incompatible
go: downloading golang.org/x/net v0.0.0-20190404232315-eb5bcb51f2a3
go: downloading github.com/BurntSushi/toml v0.3.1
go: downloading gopkg.in/yaml.v2 v2.2.2
go: downloading github.com/bmatcuk/doublestar v1.1.1
go: downloading github.com/karrick/godirwalk v1.7.8
go: downloading github.com/UnnoTed/fileb0x v1.1.4
go: downloading github.com/gizak/termui/v3 v3.1.0
go: downloading github.com/labstack/gommon v0.3.0
go: downloading golang.org/x/crypto v0.0.0-20200117160349-530e935923ad
go: downloading github.com/pkg/errors v0.8.0
go: downloading github.com/mattn/go-runewidth v0.0.3
go: downloading github.com/mitchellh/go-wordwrap v1.0.0
go: downloading github.com/nsf/termbox-go v0.0.0-20190121233118-02980233997d
go: downloading github.com/mattn/go-colorable v0.1.2
go: downloading github.com/mattn/go-isatty v0.0.9
go: downloading github.com/valyala/fasttemplate v1.0.1
go: downloading golang.org/x/sys v0.0.0-20190813064441-fde4db37ae7a
go: downloading github.com/valyala/bytebufferpool v1.0.0
go: downloading golang.org/x/text v0.3.0
exec: fileb0x "crypto/b0x.yaml"
Error: failed to run "fileb0x crypto/b0x.yaml: exec: "fileb0x": executable file not found in $PATH"
exit status 1
make: *** [Makefile:2: all] Errore 1

I'm following this:

    $ git clone https://github.com/Velocidex/velociraptor.git
    $ cd velociraptor

    # This will build the GUI elements. You will need to have node
    # installed first. For example get it from
    # https://nodejs.org/en/download/.
    $ cd gui/velociraptor/
    $ npm install

    # This will build the webpack bundle
    $ make build

    # To build a dev binary just run make.
    # NOTE: Make sure ~/go/bin is on your path -
    # this is required to find the Golang tools we need.
    $ cd ../..
    $ make <= Here where I got the issue

    # To build production binaries
    $ make linux
    $ make windows

Fresh Debian 12 install with latest golang (1.19) and gcc (12.2.0) how can I solve?
Thanks,
Alessandro

[scudette]

You need to make sure you follow this step

NOTE: Make sure ~/go/bin is on your path -

[Niubbo75]

export PATH="$HOME/go/bin:$PATH"

Correct?

New error after re-run the command below:

# github.com/gorilla/websocket
../go/pkg/mod/github.com/gorilla/websocket@v1.5.2-0.20240215025916-695e9095ce87/server.go:177:28: undefined: http.NewResponseController
note: module requires Go 1.20
Error: running "go build -o output/velociraptor -tags  server_vql extras  yara  -ldflags= -w -s  -X "www.velocidex.com/golang/velociraptor/config.build_time=2024-05-06T11:52:41+02:00" -X "www.velocidex.com/golang/velociraptor/config.commit_hash=c9bfbf21" -race ./bin/" failed with exit code 2
exit status 2
make: *** [Makefile:2: all] Errore 1

[scudette]

Indeed you need go 1.20 now. You can download the latest version of Go here https://go.dev/doc/install

For linux it is very easy to install - just unpack somewhere and symlink to the go binary from your path

[Niubbo75]

Still get error:

fibernoc@velociraptor:~/velociraptor$ make
go run make.go -v autoDev
Running target: AutoDev
exec: fileb0x "artifacts/b0x.yaml"
exec: go "install" "github.com/Velocidex/fileb0x@d54f4040016051dd9657ce04d0ae6f31eab99bc6"
exec: fileb0x "artifacts/b0x.yaml"
Error: failed to run "fileb0x artifacts/b0x.yaml: exec: "fileb0x": executable file not found in $PATH"
exit status 1
make: *** [Makefile:2: all] Errore 1
fibernoc@velociraptor:~/velociraptor$ go version
go version go1.22.2 linux/amd64

[predictiple]

Check if fileb0x exists and is in your $PATH:
which fileb0x should return something like /home/user/go/bin/fileb0x

[Niubbo75]

I do not have fileb0x, how can I get it working?

[predictiple]

Try running the go install command manually:
go install github.com/Velocidex/fileb0x@d54f4040016051dd9657ce04d0ae6f31eab99bc6

[Niubbo75]

Still not have it:

fibernoc@velociraptor:~/velociraptor$ which fileb0x
fibernoc@velociraptor:~/velociraptor$ go install github.com/Velocidex/fileb0x@d54f4040016051dd9657ce04d0ae6f31eab99bc6
fibernoc@velociraptor:~/velociraptor$ which fileb0x
fibernoc@velociraptor:~/velociraptor$ 

[EDIT] I check $HOME/go/bin and I have fileb0x there:

fibernoc@velociraptor:~/go$ ls -lia bin/
totale 11848
2233350 drwxr-xr-x 2 fibernoc fibernoc     4096  7 mag 08.47 .
2101933 drwxr-xr-x 4 fibernoc fibernoc     4096  6 mag 10.51 ..
2884402 -rwxr-xr-x 1 fibernoc fibernoc 12121130  7 mag 09.31 fileb0x

[predictiple]

Ok that means your $PATH is not including ~/go/bin.
Do echo $PATH | tr ':' '\n' | sort and see if it's in there.

This is a Go installation issue, not a Velociraptor issue.

[Niubbo75]

I have reinstall Debian on a new VM, restart from the begin, install go version 1.20:

fibernoc@velociraptor:~/velociraptor$ go version
go version go1.20.2 linux/amd64

installed gcc:
gcc version 12.2.0 (Debian 12.2.0-14)
installed npm:

fibernoc@velociraptor:~/velociraptor$ npm version
{
  npm: '9.2.0',
  node: '18.19.0',
  acorn: '8.8.1',
  ada: '2.7.2',
  ares: '1.18.1',
  base64: '0.5.0',
  brotli: '1.0.9',
  cjs_module_lexer: '1.2.2',
  cldr: '42.0',
  icu: '72.1',
  llhttp: '6.0.11',
  modules: '108',
  napi: '9',
  nghttp2: '1.52.0',
  openssl: '3.0.11',
  simdutf: '3.2.18',
  tz: '2022e',
  unicode: '15.0',
  uv: '1.44.2',
  uvwasi: '0.0.19',
  v8: '10.2.154.26-node.28',
  zlib: '1.2.13'
}

installer make:

fibernoc@velociraptor:~/velociraptor$ make -v
GNU Make 4.3
Compilato per x86_64-pc-linux-gnu
Copyright (C) 1988-2020 Free Software Foundation, Inc.
 Licenza GPLv3+: GNU GPL versione 3 o successiva <http://gnu.org/licenses/gpl.html>.
 Questo programma è software libero: siete liberi di modificarlo e ridistribuirlo.
 Non c'è ALCUNA GARANZIA, per quanto consentito dalle vigenti normative.

I have installed go using:

wget https://golang.org/dl/go1.20.2.linux-amd64.tar.gz
sudo tar -C /usr/local -xzf go1.20.2.linux-amd64.tar.gz
echo "export PATH=/usr/local/go/bin:${PATH}" | sudo tee -a $HOME/.profile
source $HOME/.profile

but I still get the same error:

fibernoc@velociraptor:~/velociraptor/gui/velociraptor$ npm install
npm WARN deprecated urix@0.1.0: Please see https://github.com/lydell/urix#deprecated
npm WARN deprecated stable@0.1.8: Modern JS already guarantees Array#sort() is a stable sort, so this library is deprecated. See the compatibility table on MDN: https://developer.mozilla.org/en-US/docs/Web/JavaScript/Reference/Global_Objects/Array/sort#browser_compatibility
npm WARN deprecated source-map-resolve@0.5.3: See https://github.com/lydell/source-map-resolve#deprecated
npm WARN deprecated source-map-url@0.4.1: See https://github.com/lydell/source-map-url#deprecated
npm WARN deprecated resolve-url@0.2.1: https://github.com/lydell/resolve-url#deprecated
npm WARN deprecated querystring@0.2.0: The querystring API is considered Legacy. new code should use the URLSearchParams API instead.
npm WARN deprecated chokidar@2.1.8: Chokidar 2 does not receive security updates since 2019. Upgrade to chokidar 3 with 15x fewer dependencies
npm WARN deprecated popper.js@1.16.1: You can find the new Popper v2 at @popperjs/core, this package is dedicated to the legacy v1
npm WARN deprecated core-js@1.2.7: core-js@<3.23.3 is no longer maintained and not recommended for usage due to the number of issues. Because of the V8 engine whims, feature detection in old core-js versions could cause a slowdown up to 100x even if nothing is polyfilled. Some versions have web compatibility issues. Please, upgrade your dependencies to the actual version of core-js.

added 988 packages, and audited 989 packages in 33s

139 packages are looking for funding
  run `npm fund` for details

12 vulnerabilities (10 high, 2 critical)

To address issues that do not require attention, run:
  npm audit fix

To address all issues possible (including breaking changes), run:
  npm audit fix --force

Some issues need review, and may require choosing
a different dependency.

Run `npm audit` for details.
fibernoc@velociraptor:~/velociraptor/gui/velociraptor$ make build
echo "module fake_nodejs_module // Exclude this directory from Go tools\n\ngo 1.16" > node_modules/go.mod
npm run build

> velociraptor@0.72 build
> vite build

vite v4.5.3 building for production...
✓ 2327 modules transformed.
../build/assets/Microsoft_Azure_Logo-4e266c6c.svg                         0.53 kB │ gzip:     0.31 kB
../build/assets/Google-icon-vector-04-2728ed80.svg                        1.31 kB │ gzip:     0.70 kB
../build/index.html                                                       1.36 kB │ gzip:     0.69 kB
../build/assets/OpenID_logo-79676983.svg                                  2.90 kB │ gzip:     1.23 kB
../build/assets/Github-octocat-icon-vector-01-91a667a1.svg                4.95 kB │ gzip:     1.95 kB
../build/assets/velo-5183c258.svg                                         5.99 kB │ gzip:     2.93 kB
../build/assets/fixedsysexcelsioriiib-l2-mono-webfont-55c2c982.woff2     14.84 kB
../build/assets/noto-sans-v27-latin-ext_latin-regular-97d783ea.woff2     40.10 kB
../build/assets/noto-sans-v27-latin-ext_latin-600-6285227f.woff2         41.08 kB
../build/assets/iosevka-term-regular-subset-200dadf1.woff2               79.92 kB
../build/assets/iosevka-term-medium-subset-d289edc8.woff2                80.05 kB
../build/assets/iosevka-term-bold-subset-89c23b94.woff2                  80.65 kB
../build/assets/index-3a0120b7.css                                      415.58 kB │ gzip:    60.81 kB
../build/assets/index-2e0329b3.js                                     4,891.11 kB │ gzip: 1,179.89 kB

(!) Some chunks are larger than 500 kBs after minification. Consider:
- Using dynamic import() to code-split the application
- Use build.rollupOptions.output.manualChunks to improve chunking: https://rollupjs.org/configuration-options/#output-manualchunks
- Adjust chunk size limit for this warning via build.chunkSizeWarningLimit.
✓ built in 31.35s

✨ [vite-plugin-compression]:algorithm=brotliCompress - compressed file successfully: 
build//home/fibernoc/velociraptor/gui/velociraptor/build/assets/Google-icon-vector-04-2728ed80.svg.br                     1.28kb / brotliCompress: 0.58kb
build//home/fibernoc/velociraptor/gui/velociraptor/build/assets/Github-octocat-icon-vector-01-91a667a1.svg.br             4.83kb / brotliCompress: 1.65kb
build//home/fibernoc/velociraptor/gui/velociraptor/build/assets/OpenID_logo-79676983.svg.br                               2.84kb / brotliCompress: 1.03kb
build//home/fibernoc/velociraptor/gui/velociraptor/build/assets/fixedsysexcelsioriiib-l2-mono-webfont-55c2c982.woff2.br   14.49kb / brotliCompress: 14.45kb
build//home/fibernoc/velociraptor/gui/velociraptor/build/assets/velo-5183c258.svg.br                                      5.85kb / brotliCompress: 2.49kb
build//home/fibernoc/velociraptor/gui/velociraptor/build/assets/noto-sans-v27-latin-ext_latin-600-6285227f.woff2.br       40.11kb / brotliCompress: 40.12kb
build//home/fibernoc/velociraptor/gui/velociraptor/build/assets/noto-sans-v27-latin-ext_latin-regular-97d783ea.woff2.br   39.16kb / brotliCompress: 39.16kb
build//home/fibernoc/velociraptor/gui/velociraptor/build/assets/iosevka-term-medium-subset-d289edc8.woff2.br              78.18kb / brotliCompress: 78.18kb
build//home/fibernoc/velociraptor/gui/velociraptor/build/assets/iosevka-term-bold-subset-89c23b94.woff2.br                78.76kb / brotliCompress: 78.76kb
build//home/fibernoc/velociraptor/gui/velociraptor/build/assets/iosevka-term-regular-subset-200dadf1.woff2.br             78.05kb / brotliCompress: 78.05kb
build//home/fibernoc/velociraptor/gui/velociraptor/build/velo.svg.br                                                      9.17kb / brotliCompress: 3.44kb
build//home/fibernoc/velociraptor/gui/velociraptor/build/favicon.ico.br                                                   34.79kb / brotliCompress: 3.99kb
build//home/fibernoc/velociraptor/gui/velociraptor/build/assets/index-3a0120b7.css.br                                     405.85kb / brotliCompress: 44.40kb
build//home/fibernoc/velociraptor/gui/velociraptor/build/assets/index-2e0329b3.js.br                                      4805.05kb / brotliCompress: 860.02kb


cd build && mkdir static
echo > build/static/.keep
echo > build/.keep
fibernoc@velociraptor:~/velociraptor/gui/velociraptor$ cd ../..
fibernoc@velociraptor:~/velociraptor$ make
go run make.go -v autoDev
go: downloading github.com/magefile/mage v1.15.0
go: downloading github.com/Masterminds/semver/v3 v3.2.1
go: downloading github.com/Velocidex/json v0.0.0-20220224052537-92f3c0326e5a
go: downloading github.com/Velocidex/ordereddict v0.0.0-20230909174157-2aa49cc5d11d
go: downloading github.com/valyala/fastjson v1.6.4
go: downloading google.golang.org/protobuf v1.33.0
go: downloading www.velocidex.com/golang/vfilter v0.0.0-20240506173130-c9f964f7778a
go: downloading github.com/Velocidex/yaml/v2 v2.2.8
go: downloading github.com/alecthomas/participle v0.7.1
go: downloading github.com/pkg/errors v0.9.1
go: downloading golang.org/x/text v0.15.0
go: downloading github.com/alecthomas/repr v0.4.0
Running target: AutoDev
exec: fileb0x "artifacts/b0x.yaml"
exec: go "install" "github.com/Velocidex/fileb0x@d54f4040016051dd9657ce04d0ae6f31eab99bc6"
go: downloading github.com/Velocidex/fileb0x v1.1.2-0.20200125141948-d54f40400160
go: downloading github.com/labstack/echo v3.2.1+incompatible
go: downloading golang.org/x/net v0.0.0-20190404232315-eb5bcb51f2a3
go: downloading github.com/BurntSushi/toml v0.3.1
go: downloading gopkg.in/yaml.v2 v2.2.2
go: downloading github.com/bmatcuk/doublestar v1.1.1
go: downloading github.com/karrick/godirwalk v1.7.8
go: downloading github.com/UnnoTed/fileb0x v1.1.4
go: downloading github.com/gizak/termui/v3 v3.1.0
go: downloading github.com/labstack/gommon v0.3.0
go: downloading golang.org/x/crypto v0.0.0-20200117160349-530e935923ad
go: downloading github.com/pkg/errors v0.8.0
go: downloading github.com/mattn/go-runewidth v0.0.3
go: downloading github.com/mitchellh/go-wordwrap v1.0.0
go: downloading github.com/nsf/termbox-go v0.0.0-20190121233118-02980233997d
go: downloading github.com/mattn/go-colorable v0.1.2
go: downloading github.com/mattn/go-isatty v0.0.9
go: downloading github.com/valyala/fasttemplate v1.0.1
go: downloading golang.org/x/sys v0.0.0-20190813064441-fde4db37ae7a
go: downloading github.com/valyala/bytebufferpool v1.0.0
go: downloading golang.org/x/text v0.3.0
exec: fileb0x "artifacts/b0x.yaml"
Error: failed to run "fileb0x artifacts/b0x.yaml: exec: "fileb0x": executable file not found in $PATH"
exit status 1
make: *** [Makefile:2: all] Errore 1

Where I did the wrong thing?

[Niubbo75]

Ok, I dig a little bit more and I found that I do not have fileb0x in /usr/local/go/bin but I have it only in /home/user/go/bin so I have copied it to /usr/local/go/bin and after that I can run make

[scudette]

Indeed you should add /home/user/go/bin to the path

[Niubbo75]

I have do it here:
echo "export PATH=/usr/local/go/bin:${PATH}" | sudo tee -a $HOME/.profile
it's not the right way?

[scudette]

I normally add it to .bashrc or .bash_profile

[Niubbo75]

I'll keep in mind for the future than.
Thanks for all your support!
Best regards,
Alessandro