How to compile the cpp version of benchmarks

[wrfgup]

I build the docker image following the Readme, run the docker but find no executable file of benchmarks.
when I look to the Readme in Tensorrt_llm/benchmarks/cpp:

I find that there is only CMakeList.txt in this directory but no Makeflie.
So how can I get the executable file of benchmarks of cpp version

[juney-nvidia]

@wrfgup
I think you are not executing the TensorRT-LLM building command before?

After invoking it, you can see the cpp/build directory under which there is Makefile.

[wrfgup]

@juney-nvidia yes i just run build tensorrt-llm in one step(https://github.com/NVIDIA/TensorRT-LLM/blob/release/0.5.0/docs/source/installation.md#build-tensorrt-llm-in-one-step).should i run https://github.com/NVIDIA/TensorRT-LLM/blob/release/0.5.0/docs/source/installation.md#build-tensorrt-llm after builded tensorrt-llm in one step

[juney-nvidia]

https://github.com/NVIDIA/TensorRT-LLM/blob/release/0.5.0/docs/source/installation.md#build-tensorrt-llm

After invoking python3 ./scripts/build_wheel.py --trt_root /usr/local/tensorrt, you should be able to see the cpp/build directory. Does it work for you now?

June

[77h2l]

nope.as long as we were in the docker, after run python3 ./scripts/build_wheel.py --trt_root /usr/local/tensorrt
there is still no build dir under the benchmarks/cpp directory

[byshiue]

ython3 ./scripts/build_wheel.py --trt_root /usr/local/tensorrt
there is still no build dir under the benchmarks/cpp directory

Please trying

cd cpp/build
make -j12

By default, the build_wheel.py only build packages for python.

[77h2l]

actually, I mean no matter how compiles in the docker container, there will never be Makefile file under the benchmark/cpp/build directory even no build dir under cpp, pls confirms.

[byshiue]

actually, I mean no matter how compiles in the docker container, there will never be Makefile file under the benchmark/cpp/build directory even no build dir under cpp, pls confirms.

They should be put in cpp/build/benchmarks instead of benchmark/cpp/build.