Skip to content

Files

Latest commit

 

History

History
97 lines (70 loc) · 3.99 KB

README.md

File metadata and controls

97 lines (70 loc) · 3.99 KB

English | 简体中文

PaddleDetection C# Deployment Example

This directory provides examples that infer_xxx.cs to fastly finish the deployment of PaddleDetection models, including PPYOLOE on CPU/GPU.

Before deployment, two steps require confirmation

Please follow below instructions to compile and test in Windows. FastDeploy version 1.0.4 or above (x.x.x>=1.0.4) is required to support this model.

1. Download C# package management tool nuget client

https://dist.nuget.org/win-x86-commandline/v6.4.0/nuget.exe

Add nuget program into system variable PATH

2. Download model and image for test

https://bj.bcebos.com/paddlehub/fastdeploy/ppyoloe_crn_l_300e_coco.tgz # (unzip it after download) https://gitee.com/paddlepaddle/PaddleDetection/raw/release/2.4/demo/000000014439.jpg

3. Compile example code

Open x64 Native Tools Command Prompt for VS 2019 command tool on Windows, cd to the demo path of ppyoloe and execute commands

cd D:\Download\fastdeploy-win-x64-gpu-x.x.x\examples\vision\detection\paddledetection\csharp

mkdir build && cd build
cmake .. -G "Visual Studio 16 2019" -A x64 -DFASTDEPLOY_INSTALL_DIR=D:\Download\fastdeploy-win-x64-gpu-x.x.x -DCUDA_DIRECTORY="C:/Program Files/NVIDIA GPU Computing Toolkit/CUDA/v11.2"

nuget restore
msbuild infer_demo.sln /m:4 /p:Configuration=Release /p:Platform=x64

For more information about how to use FastDeploy SDK to compile a project with Visual Studio 2019. Please refer to

4. Execute compiled program

fastdeploy.dll and related dynamic libraries are required by the program. FastDeploy provide a script to copy all required dll to your program path.

cd D:\Download\fastdeploy-win-x64-gpu-x.x.x

fastdeploy_init.bat install %cd% D:\Download\fastdeploy-win-x64-gpu-x.x.x\examples\vision\detection\paddledetection\csharp\build\Release

Then you can run your program and test the model with image

cd Release
infer_ppyoloe_demo.exe ppyoloe_crn_l_300e_coco 000000014439.jpg 0  # CPU
infer_ppyoloe_demo.exe ppyoloe_crn_l_300e_coco 000000014439.jpg 1  # GPU

PaddleDetection C# Interface

Model Class

fastdeploy.vision.detection.PPYOLOE(
        string model_file,
        string params_file,
        string config_file
        fastdeploy.RuntimeOption runtime_option = null,
        fastdeploy.ModelFormat model_format = ModelFormat.PADDLE)

PaddleDetection PPYOLOE initialization.

Params

  • model_file(str): Model file path
  • params_file(str): Parameter file path
  • config_file(str): Configuration file path, which is the deployment yaml file exported by PaddleDetection
  • runtime_option(RuntimeOption): Backend inference configuration. null by default, which is the default configuration
  • model_format(ModelFormat): Model format. Paddle format by default

Predict Function

fastdeploy.DetectionResult Predict(OpenCvSharp.Mat im)

Model prediction interface. Input images and output results directly.

Params

  • im(Mat): Input images in HWC or BGR format

Return

  • result(DetectionResult): Detection result, including detection box and confidence of each box. Refer to Vision Model Prediction Result for DetectionResult