Depth-Anything TensorRT in TouchDesigner

TouchDesigner implementation for Depth Anything and TensorRT monocular depth estimation.

Features

• One click install and run script
• In-TouchDesigner inference

Usage

Tested with TouchDesigner 2023.11340 & Python 3.11

Install:

1. Install Python 3.11
2. Install CUDA Toolkit 11.8
3. Download TDDepthAnything repository
4. Run accelerate.bat

Accelerate models:

1. Download Depth-Anything model
2. Copy model to checkpoints folder
3. Run accelerate.bat
4. Select model size (s - small, b - base, l - large)
5. Select width & height (default is 518x518)
6. Wait for acceleration to finish

TouchDesigner inference:

1. Add TDDepthAnything.tox to project
2. On Settings page change path to TDDepthAnything folder and click Re-init
3. On Depth Anything page select path to engine file (for ex. engines/depth_anything_vits14.engine) and click Load Engine

Acknowledgement

Based on the following projects:

• Depth-Anything - Unleashing the Power of Large-Scale Unlabeled Data.
• Depth-Anything TensorRT C++ - Leveraging the TensorRT API for efficient real-time inference.
• TopArray - Interaction between Python/PyTorch tensor operations and TouchDesigner TOPs.