Skip to content

mrassi/REtrackerDEMO

Repository files navigation

REtrackerDEMO

REtracker: RealSense Tracker by RASSI ENGINEERING

(Demo version: only supports Roll Pitch Yaw) For full product contact Rassi Engineering +9613341934 or marwan@rassi.me)

1- You will need a Realesense T265 that you can purchase here

2- Download and install latest sdk from realsense

3- clone or download Github directory

4- download tracker software REtrackerDemo.exe from Dropbox

5- run RE_sensordetect.exe (this will read your unique T265 serial number and will store it under serial.txt)

6- email serial.txt to marwan@rassi.me or mrassi@gmail.com

7- after email is received, we will email back your key (place key.txt in the same directory)

8- edit remote_address.txt with your aximmetry ip address (or local 127.0.0.1 if on the same PC)

9- run REtrackerDemo.exe

Aximmetry setup

1- go to manage devices > OSC server > select ip address > and set port to 7000

2a- Open ./aximmetry tools/sample_project.xcomp and replace test input video and Unreal Engine file

2b- or use ./aximmetry tools/REtrackerServer.xcomp and connect output to any camera transform node

3- for advanced users: you can use ./aximmetry tools/REtracker_LensDistort_JSON.xcomp after calibrating lense with RE_calibrate.exe and generating a distortion matrix JSON file (contact us for free calibration tools)

Miscellaneous

1- Tested extension cable from Amazon

2- Check the 3D-printable design (mount_t265_d435.stl) for attaching the Realsense with a 1/4 inch screw

Lens calibration procedure

1- Download Calibration pattern (camera-calibration-checker-board_9x7.pdf) print it and tape it to a board

2- Follow the Lens Calibration explanation here

3- An in depth video tutorial by Greg Corson youtube

Brief description

The T265 is an Intel RealSense high precision tracking sensor. We used it to create our own REtracker software. The software is renderer agnostic, meaning it works with all engines. You don’t need any markers at the set and you can use it outdoors and indoors. You need to purchase the sensor yourself from Intel website (check readme file)

When we started this project our goals were:

  • initial deployment time of less than 10 minutes
  • Daily use setup should take less than 2 minutes
  • Robust enough for live broadcast
  • Ability for use with most engines
  • Very easy workflow

you can track 3 cameras simultaneously with the same Aximmetry license on a single PC

The sensor connects to the PC or to a laptop. You can use yany broadcast camera. It is mounted on top of it. The REtracker software can be installed on any mini pc (i3, 4 GB ram) and the software will send tracking data via Wifi. Or you can connect it directly to the renderer PC.

A set of precision calibration tools is offered in the package as well.

Sample workflow video: check video here

Further stuff at my Youtube page

As for Unreal it works with the native unreal OSC plugin.

A Livelink Version for Unreal is in the making, it is still in beta, we will release it soon enough.

Full version features:

1- full studio tracking (3 Sensors, 3 cameras)

2- Lens calibration software that generates the FOV and lens distortion parameters

3- Genlock (our bespoke system locks the tracking to the output signal for a silky smooth blend of the graphics and the camera feed)

4- World pose software to detect camera height and position in real world

5- Aximmetry tools for AR, VR and XR

6- Livelink version for native unreal support

7- One on one tutorial on zoom and teamviewer

8- Lifetime license.

The price is 2000$/studio. Meaning you can use the same license for up to 3 cameras (you need one sensor per camera, sensor costs 199$) We also provide one on one remote support and training. We only sell 10 licenses per month in order to provide complete support to our clients. NB: Some exceptions are made for Indie companies and the ones whose input help our progress, we sell them single licenses with options to upgrade at a reduced cost.

PS: Intel's support of the sensor does not affect REtracker as it is bullet proof already. Hurry up and purchase your sensors where ever you can find them as the market is fast moving. T265 will be kept in production till february 2022.

About

RealSense T265 tracker by Rassi Engineering

Resources

License

Stars

Watchers

Forks

Releases

No releases published

Packages

No packages published