Skip to content

OSR6 Realtime Screen TCode v1.1.2

Latest
Latest

Choose a tag to compare

View all tags
@LexZeon LexZeon released this 04 Sep 04:12
· 4 commits to main since this release
v1.1.2
8ff39fa

SR6 Realtime Screen TCode v1.1.2

English

This release adds the new RTM Pose analysis workflow.

Download

Use OSR6-Realtime-Screen-v1.1.2-Windows for the ready-to-run Windows version.

Extract the whole zip before running. Do not run the app directly from inside the zip preview window.

RTM Pose GIF Demos

RTM Pose 2D with GPU Acceleration

Test hardware: Intel Ultra 9 CPU + NVIDIA GeForce RTX 4090 Laptop GPU. RTM GPU acceleration enabled.

rtm_pose_2d_gpu_4090_laptop_204036

RTM Pose 2D CPU Mode

Test hardware: Intel Ultra 9 CPU. GPU acceleration disabled.

rtm_pose_2d_cpu_intel_ultra_9_no_gpu_204419

Dance source used in the RTM Pose demos: https://www.bilibili.com/video/BV1UvtE6uEkD/

For infringement concerns, contact aivnailedeng@gmail.com for removal.

What's New

RTM Pose 2D / 3D Analysis

v1.1.2 introduces RTM Pose-based analysis modes using local ONNX models.

  • Added RTM Pose 2D mode for lower-latency pose-driven dance analysis.
  • Added / updated RTM Pose 3D mode for richer pose-based motion testing.
  • Added separate model handling for RTM Pose 2D and RTM Pose 3D.
  • Added model auto-detection / download flow.
  • Added model validation before realtime output to avoid using the wrong 2D/3D model.

RTM GPU Acceleration

  • Added optional RTM GPU acceleration.
  • GPU acceleration is intended for CUDA-capable NVIDIA GPUs.
  • If CUDA is unavailable or loading fails, the app falls back to CPU mode.
  • Tested RTM Pose 2D GPU acceleration on a 4090 Laptop GPU.
  • Tested RTM Pose 2D CPU mode on an Intel Ultra 9 CPU.

RTM Tracking Improvements

  • Added RTM optical-flow assist for smoother keypoint movement between model detections.
  • Added RTM Kalman fusion to reduce keypoint jitter.
  • RTM preview now shows clearer status for the current tracking mode.

Existing Features

Hybrid Analysis was already available since v1.0.0 and remains the recommended low-latency non-dance analysis mode.

Safety Notes

This project is intended for adults only. Minors are prohibited.

Six Axis mode is recommended only when lighting is good, the main subject is clear, and the selected screen region is clean. If the image is unclear, crowded, dark, or unstable, start with L0 Only or Log only preview.

Credits

Special thanks to DK and 1327 for technical guidance.

For infringement concerns, license corrections, suggestions, or collaboration, contact: aivnailedeng@gmail.com

中文

本次 v1.1.2 主要加入新的 RTM Pose 分析流程。

下载

OSR6-Realtime-Screen-v1.1.2-Windows 是可直接运行的 Windows 版本。

请先完整解压 zip，再运行软件。不要直接在压缩包预览窗口里双击运行。

RTM Pose GIF 演示

RTM Pose 2D GPU 加速

测试硬件：Intel Ultra 9 CPU + NVIDIA GeForce RTX 4090 Laptop GPU。已开启 RTM GPU 加速。

rtm_pose_2d_gpu_4090_laptop_204036

RTM Pose 2D CPU 模式

测试硬件：Intel Ultra 9 CPU。未开启 GPU 加速。

rtm_pose_2d_cpu_intel_ultra_9_no_gpu_204419

RTM Pose 演示中的舞蹈素材来源：https://www.bilibili.com/video/BV1UvtE6uEkD/

如有侵权请联系 aivnailedeng@gmail.com 删除。

新增内容

RTM Pose 2D / 3D 分析

v1.1.2 新增基于本地 ONNX 模型的 RTM Pose 分析模式。

  • 新增 RTM Pose 2D 模式，用于更低延迟的姿态驱动舞蹈分析。
  • 新增 / 更新 RTM Pose 3D 模式，用于更丰富的姿态动作测试。
  • RTM Pose 2D 和 RTM Pose 3D 使用分开的模型路径和模型处理逻辑。
  • 新增模型自动检测 / 下载流程。
  • 开始实时输出前会校验模型，避免 2D/3D 模型选错。

RTM GPU 加速

  • 新增可选 RTM GPU 加速。
  • GPU 加速面向支持 CUDA 的 NVIDIA 显卡。
  • 如果 CUDA 不可用或加载失败，软件会自动回退到 CPU 模式。
  • RTM Pose 2D GPU 加速测试环境：4090 Laptop GPU。
  • RTM Pose 2D CPU 模式测试环境：Intel Ultra 9 CPU。

RTM 追踪改进

  • 新增 RTM 光流辅助，用于补足两次模型检测之间的关键点运动。
  • 新增 RTM 卡尔曼融合，用于减少关键点跳动。
  • RTM 预览会显示当前追踪模式状态。

已有功能

Hybrid Analysis 从 v1.0.0 起已经支持，并仍然是低延迟非舞蹈读屏分析的推荐模式。

安全提示

本项目仅面向成年人使用，未成年人禁止使用。

六轴模式只建议在光线好、主体清晰、框选区域干净的画面中使用。如果画面太暗、主体不清楚、无关运动太多或画面不稳定，请先使用 L0 Only 或 Log only 预览。

鸣谢

特别感谢 DK 和 1327 提供技术指导。

如有侵权、许可证修正、建议或合作，请联系：aivnailedeng@gmail.com

Assets 3
Loading