Repository navigation
v0.9.0-integration — Milestone 9: First End-to-End macOS Display Streaming
Pre-release
Pre-release
·
214 commits
to main
since this release
Renderd v0.9.0-integration — First End-to-End macOS Display Streaming Milestone
Renderd has achieved its first fully operational, real-time end-to-end remote desktop stream on macOS!
Verified Working Pipeline Components
- **Screen Capture**: Zero-copy GPU screen capture via `ScreenCaptureKit` FFI.
- **Hardware Encoding**: Real-time HEVC encoding via macOS `VideoToolbox` (`VTCompressionSession`).
- **Transport**: Sub-16ms peer-to-peer QUIC datagram streaming (`quinn`).
- **Discovery & Handshake**: Local network mDNS peer discovery and QUIC Stream 0 handshake.
- **Framing & Reassembly**: Sliding-window datagram fragmentation and reassembly (`ReassemblyWindow`).
- **Hardware Decoding**: Real-time HEVC hardware decompression via `VideoToolbox` (`VTDecompressionSession`).
- **Format Description & NAL Parsing**: Dynamic VPS/SPS/PPS parameter set extraction and Annex-B → HVCC length prefix conversion.
- **Frame Extraction & Presentation**: Zero-copy `CVPixelBuffer` BGRA buffer extraction and continuous rendering via `SoftRenderer`.
Project Roadmap & Feature Status
- [x] **End-to-End macOS Streaming** (`ScreenCaptureKit` → `VideoToolbox` HW Encode → QUIC → `VideoToolbox` HW Decode → `SoftRenderer`)
- [ ] **Cross-Platform Support** (macOS host ↔ Windows D3D12/MediaFoundation viewer integration)
- [ ] **Input Injection** (Low-latency mouse, keyboard, and touch event forwarding)
- [ ] **Audio Streaming** (CoreAudio capture & WASAPI / DirectSound playback)
- [ ] **Clipboard Sync** (Bidirectional text & image pasteboard synchronization)
- [ ] **File Transfer** (Drag-and-drop peer-to-peer file transport)
- [ ] **WAN / NAT Traversal** (STUN/TURN/ICE signaling fallback)
- [ ] **Performance Optimization** (Zero-copy GPU texture sharing & sub-10ms latency tuning)
Full Changelog: v0.8.0-viewer...v0.9.0-integration