Skip to content

SyLC Cast and MV HEVC Export

Symphoenix edited this page Aug 6, 2026 · 1 revision

SyLC Cast and MV-HEVC export

Two ways to let the stereo pair leave the player.
Cast sends it live to a Quest; export gives it a carefully inspected passport and writes a spatial .mov.

Both features begin after SyLC has obtained a valid left/right pair, but they solve different problems. SyLC Cast is a real-time session whose deadline is the next frame. MV-HEVC export is an offline job whose deadline is “after every byte has been checked.” Confusing the two is how one gets a low-latency archive or a very patient headset.


SyLC Cast: live stereo to Quest

SyLC Cast encodes the current stereo output on the PC and sends video, audio, timing and control messages to the native Quest receiver.

It can carry:

  • authored MVC and MV-HEVC stereo;
  • packed stereo after SyLC has split it into eyes;
  • live 2D→3D synthesis;
  • PGS subtitles composited into both eyes;
  • SDR or HDR10 video, using HEVC Main10/P010 when the source and receiver path support it.

The sender uses NVENC for the live video stream. The receiver selects a compatible hardware decoder first, with an explicit fallback/error path when the headset cannot satisfy the declared stream.


Wi-Fi and USB-C are transports, not picture modes

Transport Discovery / connection Best use
Wi-Fi Quest discovers the PC over UDP, then opens the actual media/control session over TCP Untethered viewing on a stable local network
USB-C ADB port forwarding lets the Quest's local TCP connection reach the PC sender High-throughput, predictable link without Wi-Fi contention

The Wi-Fi media stream is not UDP. UDP answers discovery; TCP carries the same framed media/control protocol used by the USB route. That separation makes rediscovery light while keeping compressed access units ordered.

A normal Cast session

  1. Start a valid 3D presentation in SyLC.
  2. Open Stream to Quest from the Backup / Export area.
  3. Choose Wi-Fi or USB-C.
  4. Launch the SyLC receiver on the headset.
  5. Wait for the sender status to move from waiting to connected.

An orange status means the PC session exists and is waiting for the headset. Green means the receiver is connected. Neither colour means “the network is definitely innocent,” but it narrows the investigation admirably.


The live pipeline

SyLC eye pair
    │
    ├── subtitles composited at authored stereo depth
    │
    ▼
full-SBS encoder surface
    │
    ▼
NVENC HEVC / HEVC Main10
    │
    ├── video access units
    ├── audio packets
    ├── stream metadata
    └── control / pressure feedback
             │
             ▼
       TCP transport
             │
             ▼
       Quest decoder + stereo surface

When the frame-packed renderer already owns both eye textures, Cast can use that GPU-resident pair. If only the embedded preview is active, the Cast surface uploads both eyes itself. The second route costs more bandwidth inside the PC but preserves the same stereo content.


Congestion and recovery

A low-latency stream cannot solve pressure by queueing forever. SyLC combines receiver feedback and sender-side TCP pressure to distinguish normal in-flight work from real backlog.

  • sustained pressure is required before bitrate reduction;
  • USB retains a practical bitrate floor;
  • an actual compressed-frame loss can request a recovery IDR independently of bitrate selection;
  • control and UI-to-I/O latency are bounded;
  • the Quest receiver reconnects with bounded exponential backoff after a transient USB/ADB or network interruption;
  • encoder and audio state are kept alive where possible so recovery does not require restarting PC playback.

The goal is not “never drop a packet,” an ambition networks enjoy hearing. The goal is “recover at the next safe random-access point without allowing one lost reference to freeze the rest of the film.”


MV-HEVC export: one destination, several source families

The exporter creates an Apple-compatible QuickTime .mov carrying two HEVC views and the metadata required for spatial-video interpretation.

Accepted source families include:

Source Export route
Full-SBS / Full-TAB, H.264 or HEVC Decode packed frames, preserve layout, encode multiview HEVC
H.264 MVC, including Blu-ray and split-view backups Dedicated native MVC demux/decode session, pair by picture order, encode both eyes
Existing MV-HEVC Copy/remux when the container is conformant; otherwise repair/remux or re-encode
Live 2D→3D Export synthesized eye pairs through the same multiview encoder path

Half-SBS and Half-TAB are refused by the first exporter version. Their per-eye geometry is anamorphically squeezed, and emitting it without the corresponding pixel-aspect contract would produce a formally stereo file whose people have become mysteriously narrow.


The normal encode path

source adapter
    │
    ▼
decoded 8-bit 4:2:0 eye pair
    │
    ▼
x265 multiview encode
    │
    ▼
MP4Box hvc1 + hvcC + lhvC mux
    │
    ▼
audio copy or AAC conversion
    │
    ▼
vexu spatial metadata injection
    │
    ▼
final validation + atomic replacement

The resolution passed to x265 is the per-eye resolution. The encoder expands the packed canvas internally according to its multiview format. Passing the already doubled width is a wonderfully efficient way to create a file twice as wrong.


Existing MV-HEVC: copy before re-encoding

When the source is already multiview HEVC, the exporter uses a three-tier policy:

  1. Container copy: if the input already has a conformant hvc1 sample entry with hvcC and lhvC, preserve the video bytes and perform only an audio-compatibility remux when needed.
  2. Elementary-stream remux: extract layered HEVC without re-encoding, verify that dependent-view NAL units survived, then rebuild the conformant container.
  3. Re-encode fallback: if either copy route fails validation, decode both views and use the normal x265 multiview path.

This is not optimism-driven remuxing. Every tier must prove that the dependent view still exists afterward.


Audio and HDR policy

Audio

  • AAC and AC-3-family audio can be copied when QuickTime compatibility permits.
  • TrueHD, DTS and other unsuitable formats are transcoded to AAC at 384 kbit/s.
  • Audio is best-effort: an audio failure may produce a video-only result, but the completion report says so explicitly.

HDR

The bundled multiview x265 path is 8-bit. It must therefore never label an 8-bit encode as PQ or HLG.

  • A conformant MV-HEVC copy path preserves existing HDR bytes and metadata.
  • Re-encoded sources that pass through FFmpeg are tone-mapped to BT.709 SDR.
  • Routes that cannot perform a safe conversion are refused with a named reason.

“It still has an HDR tag” is not a preservation result when the values underneath have been quantized into a different signal.


Export hardening guarantees

The exporter treats successful output as a claim that must survive cross-examination.

  1. The destination is protected. Work is staged beside the target and installed with an atomic replacement only after validation. An existing file remains untouched on failure.
  2. Short output is failure. Encoded frame count is compared with the source; a decoder that stops mid-film cannot return a deceptively tidy partial movie.
  3. Geometry is checked first. Odd 4:2:0 dimensions and inconsistent packed canvases are rejected before the long encode.
  4. HDR claims match the actual path. No 8-bit PQ/HLG output is allowed.
  5. Final bytes are dogfooded. The completed file is checked for hvc1, hvcC, lhvC, parseable vexu, two ffprobe views and a successful decode through SyLC's own reader.

Temporary files live in a per-job system temp directory and are purged on success, failure or cancellation. The exporter uses private decoder instances, so an offline job cannot borrow the live player's state and return it with crumbs in the decoded-picture buffer.


When a menu item is disabled

Check these conditions:

  • a real 3D source is loaded, or 2D→3D is active;
  • packed input is Full-SBS or Full-TAB, not half-resolution;
  • bundled x265 and MP4Box tools are present;
  • ffmpeg and ffprobe are available to the exporter;
  • no other export job is already running;
  • Cast has a supported NVIDIA/NVENC path and a valid stereo presentation.

For broader diagnosis, see Troubleshooting and diagnostics.

Clone this wiki locally