Skip to content
Professor3DSound edited this page Dec 28, 2021 · 26 revisions

HTC VIVE 3DSP Audio SDK

VIVE 3DSP Audio SDK is an audio solution for simulating realistic sounds in the virtual world. The SDK could be used to create engaging and immersive spatial audio for VR apps or experiences. A host of features are designed for developers.

Some of the unique features of VIVE 3DSP Audio SDK:

  • Higher Order Ambisonics (HOA) Highly optimized 3rd order HOA is implemented with very low computing power.
  • Head-Related Transfer Function (HRTF) The precise HRTF is modelled in this SDK for every 5 degree angles.
  • Room Audio The reflection and reverberation of a real space are simulated in the room audio model.
  • Hi-Res Audio Settings The quality is kept when Hi-Res audio is processed with VIVE 3DSP Audio Features.
  • Sound Decay Model The real-world modelling is adopted to create the sound decay model.
  • Geometric occlusion The super-efficient occlusion model works well without any Unity collider. Moreover, the virtual sound wave could be partially occluded according to the obstacle geometry.
  • Ambisonic Decoder The AmbiX file is supported in the SDK.

VIVE 3DSP Audio SDK is hardware-independent, high-quality, user-friendly, and powerful. Outstanding sound experiences can be provided especially for VIVE devices.

Higher Order Ambisonics (HOA)

Capture1

Ambisonics is the technology that uses a full-sphere surround sound technique to simulate spatial sound. Spherical harmonics is presented as the sound pressure changes around the listener.

The order of the spherical harmonics is also called the order of ambisonics. The order of ambisonics has a big influence on the realistic depiction of the direction of sound. Therefore, 3rd order ambisonics is used in the spatial audio model as it generates the better directivity of a spatial sound.

When the higher order is used, higher computing power is required for the ambisonic process. However, as a patent-pending technique is used on the VIVE 3DSP ambisonic process, it just requires a low computing power similar to the 1st order ambisonic.

Room Audio

Room Audio is the technology that simulates the sound feelings in a room such as the early reflection, late reverberation, ambient sound, and others. The material (e.g. wood, concrete, glass, etc.) of the walls in a room affects the sound reflections in the early stage of the traveling sound. After that, the sound encounters more reflections and mixes with the background sound and finally turns into late reverberation. Furthermore, binaural acoustics should be simulated especially when a human is located at the corner of the room. Moreover, there should be a lot of low-level sound like the sound from a refrigerator or an air conditioner, therefore the phenomena is also presented in Room Audio technology.

Sound Decay Model

During the sound wave propagation, the sound energy changes according to the distance. The inverse square law is a conventional method for this scenario to determine the change in the sound levels. However, the capability of the sound decay varies depending on the frequency. VIVE 3DSP Audio SDK provides the real-world effect by recording the responses while a sound source excites at different distances from the listener. Point source and line source attenuation models are provided as well.

Occlusion

The occlusion effect is adopted to simulate a phenomena when a sound wave encounters an obstacle. The resulting sound is produced depending on the properties of the obstacles, like the material and thickness.

In some cases, the obstacle asymmetrically occludes the sound transmission between a sound source and a human head. For more realistic experiences, binaural occlusion is considered in VIVE 3DSP Audio SDK to produce different sound feelings for both ears.

Two kinds of occlusion are present: Geometric Occlusion and Raycast Occlusion.

  • Geometric Occlusion: In this SDK, a high-precision analytical geometry technique is present in Geometric Occlusion. The occluded-sound effect can be presented according to some geometric factors of the obstacles, such as positions, rotations, sizes, and shapes. It also performs efficiently without using any amount of physics engine of other platforms like Unity or Unreal Engine.

  • Raycast Occlusion: A line-tracing-based technique is used to simulate the sound occlusion. The implementation counts how many rays are occluded while a sound source emits. It takes advantage of the physics engine of the platforms, such that there is great flexibility of geometry shapes that can be used as long as they are supported by the platforms.

The VIVE 3DSP Audio SDK supports room effect, room reverberation and reflection, and acoustic occlusion. It also has spatial effect optimization for VIVE Pro Headphones. However the original VIVE and other HMDs and headphones are also supported.

Clone this wiki locally