Home
This wiki provides an overview of available MPEG-H Audio related repositories and additional developer-related information to help you get started with MPEG-H Audio projects.
MPEG-H Audio is a next-generation audio (NGA) system standardised in MPEG (ISO/IEC 23008-3) and designed for immersive and interactive sound experiences. It enables features such as 3D audio, user interactivity, and personalization, making it ideal for broadcast, streaming, and other advanced audio applications. Learn more at mpegh.com.
The following diagram shows the system overview of a typical broadcast/streaming receiving device using a full-featured MPEG-H Audio decoder.
To build a playback product that supports MPEG-H Audio, several key components must be integrated, as illustrated in the system overview diagram above. MPEG-H Audio is not just a codec, but a complete audio system, meaning its deployment requires careful integration of multiple MPEG-H Audio components within the device's multimedia framework. This includes not only the MPEG-H Audio decoder, but also all other MPEG-H Audio components and interfaces for exchanging the MPEG-H Audio metadata with applications or middleware. The multimedia framework must ensure that all these components interact seamlessly, handling bitstream parsing, audio decoding, user interface management, HDMI playback and system sound embedding, so that end users can benefit from immersive, interactive and accessible audio experiences.
A detailed description on how to integrate MPEG-H Audio into TVs and STBs can found below.
If you're building a stand-alone player with no RF input and/or HDMI output, some modules will not be necessary, but the general signal flow will remain the same, e.g. when building a player based on FFmpeg.
Individual build instructions come with each module (see below). When you're trying to integrate the MPEG-H Audio decoder into an existing framework, the following application notes could be useful:
- Enable MPEG-H support in FFmpeg
- Enable MPEG-H support in Media3/ExoPlayer based application
- Enable MPEG-H support in GStreamer
- Implement MPEG-H support in TV and STB
- Interactivity Handling for TV 3.0 Applications (Brazil DTV+)
- Android MPEG-H offload playback and UI handling
Below is a list of source releases related to MPEG-H Audio, published by Fraunhofer IIS on GitHub. These projects provide tools, libraries, and reference implementations for working with MPEG-H Audio in various contexts.
The Fraunhofer C/C++ implementation of the MPEG-H Audio standard (ISO/IEC 23008-3), supporting immersive and interactive audio decoding. Includes command-line tools for decoding and interactivity handling. This project includes the MPEG-H UI Manager component for handling MPEG-H user interactivity.
A C++ implementation of the ISO base media file format (ISO/IEC 14496-12), MP4 file format (ISO/IEC 14496-14), and parts of ISO/IEC 14496-15.
A C implementation of the IEC 61937-13:2018 standard, covering encapsulation of MPEG-H bitstreams in IEC data bursts for digital audio interfaces, e.g. HDMI.
A library capable of translating MPEG-H UI AudioScene and ActionEvent objects between the MPEG-H UI manager XML format and a JSON representation for application standards, e.g. TV 3.0 in Brazil.
A library for parsing MPEG-H Audio Stream (MHAS) packets, e.g. for analyzing and processing MPEG-H audio streams.
A library and tool to convert raw MHA packets, that are sometimes used in mp4 files, into self-contained MHAS stream packets. MHA is a legacy format and should not be used anymore.
A parser for extracting and analyzing the MPEG-H Audio configuration structure (mpegh3daConfig()).
A small collection of data types and algorithms used by a few of the above libraries.
A collection of test bitstreams used by several of the above projects.
A software component for rendering advanced user interfaces for the MPEG-H Audio standard (ISO/IEC 23008-3) in modern browser environments.
Visit the MPEG-H Audio website for more information, technical resources, and contact details.
This page is intended as an entry point for newcomers to MPEG-H Audio and MPEG-H related source projects.