Open LossLess in STanDards
An open effort to standardize open formats.
In cases where digital loss is not acceptable, lossless data compression has been changing the way the world stores and transmits its data. Nowadays most digital office documents use lossless compression (.docx, .xlsx, .odt, .pages) and lossless images are more ubiquitous (.png). Although uncompressed digital storage is an option, uncompressed data generally contains no fixity mechanisms and generates e-waste at a much faster rate than lossless formats. When the preservation of quality is a requirement, lossless compression is the green option.
Although lossless formats have been well adopted for images, documents and other media types, the adoption of lossless formats for audiovisual recordings has been much slower. Given the opportunity for lossless compression in audiovisual media, we also propose a focus on open formats, meaning:
- NO PATENT — freedom to read, write, and use the format
- NO PAYWALL — freedom to read, understand, and share the format's specification
- NO PROHIBITIONS — freedom to modify and distribute the format
We propose accelerating the implementation of lossless audiovisual formats with the following coordinated efforts:
- coordinated registration efforts for lossless formats with principal audiovisual standards organizations (IANA, IETF, ISO, SMPTE, at least)
- open documentation efforts of open, lossless audiovisual formats for relevant communities
- advocacy and promotion of open, lossless audiovisual formats to media application developers (both proprietary and open source)
Following with the work of the PREFORMA project we are focused on 3 open lossless formats:
- Matroska, a file container with the ability to transport various media streams
- FFV1, a lossless video coding format
- FLAC, a lossless audio coding format
This focus is not specific to the arrangement of these formats but regards their use in other contexts as well, such as using FFV1 in the MXF format or FLAC wrapped in the QuickTime format.
This page lists a summary of what we are doing regarding the registration of these formats in standard bodies used by people and organizations working with open lossless formats.
Note: Standardization of the formats themselves is excluded from this summary. It is part of the IETF CELLAR Working Group.
FFV1: Currently using the AVI compatibility layer (similar to early version of AVC support), with active discussion about instead having a dedicated codec identifier (also similar to current version of AVC support).
If we decide to move, we need to do a PR on the Matroska public repository.
FLAC: Completed prior to this initiative. ("A_FLAC" identifier), source.
For HTTP(S)/RTP servers...
Similar to MIME Type Registration for MPEG-4.
- Fill out a IANA form for media-types.
- Matroska: registering video/matroska (1+ video), audio/matroska (0 video, 1+ audio), and application/matroska (0 video, 0 audio, 1+ other)
- FFV1: Registering "video/FFV1".
- FLAC: Registering "audio/FLAC".
See the mp4ra request page for more information.
- FFV1: Registering "FFV1".
- FLAC: Registering "FLAC".
A draft proposal of the request is available for comment at Proposal.
- Standardize the implementation of FFV1 and FLAC within the MXF container. Standard subscriber fees have already been provided by Jérôme Martinez.
- Attend physical SMPTE meetings in support of work to standardize FLAC and FFV1 in MXF.
FFmpeg is an open source, cross-platform solution to record, convert and stream audio and video.
After/during registering, we will need to update FFmpeg in order to have a reference tool for the new codec identifiers.
|Entity||Format||Begin||In specs||In FFmpeg||Remarks|
|Matroska||FLAC||N/A||Already done||Already done?|
|QuickTime||FFV1||2017-02-16||Proposal, same as FFV1/MP4|
- 2017-01-27 MXF, discussion with MrMXF.
- 2017-02-04 Matroska, proposal of V_FFV1 (FFV1 in Matroska) on CELLAR.
- 2017-02-05 Matroska, FFV1 in Matroska PR is accepted.
- 2017-02-11 First draft of proposal for FFV1 and FLAC in MXF written
- 2017-02-11 Global, public communication about this page
Based on $100/hour labor, here are the cost estimates for completing project goals.
- Matroska: $100 labor to begin discussion about V_FFV1 and PR
- Matroska: $400 to register V_FFV1 for FFmpeg patch
- IANA: $400 for administrative tasks associated with registration
- MP4/QuickTime: $200 labor for administrative tasks
- MXF: $3000-10,000 for SMPTE (writing, travels) and FFmpeg patch (to be defined)
|Digital Library Standards Subscription||SMPTE||2017-02-21||$540.00|
- PREFORMA, project co-funded by the European Commission is focused on Matroska and FFV1 standardization; Matroska and IANA registration is included in the sponsorship of MediaConch.
- Other: You?