AudioAlign: Audio Synchronization And Analysis Tool
AudioAlign is a tool written for research purposes to automatically synchronize audio and video recordings that have either been recorded in parallel at the same event or contain the same aural information.
AudioAlign is basically a GUI for the Aurio library with a little bit of glue code in between.
To see what AudioAlign can do, check the demo videos linked below.
AudioAlign has been developed for a research project with the goal to automatically synchronize audio and video recordings, recorded at the same time at the same event, e.g. a speech or a music concert. The idea was to synchronize all those videos taken from the crowd and combine them to
- generate multicamera cuts by switching between perspectives (video),
- create videos with full or at least better event coverage,
- replace bad quality audio or video tracks with better ones, or
- detect interesting moments (where many recordings have been captured at the same time).
AudioAlign can be used for a lot more uses cases though, including
- video mashups (video)
- comparison of live performances (video)
- synchronization of different cover interpretations (video)
- voice dubbing (video)
- ground truth creation (website)
- evaluation of fingerprinting algorithms
- Update Aurio
- Requires Visual Studio 2017 (due to Aurio update to .NET Standard 2.0 / .NET Core 2.0)
- Validate matches before executing aligment and show error message box if validation fails
- Show error message box if added file cannot be read
- Report progress during HK/CP match finding and filtering
- Concatenated tracks consisting of multiple files (hold
SHIFTkey when adding)
- Support for compressed audio and video file formats
- Close file handles after use
- see the Aurio changes for details
For questions and issues, please open an issue on the issue tracker. Commercial support, development and consultation is available through Protyposis Multimedia Solutions.
Building & Running
AudioAlign requires Visual Studio 2017 and the .NET Framework 4.6.2. It depends on Aurio, which is included as a Git submodule, and OxyPlot, which is automatically downloaded by Visual Studio through NuGet when compiling for the first time. Make sure that NuGet downloads are enabled by checking
Allow NuGet to download missing packages in
Tools -> Options -> NuGet Package Manager.
- Clone the repository and Aurio submodule:
git clone --recursive https://github.com/protyposis/AudioAlign.git
- Setup FFmpeg dependencies, see
AudioAlign.slnin Visual Studio and hit the Start button
Not available yet. If you have any questions, feel free to open an issue!
Controls & Shortcuts
- Audio and video files can be drag & dropped into the timeline
- Multiple files will be added as multiple tracks
SHIFTto add the files as a single concatenated track
- Navigating the multitrack view
- Click anywhere or drag the caret in the time scale to set the current (playback) position
SPACEto start/pause playback
- Vertically drag the bottom of a track to resize its height
- Scroll the mouse wheel to scale the time resolution (zoom into/out of the timeline) at the current position
CTRLto smoothly scroll the timeline
CTRL + SHIFTto page through the timeline
- Select a track by clicking its title bar
CTRLto select multiple tracks
SHIFTto select a range of tracks
- Move tracks on the timeline by dragging them horizontally
Copyright (C) 2010-2018 Mario Guggenberger email@example.com.
This project is released under the terms of the GNU Affero General Public License. See
LICENSE for details.