Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Sync Audio #10

Open
sunwell1994 opened this issue Dec 6, 2021 · 4 comments
Open

Sync Audio #10

sunwell1994 opened this issue Dec 6, 2021 · 4 comments

Comments

@sunwell1994
Copy link

Thanks for the interesting audio. The phase alignment method is really helpful and the results are impressive. One more question is whether we can record the audio streaming with perfect synchronization. Based on the reference latency, it seems that we may get a delay of less than 20 microseconds for the image and audio stream after applying alignment to both audio and image. Is it true?

@Elucidation
Copy link
Collaborator

You'll need to quantify the latency of initiating audio streaming/recording. I think when we were looking into using audio chrips for synchronization the variable latency of starting/stopping audio streaming was much greater than 20 microseconds.

Assuming you can resolve that, you could indeed use the network sync portion of software sync to trigger the audio streaming, and that part of it should be < 20 us.

The phase alignment sync portion is for the cameras currently, so it may not be relevant to audio streaming unless you're also recording video.

@sunwell1994
Copy link
Author

You'll need to quantify the latency of initiating audio streaming/recording. I think when we were looking into using audio chrips for synchronization the variable latency of starting/stopping audio streaming was much greater than 20 microseconds.

Assuming you can resolve that, you could indeed use the network sync portion of software sync to trigger the audio streaming, and that part of it should be < 20 us.

The phase alignment sync portion is for the cameras currently, so it may not be relevant to audio streaming unless you're also recording video.

Thanks for sharing your experience. It is really helpful to remind me that the starting/stopping audio streaming is really large. I would like to record the video but I find that the video is not perfectly synced with audio.

Is the reset sampling method possible to fix the start of the audio stream into the target period? Since its variance is large, it may require many more iterations.

@Elucidation
Copy link
Collaborator

Is the reset sampling method possible to fix the start of the audio stream into the target period? Since its variance is large, it may require many more iterations.

Rough guess is yes but this would be complicated:
1 - You'll need to look into how audio streaming starts/stops relative to the video, and whether it takes a long time to restart it, and if the variability of the error is random enough that reset sampling is valid. Might be too long to be useful.
2 - You need some way to measure the offset error of the audio from the video, this might be easy if the audio stream has a separate start time stamp, but I haven't looked into this.

@sunwell1994
Copy link
Author

Thanks so much. Will try to figure out these challenges.

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
None yet
Projects
None yet
Development

No branches or pull requests

2 participants