<p>I have two video clips of the same music video. Both are made of the same video and audio tracks but of different sources and quality.</p>
<p>One of them is a rip from an officially released media, so the video/audio synchronization in it can be used as reference.</p>
<p>The other was made by muxing video and audio streams from different unrelated sources. Whereas they appear perfectly in sync to human eye and ear resembling the original, I would like to somehow gauge it with sample-perfect precision to see how close the sync to the original actually is.</p>
<p>I can use some video players to nagivate frame-by-frame to the same frame in both clips. But I don't know how to see the accurate position in the audio waveform which that frame corresponds to (to be perfectly clear, the brackets encompassing the audio fragment corresponding to a particular video frame). What tools can I use for this?</p>
<p>Ideally I want the tool to tell me something like &quot;your second clip's audio is muxed 0.0005 seconds behind comparing to the reference clip&quot;. I will then use that 0.0005 seconds result to correct the second clip by re-muxing it with the right offset.</p>

CC BY-SA 4.0
2020-07-05T13:07:56.060Z
I don't understand the question. You said audio is perfectly in sync judging by your eyes and ears. Anyway, you cannot get more precise than 0.01 - 0.04 seconds depending on fps of the video. To me it seems you're chasing a ghost problem.
Matt
CC BY-SA 4.0
2020-07-05T14:06:18.547Z
@Matt Let's say I'm chasing 0.04 s for pure perfectionism purposes. Eyes/ears won't detect 0.04 s out-of-sync, will they? I want to detect and negate that.
Greendrake
CC BY-SA 4.0
2020-07-05T14:10:38.723Z
@Matt Actually, why would audio sync precision depend on fps? While a frame is frozen on the screen for a split of a second, the audio keeps playing continuously. You can move it backwards or forwards with its sampling precision (e.g. 1/48000 s).
Greendrake
CC BY-SA 4.0
2020-07-05T18:20:24.437Z
Humans can detect off-sync audio from around 0.045 s or 0.1 s depending on who you ask. You're right, you can align the audio signal as precisely as the audio sampling rate. But you need to decide to what frame to align but you only get a new frame every 0.04s for example. What if you want to sync to a drum stick hit on a hi-hat but the stick is in one frame far from the hi-hat and in the next one already touches it? The hit is somewhere in between those two frames. You can't tell by how much to move the audio signal back or forth. That's what I meant.
Matt
CC BY-SA 4.0
2020-07-06T01:36:08.257Z
@Matt The stick hit will be somewhere inside the frame previous to the first one where the stick touches the hit-hat. And yes I can tell how much to move the audio signal because I can see where _exactly_ the hit is in the frame in the reference video. Just need a tool to magnify and measure it with precision, which is what this question is about.
Greendrake
<video><audio><sync>
How to compare the audio/video synchronization in video clips?
Greendrake
# How to compare the audio/video synchronization in video clips?

(Asked by: username_0 on 2020-07-05)

I have two video clips of the same music video. Both are made of the same video and audio tracks but of different sources and quality.

One of them is a rip from an officially released media, so the video/audio synchronization in it can be used as reference.

The other was made by muxing video and audio streams from different unrelated sources. Whereas they appear perfectly in sync to human eye and ear resembling the original, I would like to somehow gauge it with sample-perfect precision to see how close the sync to the original actually is.

I can use some video players to nagivate frame-by-frame to the same frame in both clips. But I don't know how to see the accurate position in the audio waveform which that frame corresponds to (to be perfectly clear, the brackets encompassing the audio fragment corresponding to a particular video frame). What tools can I use for this?

Ideally I want the tool to tell me something like "your second clip's audio is muxed 0.0005 seconds behind comparing to the reference clip". I will then use that 0.0005 seconds result to correct the second clip by re-muxing it with the right offset.

**Tags:** video, audio, sync

> **Comments:**
> **username_1**: I don't understand the question. You said audio is perfectly in sync judging by your eyes and ears. Anyway, you cannot get more precise than 0.01 - 0.04 seconds depending on fps of the video. To me it seems you're chasing a ghost problem.  
> **username_0**: @username_1 Let's say I'm chasing 0.04 s for pure perfectionism purposes. Eyes/ears won't detect 0.04 s out-of-sync, will they? I want to detect and negate that.  
> **username_0**: @username_1 Actually, why would audio sync precision depend on fps? While a frame is frozen on the screen for a split of a second, the audio keeps playing continuously. You can move it backwards or forwards with its sampling precision (e.g. 1/48000 s).  
> **username_1**: Humans can detect off-sync audio from around 0.045 s or 0.1 s depending on who you ask. You're right, you can align the audio signal as precisely as the audio sampling rate. But you need to decide to what frame to align but you only get a new frame every 0.04s for example. What if you want to sync to a drum stick hit on a hi-hat but the stick is in one frame far from the hi-hat and in the next one already touches it? The hit is somewhere in between those two frames. You can't tell by how much to move the audio signal back or forth. That's what I meant.  
> **username_0**: @username_1 The stick hit will be somewhere inside the frame previous to the first one where the stick touches the hit-hat. And yes I can tell how much to move the audio signal because I can see where _exactly_ the hit is in the frame in the reference video. Just need a tool to magnify and measure it with precision, which is what this question is about.  

---

## 0 answers

