用于测量唇形同步的 YUV/PCM 可视化工具
我有两个来自编码器的原始视频和原始音频的转储文件,我希望能够测量“唇形同步”。 想象一下锤子敲击铁砧的视频。 我想逐帧查看,当锤子最终击中铁砧时,音轨上会出现振幅尖峰。
由于一切发生的速度都很快,我不能仅仅听音频,我需要查看时域波形。
有没有可以让我同时观看视频和音频的工具?
I have a two dump files of raw video and raw audio from an encoder and I want to be able to measure the "Lip-sync". Imagine a video of a hammer striking an anvil. I want to go frame by frame and see that when the hammer finally hits the anvil, there is a spike in amplitude on the audio track.
Because of the speed that everything happens at, I cannot merely listen to the audio, i need to see the waveform in time domain.
Are there any tools out there that will let me see both the video and audio?
如果你对这篇内容有疑问,欢迎到本站社区发帖提问 参与讨论,获取更多帮助,或者扫码二维码加入 Web 技术交流群。
绑定邮箱获取回复消息
由于您还没有绑定你的真实邮箱,如果其他用户或者作者回复了您的评论,将不能在第一时间通知您!
发布评论
评论(1)
如果您担心验证解码器,那么通常从验证的角度来看,目标是根据通用实时时钟检查音频和视频 PTS 值。
原始 YUV 和 PCM 文件不包含时间戳。 如果您知道帧速率和采样率,您可以使用原始 yuv 文件查看器(我自己编写的)来计算视频中给定帧的时间(从文件开始) ,以及像 Audacity 这样的工具,可以计算出音频文件中从文件开始到音调开始的时间。 这仍然可能无法告诉您整个故事,因为工具通常会在 ts/ps 文件中的音频和视频之间嵌入延迟。 或者您也可以连接 OScope 并继续老方法。
If you are concerned about validating a decoder then generally from a validation perspective the goal is to check Audio and Video PTS values against a common real time clock.
Raw YUV and PCM files do not include timestamps. If you know the frame-rate and sample-rate you can use a raw yuv file viewer (I wrote my own) to figure out the time (from start of file) of a given frame in the video, and a tool like Audacity to figure out the time form start of file to a start of tone in the audio file. this still may not tell you the whole story since tools usually embed a delay between the audio and video in the ts/ps file. Or you can hook up ab OScope and go old school.