如何在播放时以编程方式真实地修改视频剪辑？
不久前，我在一家德国公司的网站上看到了一系列有趣的视频演示。他们处理在播放时修改视频流的问题，这种技术的准确性和流畅性给我留下了深刻的印象。在所有这些演示中，我认为其中一个在动态、播放中的文本混合方面非常令人着迷。视频。它允许您在视频播放时在文本框中输入字符串，并以真实的准确性嵌入您在视频中编写的文本的转换变体。我的问题是，如果您碰巧知道这样的功能需要什么样的算法，我如何以编程方式将实时文本和图像嵌入视频流中？有没有我应该查看的研究论文或图书馆以了解详细信息？
附言。不要因为视频的内容而激怒我，我感兴趣的是编程技术，视频是我能找到的最好的例子。
A while ago I came across an interesting array of video presentations on a German company's website. They deal with modifying a video stream while it's playing, and I remained pleasantly impressed by the accuracy and smoothness of this technique. Out of all these presentations, I considered one of them quite fascinating in terms of text blending within dynamic, playing video. It allows you to type in a string in a text box while the video is playing and embeds transformed variants of the text you wrote withing the video, with realistic accuracy. My question is if you would happen to know what kind of algorithm is required for such a feature, how could I programmatically embed real-time text and images in a video stream? Is there any research paper or library I should look into for details?
PS. Don't flame me for the contents of the video, it's the programming technique that I'm interested about, the video is the best example I could find.
如果你对这篇内容有疑问，欢迎到本站社区发帖提问 参与讨论，获取更多帮助，或者扫码二维码加入 Web 技术交流群。
绑定邮箱获取回复消息
由于您还没有绑定你的真实邮箱，如果其他用户或者作者回复了您的评论，将不能在第一时间通知您！
发布评论
评论（3）
它被称为增强现实，并且有许多库和工具包可用于执行此操作，例如 arttoolkit
http://www.hitl.washington.edu/artoolkit/
It's called augmented reality, and there's numerous libraries and toolkits available for doing so, such as artoolkit
http://www.hitl.washington.edu/artoolkit/
为此，您只需要在渲染帧之前对其进行调解即可。
基本上：
确实没有算法可以做到这一点。
To do this you would just need to intercede the frame before it is rendered.
Basically:
There really isn't an algorithm to do this.
好吧，我实际上看了你的例子。由于这是预先录制的视频，因此他们可以手动将盒子的四个角描到目标表面上。然后要进行渲染，您只需将文本透视变换到目标矩形即可。要使其混合，可能只是选择好的颜色、分层、颜色变换和透明度的艺术。这里没有什么特别神奇的地方，只是标准的 Photoshop 风格的图形算法，其中大部分可能只是内置于 Flash 中。
Okay so I actually looked at your example. Since this is prerecorded video, they could have just hand traced the four corners of a box onto the target surface. Then to render, you just do a perspective transform of your text, to the target rectangle. To make it blend was probably just the art of choosing good colors, layering, color transforms and transparency. Nothing particularly magic here, just standard photoshop style graphics algorithms, most of which are probably just built into flash.