用于评估计算机视觉算法的模拟和合成视频生成

发布于 2024-08-15 08:19:25 字数 434 浏览 6 评论 0原文

我正在寻找一种简单的方法来生成合成视频来测试计算机视觉软件。

目前我只知道一种针对这一需求的工具: ObjectVideo 虚拟视频 (OVVV)。它是一个《HalfLife 2》模组,允许在虚拟世界中模拟摄像机。

但我正在寻找一种更开放(例如开源)并且可能是可移植的解决方案。一种方法是在十几个开源 3D 引擎之一上实现所需的功能。不过,如果有人知道已经实现了 OVVV 之类功能的库或工具,那就太好了。

另外,如果您没有现成的解决方案:您将如何解决该问题?

PS:我在这里问的原因是我想尽量减少我在这个问题上花费的精力。这并不是说我不知道​​该怎么做。但我的解决方案需要我投入大量时间。所以我在这里寻找具体的技巧......:-)

I am looking for an easy way to generate synthetic videos to test computer vision software.

Currently I am only aware of one tool that targets this need:
ObjectVideo Virtual Video (OVVV). It is a HalfLife 2 mod that allows to simulate cameras in a virtual world.

But I am looking for a more open (like in open source) and maybe portable solution. One way would be to implement the needed functionality on top of one of the dozen open-source 3D engines. Though, it would be great if somebody knows a library or tool that already implements something like OVVV does.

Also, if you do not no a ready-to-use solution: how would you tackle the problem?

PS: The reason I ask here is that I want to minimize my efforts spent on this issue. It's not that I had no idea how to do it. But my solutions would require me to invest to much time into this. So I am looking for concrete tips here ... :-)

如果你对这篇内容有疑问,欢迎到本站社区发帖提问 参与讨论,获取更多帮助,或者扫码二维码加入 Web 技术交流群。

扫码二维码加入Web技术交流群

发布评论

需要 登录 才能够评论, 你可以免费 注册 一个本站的账号。

评论(3

你好,陌生人 2024-08-22 08:19:25

如果我处于您的情况,我可能会使用 POV-Ray,因为可以用任何语言编写代码来生成 .pov 文件来提供它。当精确的几何、光照、纹理和复杂的精确运动很重要时,这非常有用。 POV-Ray 可以完全从命令行运行,也可以通过 system() 调用或等效程序以编程方式运行。

尽管 POV-Ray 不是通常意义上的开源,但它是免费的,您可以获得它的源代码。

If I were in your situation, I'd probably use POV-Ray since it's possible to write code in any language to produce .pov files to feed it. This is great where precise geometry, lighting, textures and complex exact motions are important. POV-Ray can be run entirely from the command line or programmatically with a system() call or equivalent.

Although POV-Ray isn't open source in the usual sense, it is free and you can get the source for it.

愛上了 2024-08-22 08:19:25

使用开源游戏引擎之一怎么样?如果我没记错的话,Quake 引擎现在属于公共领域,它可能足以满足您的需求。

大多数引擎提供用于 AI 和对象行为的脚本功能(通常是 Lua),但可以轻松提供您所需的可编程性。

编辑:以编程方式将噪声/失真和其他后处理效果应用于视频的技巧

编写的简短脚本AviSynth 将提供模糊、失真、对比度/帧速率变化、噪声添加以及许多其他可能的效果。这些效果是逐帧动态提供的,因此您无需将输出“渲染”到巨大的视频文件进行测试。视频程序将像普通视频一样对待脚本文件,尽管在播放过程中需要更多的 CPU。因此,您可以为计算机视觉包提供一堆 AviSynth 脚本进行测试,这些脚本可能全部来自同一视频源,但应用不同级别的噪声、模糊等。可以在测试中节省大量时间和磁盘空间!

我认为他们的网站暂时关闭了,但是你可以在任何地方找到 DL 它的软件包,因为它是开源的并且被广泛使用。

What about using one of the open source game engines? If I recall correctly, the Quake engine is now in the public domain, and it may be sufficient for your needs.

Most of the engines provide scripting features (often Lua) intended for AI and object behaviors, but which could easily provide the programmability you need.

Edit: Tricks for applying noise/distortion and other post-processing effects programmatically to video

A short script written in AviSynth will provide blur, distortion, contrast/frame-rate changes, noise addition, and a host of other possible effects. These effects are provided on the fly on a frame-by-frame basis, so you don't need to "render" the output to a huge video file for testing. Video programs will treat the script files like a normal video, albeit with more CPU needs during playback. So, you can feed your computer vision package a bunch of AviSynth scripts for testing, which may all feed from the same video source, but apply different levels of noise, blur, etc. Could save a LOT of time and disk space in testing!

Their site is briefly down, I think, but you can find the packages to DL it everywhere, since it is open source and widely used.

逆光下的微笑 2024-08-22 08:19:25

我见过 Ogre 用于此目的。

I've seen Ogre used for this exact purpose.

~没有更多了~
我们使用 Cookies 和其他技术来定制您的体验包括您的登录状态等。通过阅读我们的 隐私政策 了解更多相关信息。 单击 接受 或继续使用网站,即表示您同意使用 Cookies 和您的相关数据。
原文