如果您更喜欢编写代码而不是连接对象,那么您仍然可以在 Max 中使用 Java 或 Javascript。
我会说越简单越好,并且由于您的项目的输出是合理的,我会说 Max 是您最好的选择。
华泰
It very much depends on your setup.
You can do 2D frame differencing or 3D tracking with Kinect and MSP is great for audio synthesis/processing. Since you patch the code live, it should be a lot faster to prototype than the regular Processing/Java cycle (write code,compile,test,debug,repeat). If you're feeling comfortable with Max I would recommend it.
Otherwise, you can do the tracking with Processing, but I wouldn't recommend Processing for responsive audio applications. Depending on how much processing(video and audio) needs to be done, Java's Garbage Collector might kick in for a sweep of loitering objects when you least expect it and could cause delays and clicks in audio. Max is faster.
You could have a mix of the two, maybe using the OSC protocol between Processing and Max, but it mostly depends on your setup and skills.
If you're more comfortable writing code than wiring objects, you could still use Java or Javascript in Max.
I would say the simpler, the better, and since the output of your project is sound, I would say Max is your best bet.
You can go just with Max/MSP/Jitter and web camera. The basic way of translating image into the audio is the determine quantity of motion (QoM) and use it to control synthesis parameters. I would suggest you to start with this article: https://cycling74.com/2009/10/26/making-connections-camera-data/ — it has a basic info about it and ready-to-use patch to quickly start working.
我使用 Kinect 和 Synapse。 Synapse 包还提供 max patch,为您提供可以直接用作映射参数的所有身体信息(坐标)。
I used MAX/MSP for this because there are many open source stuff outthere.
I used Kinect with Synapse. The Synapse package also provide max patch that give you all the body information (coordinates) that you can directly use as mapping parameters.
发布评论
评论(3)
这很大程度上取决于您的设置。
您可以进行2D帧差分或使用 Kinect 和 MSP 进行 3D 跟踪非常适合音频合成/处理。由于您实时修补代码,因此原型制作应该比常规处理/Java 周期(编写代码、编译、测试、调试、重复)快得多。
如果您对 Max 感到满意,我会推荐它。
否则,您可以使用处理进行跟踪,但我不建议对响应式音频应用程序使用处理。根据需要完成的处理量(视频和音频),Java 的垃圾收集器可能会在您最意想不到的时候启动清理徘徊对象,并可能导致音频延迟和咔嗒声。麦克斯更快。
您可以混合使用两者,也许在Processing和Max之间使用OSC协议,但这主要取决于您的设置和技能。
如果您更喜欢编写代码而不是连接对象,那么您仍然可以在 Max 中使用 Java 或 Javascript。
我会说越简单越好,并且由于您的项目的输出是合理的,我会说 Max 是您最好的选择。
华泰
It very much depends on your setup.
You can do 2D frame differencing or 3D tracking with Kinect and MSP is great for audio synthesis/processing. Since you patch the code live, it should be a lot faster to prototype than the regular Processing/Java cycle (write code,compile,test,debug,repeat).
If you're feeling comfortable with Max I would recommend it.
Otherwise, you can do the tracking with Processing, but I wouldn't recommend Processing for responsive audio applications. Depending on how much processing(video and audio) needs to be done, Java's Garbage Collector might kick in for a sweep of loitering objects when you least expect it and could cause delays and clicks in audio. Max is faster.
You could have a mix of the two, maybe using the OSC protocol between Processing and Max, but it mostly depends on your setup and skills.
If you're more comfortable writing code than wiring objects, you could still use Java or Javascript in Max.
I would say the simpler, the better, and since the output of your project is sound, I would say Max is your best bet.
HTH
您可以只使用 Max/MSP/Jitter 和网络摄像头。将图像转换为音频的基本方法是确定运动量(QoM)并用它来控制合成参数。我建议您从这篇文章开始:https://cycling74。 com/2009/10/26/making-connections-camera-data/ — 它有关于它的基本信息和即用型补丁,可以快速开始工作。
You can go just with Max/MSP/Jitter and web camera. The basic way of translating image into the audio is the determine quantity of motion (QoM) and use it to control synthesis parameters. I would suggest you to start with this article: https://cycling74.com/2009/10/26/making-connections-camera-data/ — it has a basic info about it and ready-to-use patch to quickly start working.
我为此使用了 MAX/MSP,因为有很多开源的东西。
我使用 Kinect 和 Synapse。 Synapse 包还提供 max patch,为您提供可以直接用作映射参数的所有身体信息(坐标)。
I used MAX/MSP for this because there are many open source stuff outthere.
I used Kinect with Synapse. The Synapse package also provide max patch that give you all the body information (coordinates) that you can directly use as mapping parameters.