缩放后端视频和音频处理
我使用 node.js、PostgreSQL、rabbitmq、EC2 with EBS 和 Kubernetes 制作了一个用于视频和音频转码的应用程序。
我有点担心存储大小和计算能力。计算能力容易解决,但存储问题更大。 最好的解决方案是自动扩展存储大小,但我不确定 Kubernetes 是否支持这一点。
现在我正在考虑将 EC2 更换为带有 Hadoop hdfs 的裸机,但我觉得这有点过分了。
第二个想法是购买一些 ec2 实例,并为每个实例添加自己的 EBS,但我再次不确定 Kubernetes 是否支持这种想法,最后每个 EC2 实例都需要访问另一个 EC2 EBS 存储。
你怎么认为?也许有一种更简单、更便宜的方法。
I made an app for video and audio transcoding using node.js, PostgreSQL, rabbitmq, EC2 with EBS, and Kubernetes.
I am a little bit worried about storage size and computing power. Computing power is easy to solve but storage is more problematic.
The best will be a solution that automatically scales storage size but I am not sure if Kubernetes supports that.
Right now I am thinking of swapping EC2 to bare metal with Hadoop hdfs but I feel it is overkill.
The second idea is to buy a few instances of ec2 and for every instance add own EBS, but again I am not sure if Kubernetes supports such think, at the end every EC2 instance need access to another EC2 EBS storage.
What do you think? Maybe there is an easier and cheaper way.
如果你对这篇内容有疑问,欢迎到本站社区发帖提问 参与讨论,获取更多帮助,或者扫码二维码加入 Web 技术交流群。
绑定邮箱获取回复消息
由于您还没有绑定你的真实邮箱,如果其他用户或者作者回复了您的评论,将不能在第一时间通知您!
发布评论
评论(1)
因此,既然您使用的是 AWS,那么您可以考虑的一件事就是使用 EFS(弹性文件系统)作为卷类型。通过将 EFS 配置程序和 EFS 存储类添加到集群,您可以利用 EFS 提供的动态大小调整。您不必担心空间不足。
您可以在此处查看 efs provsioner!
我一直在将这种存储类用于其他读/写不太密集的应用程序,并且取得了很大的成功!您还可以跨多个可用区挂载卷,这样您就可以获得 HA(高可用性)!
So one thing you can consider since you are on AWS is to use EFS (elastic file system) as a volume type. By adding the EFS provisioner and EFS storage class to your cluster, you can make use the dynamic sizing that EFS gives you. you wont have to worry about running out of space.
You can check out the efs provsioner here!!
I have been using this storage class for other applications that are not too intense on read/writes and have had a lot of success with it! You also can mount the volume across multiple AZs so you get HA (high availability) as a plus!