我想在Kubernetes上运行很多Pyflink作业，那里处理的状态和事件数量很小，因此我想在群集中使用尽可能少的内存，以便我可以大部分包装包装。有效。我每次工作都经营一个弗林克集群。我目前正在尝试查看我可以如何制作内存设置。
我设置 taskManager.memory.process.size：512MB 在我的Flink Config中。该容器正在以 512MI 的要求内存开始。
当我的TaskManager启动时，我会收到一条错误消息：
IllegalConfigurationException：配置框架堆内存的总和
（128MB），框架离容器内存（128MB），任务外存储器（0
字节），托管内存（25.6MB）和网络内存（64MB）超过
配置的总截数（64MB）。
我对文档的理解（）是我只需要设置taskmanager.memory.memory.memory.process.process.size。 64MB的数字来自哪里，构成了总截形记忆？我该如何更改？
I'm wanting to run quite a number of PyFlink jobs on Kubernetes, where the amount of state and number of events being processed is small and therefore I'd like to use as little memory in my clusters as possible so I can bin pack most efficiently. I'm running a Flink cluster per job. I'm currently trying to see how small I can make the memory settings.
I set taskmanager.memory.process.size: 512mb in my Flink config. The container is being started with requested memory of 512Mi.
When my TaskManager starts up, I get an error message:
IllegalConfigurationException: Sum of configured Framework Heap Memory
(128mb), Framework Off-Heap Memory (128mb), Task Off-Heap Memory (0
bytes), Managed Memory (25.6mb) and Network Memory (64mb) exceed
configured Total Flink Memory (64mb).
My understanding of the docs (https://nightlies.apache.org/flink/flink-docs-release-1.14/docs/deployment/memory/mem_setup_tm/) is that I should just need to set taskmanager.memory.process.size. Where is the 64mb figure coming from which makes up the Total Flink Memory? How do I change this?
发布评论