Flink WebUI日志失败,Jobmanager总是关闭Kubernetes

发布于 2025-01-22 12:21:24 字数 4521 浏览 0 评论 0原文

使用独立的Kubernetes应用程序群集(部署模式为应用程序),

Flink版本为1.14.4,在Kubernetes,独立applicationn模式

部署步骤和yaml使用:

  1. //nightlies.apache.org/flink/flink-docs-release-1.14/docs/deployment/Resource-Providers/standalone/standalone/kubernetes/#application-mode-mode-mode-mode-mode-mode-mode 在kubernetes中运行,但是日志无法在flink-webui中查看,只能通过“ kubectl logs”或“ docker logs”
  2. 在瞬间重新启动然后关闭,不确定

对记录问题的记录问题,搜索一些解决方案,但也无法确定一些解决方案,但也无法确定。在我的情况下工作,或者仅查看Taskmanager Stdout,而没有Jonmanager日志或Stdout;现在,JobManager关闭现在不知道

console的一些记录器错误信息:

错误statuslogger重新配置失败:在'null'in'null'

中找不到针对'74a14482'的配置

未知的taskexecutorexception:no taskexecutor在10.244.0.85:6122-cbd9ad下注册。

错误org.apache.flink.runtime.rest.handler.taskmanager.taskmanagerstdoutfilehandler [] - 无法从taskexecutor传输文件10.244.0.85:6122 -b815fd。 java.util.concurrent.completionexception:org.apache.flink.util.flinkexception:taskexecutor上不存在文件stdout。

thread-20错误无法在类org.apache.logging.log4j.core.core.appender.rollingfileappender中调用出厂方法,用于元素rollingfile:java.lang.illegalstateException:no for Class org.apache.logging.logging.logging.logging.logging.logging.logging.logging.logging.logging.logging.logging.logging.logging.logging.log4J 。

错误无法创建类型类别org.apache.logging.log4j.core.core.appender.rollingfileappender的插件,用于元素rollingfile:java.lang.illang.illegalstateexception:managerfactory [org.apache.loging.logging.logging.logging.logging.log4j.core.appender.appender.abpender.rolllolllolllolling.Rollling-Rolling-Rolling-Rolling-Rolling。 RollingFileManager $ rollingFileManagerFactory@778d1062]无法使用数据[org.apache.logging.loggoge.log4j.core.appender.rolling.rollingfilemanagerquremenagerqulqualfactorydata@factorydata@7a64d6ab [pattern =。 bufferSize=8192, policy=CompositeTriggeringPolicy(policies=[SizeBasedTriggeringPolicy(size=104857600)]), strategy=DefaultRolloverStrategy(min=1, max=10, useMax=true), advertiseURI=null, layout=%d{yyyy-MM- DD HH:MM:SS,SSS}%-5p%-5p%-60C%X-%m%N,filePermissions = null,fileowner = null]] java.lang.illang.illegalstateexception:managerfactory [org.apache.loggace.logging.logging.logging.logging.log4j.core。 appender.rolling.RollingFileManager$RollingFileManagerFactory@778d1062] unable to create manager for [] with data [org.apache.logging.log4j.core.appender.rolling.RollingFileManager$FactoryData@7a64d6ab[pattern=.%i, append=false, bufferedio = true,buffersize = 8192,策略= compitetriggeringPolicy(policies = [sizeBasedTriggeringPolicyPolicy(size = 104857600)])),策略= DefaultrolloverStrategy(min = 1,max = 1,max = 10,usemax = true),usemax = true = true) YYYY-MM-DD HH:MM:SS,SSS}%-5p%-60C%x-%m%n,filepermissions = null,fileAller = null]]

globaleventexecutor-1-1错误null对象返回附录中的rollingfile对象。 globaleventexecutor-1-1错误无法在logger配置“ root”中找到appender“ rollingfileappender” 线程-20错误无法创建文件java.io.io.ioexception:no这样的文件或目录,在java.io.unixfilesystem.createfileexclusively(本机方法)

globalEventExecutor-1-1 ERROR Unable to invoke factory method in class org.apache.logging.log4j.core.appender.RollingFileAppender for element RollingFile: java.lang.IllegalStateException: No factory method found for class org.apache.logging 。

2022-04-20 01:41:09,138 info org.apache.flink.runtime.entrypoint.clusterentrypoint [] - 接收信号15:sigterm。根据要求关闭。 2022-04-20 01:41:09,140 info org.apache.flink.runtime.entrypoint.clusterentrypoint [] - 闭合独立的clustrusterrentrypoint,以应用程序状态未知。诊断群集入口点已在外部关闭。 2022-04-20 01:41:09,142信息org.apache.flink.runtime.jobmaster.jobmaster.minidispatcherrestendpoint [] - 关闭REST端点。 2022-04-20 01:41:09,146信息org.apache.flink.runtime.blob.blobserver [] - 在0.0.0.0.0:6124停止Blob服务器 2022-04-20 01:41:09,184 globaleventexecutor-1-1错误无法找到logger config的appender“ rollingfileappender” 2022-04-20 01:41:09,357线程-48错误无法在logger配置“ root”中找到appender“ rollingfileappender” 2022-04-20 01:41:09,397 info akka.remote.remoteactorrefprovider $ semotingterminator [] - 关闭远程守护程序。 2022-04-20 01:41:09,397 info akka.remote.remoteactorrefprovider $ semotingterminator [] - 关闭远程守护程序。 2022-04-20 01:41:09,404信息akka.remote.remoteactorrefprovider $ semotingterminator [] - 远程守护程序关闭;进行冲洗远程运输。 2022-04-20 01:41:09,406信息akka.remote.remoteactorrefprovider $ remotingterminator [] - 远程守护程序关闭;进行冲洗远程运输。 2022-04-20 01:41:09,453信息akka.remote.remoteactorrefprovider $ remeTingTerminator [] - 远程关闭。 2022-04-20 01:41:09,455信息akka.remote.remoteactorrefprovider $ remotingterminator [] - 远程关闭。

全部!

deployed a flink with Standalone Kubernetes Application Cluster(Deployment Modes is Application),

flink version is 1.14.4, and run in kubernetes, standalone-applicationn mode

deploy steps and yaml use:
https://nightlies.apache.org/flink/flink-docs-release-1.14/docs/deployment/resource-providers/standalone/kubernetes/#application-mode

problems:

  1. the flink is running in kubernetes, but the logs cannot view in the flink-webui, only through "kubectl logs" or "docker logs"
  2. after a moment jobmanager restart then shutdown , not sure also the logger problem

about logger problem, search some solutions but cannot work in my case or just only see taskmanager stdout and no jonmanager logs or stdout; and jobmanager shutdown no idea now

some logger error info from console:

ERROR StatusLogger Reconfiguration failed: No configuration found for '74a14482' at 'null' in 'null'

UnknownTaskExecutorException: No TaskExecutor registered under 10.244.0.85:6122-cbd9ad.

ERROR org.apache.flink.runtime.rest.handler.taskmanager.TaskManagerStdoutFileHandler [] - Failed to transfer file from TaskExecutor 10.244.0.85:6122-b815fd.
java.util.concurrent.CompletionException: org.apache.flink.util.FlinkException: The file STDOUT does not exist on the TaskExecutor.

Thread-20 ERROR Unable to invoke factory method in class org.apache.logging.log4j.core.appender.RollingFileAppender for element RollingFile: java.lang.IllegalStateException: No factory method found for class org.apache.logging.log4j.core.appender.RollingFileAppender java.lang.IllegalStateException: No factory method found for class org.apache.logging.log4j.core.appender.RollingFileAppender

ERROR Could not create plugin of type class org.apache.logging.log4j.core.appender.RollingFileAppender for element RollingFile: java.lang.IllegalStateException: ManagerFactory [org.apache.logging.log4j.core.appender.rolling.RollingFileManager$RollingFileManagerFactory@778d1062] unable to create manager for [] with data [org.apache.logging.log4j.core.appender.rolling.RollingFileManager$FactoryData@7a64d6ab[pattern=.%i, append=false, bufferedIO=true, bufferSize=8192, policy=CompositeTriggeringPolicy(policies=[SizeBasedTriggeringPolicy(size=104857600)]), strategy=DefaultRolloverStrategy(min=1, max=10, useMax=true), advertiseURI=null, layout=%d{yyyy-MM-dd HH:mm:ss,SSS} %-5p %-60c %x - %m%n, filePermissions=null, fileOwner=null]] java.lang.IllegalStateException: ManagerFactory [org.apache.logging.log4j.core.appender.rolling.RollingFileManager$RollingFileManagerFactory@778d1062] unable to create manager for [] with data [org.apache.logging.log4j.core.appender.rolling.RollingFileManager$FactoryData@7a64d6ab[pattern=.%i, append=false, bufferedIO=true, bufferSize=8192, policy=CompositeTriggeringPolicy(policies=[SizeBasedTriggeringPolicy(size=104857600)]), strategy=DefaultRolloverStrategy(min=1, max=10, useMax=true), advertiseURI=null, layout=%d{yyyy-MM-dd HH:mm:ss,SSS} %-5p %-60c %x - %m%n, filePermissions=null, fileOwner=null]]

globalEventExecutor-1-1 ERROR Null object returned for RollingFile in Appenders.
globalEventExecutor-1-1 ERROR Unable to locate appender "RollingFileAppender" for logger config "root"
Thread-20 ERROR Unable to create file java.io.IOException: No such file or directory, at java.io.UnixFileSystem.createFileExclusively(Native Method)

globalEventExecutor-1-1 ERROR Unable to invoke factory method in class org.apache.logging.log4j.core.appender.RollingFileAppender for element RollingFile: java.lang.IllegalStateException: No factory method found for class org.apache.logging.log4j.core.appender.RollingFileAppender java.lang.IllegalStateException: No factory method found for class org.apache.logging.log4j.core.appender.RollingFileAppender

jobmanager shutdown log:

2022-04-20 01:41:09,138 INFO org.apache.flink.runtime.entrypoint.ClusterEntrypoint [] - RECEIVED SIGNAL 15: SIGTERM. Shutting down as requested.
2022-04-20 01:41:09,140 INFO org.apache.flink.runtime.entrypoint.ClusterEntrypoint [] - Shutting StandaloneApplicationClusterEntryPoint down with application status UNKNOWN. Diagnostics Cluster entrypoint has been closed externally..
2022-04-20 01:41:09,142 INFO org.apache.flink.runtime.jobmaster.MiniDispatcherRestEndpoint [] - Shutting down rest endpoint.
2022-04-20 01:41:09,146 INFO org.apache.flink.runtime.blob.BlobServer [] - Stopped BLOB server at 0.0.0.0:6124
2022-04-20 01:41:09,184 globalEventExecutor-1-1 ERROR Unable to locate appender "RollingFileAppender" for logger config "root"
2022-04-20 01:41:09,357 Thread-48 ERROR Unable to locate appender "RollingFileAppender" for logger config "root"
2022-04-20 01:41:09,397 INFO akka.remote.RemoteActorRefProvider$RemotingTerminator [] - Shutting down remote daemon.
2022-04-20 01:41:09,397 INFO akka.remote.RemoteActorRefProvider$RemotingTerminator [] - Shutting down remote daemon.
2022-04-20 01:41:09,404 INFO akka.remote.RemoteActorRefProvider$RemotingTerminator [] - Remote daemon shut down; proceeding with flushing remote transports.
2022-04-20 01:41:09,406 INFO akka.remote.RemoteActorRefProvider$RemotingTerminator [] - Remote daemon shut down; proceeding with flushing remote transports.
2022-04-20 01:41:09,453 INFO akka.remote.RemoteActorRefProvider$RemotingTerminator [] - Remoting shut down.
2022-04-20 01:41:09,455 INFO akka.remote.RemoteActorRefProvider$RemotingTerminator [] - Remoting shut down.

thx all!!

如果你对这篇内容有疑问,欢迎到本站社区发帖提问 参与讨论,获取更多帮助,或者扫码二维码加入 Web 技术交流群。

扫码二维码加入Web技术交流群

发布评论

需要 登录 才能够评论, 你可以免费 注册 一个本站的账号。
列表为空,暂无数据
我们使用 Cookies 和其他技术来定制您的体验包括您的登录状态等。通过阅读我们的 隐私政策 了解更多相关信息。 单击 接受 或继续使用网站,即表示您同意使用 Cookies 和您的相关数据。
原文