Flink WebUI日志失败,Jobmanager总是关闭Kubernetes
使用独立的Kubernetes应用程序群集(部署模式为应用程序),
Flink版本为1.14.4,在Kubernetes,独立applicationn模式
部署步骤和yaml使用:
- //nightlies.apache.org/flink/flink-docs-release-1.14/docs/deployment/Resource-Providers/standalone/standalone/kubernetes/#application-mode-mode-mode-mode-mode-mode-mode 在kubernetes中运行,但是日志无法在flink-webui中查看,只能通过“ kubectl logs”或“ docker logs”
- 在瞬间重新启动然后关闭,不确定
对记录问题的记录问题,搜索一些解决方案,但也无法确定一些解决方案,但也无法确定。在我的情况下工作,或者仅查看Taskmanager Stdout,而没有Jonmanager日志或Stdout;现在,JobManager关闭现在不知道
console的一些记录器错误信息:
错误statuslogger重新配置失败:在'null'in'null'
中找不到针对'74a14482'的配置未知的taskexecutorexception:no taskexecutor在10.244.0.85:6122-cbd9ad下注册。
错误org.apache.flink.runtime.rest.handler.taskmanager.taskmanagerstdoutfilehandler [] - 无法从taskexecutor传输文件10.244.0.85:6122 -b815fd。 java.util.concurrent.completionexception:org.apache.flink.util.flinkexception:taskexecutor上不存在文件stdout。
thread-20错误无法在类org.apache.logging.log4j.core.core.appender.rollingfileappender中调用出厂方法,用于元素rollingfile:java.lang.illegalstateException:no for Class org.apache.logging.logging.logging.logging.logging.logging.logging.logging.logging.logging.logging.logging.logging.logging.logging.log4J 。
错误无法创建类型类别org.apache.logging.log4j.core.core.appender.rollingfileappender的插件,用于元素rollingfile:java.lang.illang.illegalstateexception:managerfactory [org.apache.loging.logging.logging.logging.logging.log4j.core.appender.appender.abpender.rolllolllolllolling.Rollling-Rolling-Rolling-Rolling-Rolling。 RollingFileManager $ rollingFileManagerFactory@778d1062]无法使用数据[org.apache.logging.loggoge.log4j.core.appender.rolling.rollingfilemanagerquremenagerqulqualfactorydata@factorydata@7a64d6ab [pattern =。 bufferSize=8192, policy=CompositeTriggeringPolicy(policies=[SizeBasedTriggeringPolicy(size=104857600)]), strategy=DefaultRolloverStrategy(min=1, max=10, useMax=true), advertiseURI=null, layout=%d{yyyy-MM- DD HH:MM:SS,SSS}%-5p%-5p%-60C%X-%m%N,filePermissions = null,fileowner = null]] java.lang.illang.illegalstateexception:managerfactory [org.apache.loggace.logging.logging.logging.logging.log4j.core。 appender.rolling.RollingFileManager$RollingFileManagerFactory@778d1062] unable to create manager for [] with data [org.apache.logging.log4j.core.appender.rolling.RollingFileManager$FactoryData@7a64d6ab[pattern=.%i, append=false, bufferedio = true,buffersize = 8192,策略= compitetriggeringPolicy(policies = [sizeBasedTriggeringPolicyPolicy(size = 104857600)])),策略= DefaultrolloverStrategy(min = 1,max = 1,max = 10,usemax = true),usemax = true = true) YYYY-MM-DD HH:MM:SS,SSS}%-5p%-60C%x-%m%n,filepermissions = null,fileAller = null]]
globaleventexecutor-1-1错误null对象返回附录中的rollingfile对象。 globaleventexecutor-1-1错误无法在logger配置“ root”中找到appender“ rollingfileappender” 线程-20错误无法创建文件java.io.io.ioexception:no这样的文件或目录,在java.io.unixfilesystem.createfileexclusively(本机方法)
globalEventExecutor-1-1 ERROR Unable to invoke factory method in class org.apache.logging.log4j.core.appender.RollingFileAppender for element RollingFile: java.lang.IllegalStateException: No factory method found for class org.apache.logging 。
2022-04-20 01:41:09,138 info org.apache.flink.runtime.entrypoint.clusterentrypoint [] - 接收信号15:sigterm。根据要求关闭。 2022-04-20 01:41:09,140 info org.apache.flink.runtime.entrypoint.clusterentrypoint [] - 闭合独立的clustrusterrentrypoint,以应用程序状态未知。诊断群集入口点已在外部关闭。 2022-04-20 01:41:09,142信息org.apache.flink.runtime.jobmaster.jobmaster.minidispatcherrestendpoint [] - 关闭REST端点。 2022-04-20 01:41:09,146信息org.apache.flink.runtime.blob.blobserver [] - 在0.0.0.0.0:6124停止Blob服务器 2022-04-20 01:41:09,184 globaleventexecutor-1-1错误无法找到logger config的appender“ rollingfileappender” 2022-04-20 01:41:09,357线程-48错误无法在logger配置“ root”中找到appender“ rollingfileappender” 2022-04-20 01:41:09,397 info akka.remote.remoteactorrefprovider $ semotingterminator [] - 关闭远程守护程序。 2022-04-20 01:41:09,397 info akka.remote.remoteactorrefprovider $ semotingterminator [] - 关闭远程守护程序。 2022-04-20 01:41:09,404信息akka.remote.remoteactorrefprovider $ semotingterminator [] - 远程守护程序关闭;进行冲洗远程运输。 2022-04-20 01:41:09,406信息akka.remote.remoteactorrefprovider $ remotingterminator [] - 远程守护程序关闭;进行冲洗远程运输。 2022-04-20 01:41:09,453信息akka.remote.remoteactorrefprovider $ remeTingTerminator [] - 远程关闭。 2022-04-20 01:41:09,455信息akka.remote.remoteactorrefprovider $ remotingterminator [] - 远程关闭。
全部!
deployed a flink with Standalone Kubernetes Application Cluster(Deployment Modes is Application),
flink version is 1.14.4, and run in kubernetes, standalone-applicationn mode
deploy steps and yaml use:
https://nightlies.apache.org/flink/flink-docs-release-1.14/docs/deployment/resource-providers/standalone/kubernetes/#application-mode
problems:
- the flink is running in kubernetes, but the logs cannot view in the flink-webui, only through "kubectl logs" or "docker logs"
- after a moment jobmanager restart then shutdown , not sure also the logger problem
about logger problem, search some solutions but cannot work in my case or just only see taskmanager stdout and no jonmanager logs or stdout; and jobmanager shutdown no idea now
some logger error info from console:
ERROR StatusLogger Reconfiguration failed: No configuration found for '74a14482' at 'null' in 'null'
UnknownTaskExecutorException: No TaskExecutor registered under 10.244.0.85:6122-cbd9ad.
ERROR org.apache.flink.runtime.rest.handler.taskmanager.TaskManagerStdoutFileHandler [] - Failed to transfer file from TaskExecutor 10.244.0.85:6122-b815fd.
java.util.concurrent.CompletionException: org.apache.flink.util.FlinkException: The file STDOUT does not exist on the TaskExecutor.Thread-20 ERROR Unable to invoke factory method in class org.apache.logging.log4j.core.appender.RollingFileAppender for element RollingFile: java.lang.IllegalStateException: No factory method found for class org.apache.logging.log4j.core.appender.RollingFileAppender java.lang.IllegalStateException: No factory method found for class org.apache.logging.log4j.core.appender.RollingFileAppender
ERROR Could not create plugin of type class org.apache.logging.log4j.core.appender.RollingFileAppender for element RollingFile: java.lang.IllegalStateException: ManagerFactory [org.apache.logging.log4j.core.appender.rolling.RollingFileManager$RollingFileManagerFactory@778d1062] unable to create manager for [] with data [org.apache.logging.log4j.core.appender.rolling.RollingFileManager$FactoryData@7a64d6ab[pattern=.%i, append=false, bufferedIO=true, bufferSize=8192, policy=CompositeTriggeringPolicy(policies=[SizeBasedTriggeringPolicy(size=104857600)]), strategy=DefaultRolloverStrategy(min=1, max=10, useMax=true), advertiseURI=null, layout=%d{yyyy-MM-dd HH:mm:ss,SSS} %-5p %-60c %x - %m%n, filePermissions=null, fileOwner=null]] java.lang.IllegalStateException: ManagerFactory [org.apache.logging.log4j.core.appender.rolling.RollingFileManager$RollingFileManagerFactory@778d1062] unable to create manager for [] with data [org.apache.logging.log4j.core.appender.rolling.RollingFileManager$FactoryData@7a64d6ab[pattern=.%i, append=false, bufferedIO=true, bufferSize=8192, policy=CompositeTriggeringPolicy(policies=[SizeBasedTriggeringPolicy(size=104857600)]), strategy=DefaultRolloverStrategy(min=1, max=10, useMax=true), advertiseURI=null, layout=%d{yyyy-MM-dd HH:mm:ss,SSS} %-5p %-60c %x - %m%n, filePermissions=null, fileOwner=null]]
globalEventExecutor-1-1 ERROR Null object returned for RollingFile in Appenders.
globalEventExecutor-1-1 ERROR Unable to locate appender "RollingFileAppender" for logger config "root"
Thread-20 ERROR Unable to create file java.io.IOException: No such file or directory, at java.io.UnixFileSystem.createFileExclusively(Native Method)globalEventExecutor-1-1 ERROR Unable to invoke factory method in class org.apache.logging.log4j.core.appender.RollingFileAppender for element RollingFile: java.lang.IllegalStateException: No factory method found for class org.apache.logging.log4j.core.appender.RollingFileAppender java.lang.IllegalStateException: No factory method found for class org.apache.logging.log4j.core.appender.RollingFileAppender
jobmanager shutdown log:
2022-04-20 01:41:09,138 INFO org.apache.flink.runtime.entrypoint.ClusterEntrypoint [] - RECEIVED SIGNAL 15: SIGTERM. Shutting down as requested.
2022-04-20 01:41:09,140 INFO org.apache.flink.runtime.entrypoint.ClusterEntrypoint [] - Shutting StandaloneApplicationClusterEntryPoint down with application status UNKNOWN. Diagnostics Cluster entrypoint has been closed externally..
2022-04-20 01:41:09,142 INFO org.apache.flink.runtime.jobmaster.MiniDispatcherRestEndpoint [] - Shutting down rest endpoint.
2022-04-20 01:41:09,146 INFO org.apache.flink.runtime.blob.BlobServer [] - Stopped BLOB server at 0.0.0.0:6124
2022-04-20 01:41:09,184 globalEventExecutor-1-1 ERROR Unable to locate appender "RollingFileAppender" for logger config "root"
2022-04-20 01:41:09,357 Thread-48 ERROR Unable to locate appender "RollingFileAppender" for logger config "root"
2022-04-20 01:41:09,397 INFO akka.remote.RemoteActorRefProvider$RemotingTerminator [] - Shutting down remote daemon.
2022-04-20 01:41:09,397 INFO akka.remote.RemoteActorRefProvider$RemotingTerminator [] - Shutting down remote daemon.
2022-04-20 01:41:09,404 INFO akka.remote.RemoteActorRefProvider$RemotingTerminator [] - Remote daemon shut down; proceeding with flushing remote transports.
2022-04-20 01:41:09,406 INFO akka.remote.RemoteActorRefProvider$RemotingTerminator [] - Remote daemon shut down; proceeding with flushing remote transports.
2022-04-20 01:41:09,453 INFO akka.remote.RemoteActorRefProvider$RemotingTerminator [] - Remoting shut down.
2022-04-20 01:41:09,455 INFO akka.remote.RemoteActorRefProvider$RemotingTerminator [] - Remoting shut down.
thx all!!
如果你对这篇内容有疑问,欢迎到本站社区发帖提问 参与讨论,获取更多帮助,或者扫码二维码加入 Web 技术交流群。
绑定邮箱获取回复消息
由于您还没有绑定你的真实邮箱,如果其他用户或者作者回复了您的评论,将不能在第一时间通知您!
发布评论