kafka雪花连接器 - 连接器错误后停止

发布于 2025-02-01 03:48:51 字数 2240 浏览 2 评论 0原文

我一直在检查所有Kafka雪花连接器帖子,但他们都没有谈论我遇到的问题。

我和Zookeper一起在本地安装了Kafka,也想运行一个雪花连接器,将数据从Kafka复制到Snowflake。

我运行Zookeeper,每件事看起来都正确:

zookeeper log

然后我启动了Kafka服务器同样:

服务器日志

当我启动Snowflake-kafka-connector时:

sh connect-standalone.sh /usr/local/kafka/kafka_2.11-1.1.0/config/connect-standalone.properties /usr/local/kafka/kafka_2.11-1.1.0/config/SF_connect.properties

但是, 以下:

[2022-05-27 10:41:37,380]信息完成创建Connector test_connector(org.apache.kafka.connect.runtime.worker:224) [2022-05-27 10:41:37,380]信息跳过连接器Kafkatest的重新配置,因为它不运行(org.apache.kafka.kafka.connect.runtime.standime.stance.stance.stance.standalone.standalone.stancealone.standaloneherder:285) [2022-05-27 10:41:37,381]连接器错误后停止错误(org.apache.kafka.connect.cli.cli.connectstandstance:113) java.lang.nullpoInterException:无法调用“ org.apache.kafka.connect.runtime.rest.rest.rest.resties.connectorinfo.name()”,因为org.apache.kafkace.kafka.kafka.kafka.connect.runtime.herder $ created.herder $ create.Rest.render $ rester.render $ rest.render $ rest.rest.rest.rest.rest.render created $ recust $ recust $ ()“无效 at org.apache.kafka.connect.cli.connectstandstalone $ 1.ONCOMPLETION(CONNECTSTANDANDANDALONE.JAVA:104) at org.apache.kafka.connect.cli.connectstandstalone $ 1.ONCOMPLETION(CONNECTSTANDANDANDALONE.JAVA:98) atrg.apache.kafka.connect.util.convertingfuturecallback.oncompletion(converttingfuturecallback.java:44) atrg.apache.kafka.connect.runtime.standalone.standaloneherder.putconnectorconfig(standalonehernerder.java:185) at org.apache.kafka.connect.cli.connectstandstalone.main(ConnectStandalOne.java:107) [2022-05-27 10:41:37,382] Info Kafka Connect停止(org.apache.kafka.connect.runtime.connect:65) [2022-05-27 10:41:37,382]信息停止REST服务器(org.apache.kafka.connect.runtime.rest.restserserver:211)

我试图找到有关问题的信息,但是我可以找到任何东西。你能帮我吗?

这是sf_connector.properties文件:

sf_connector.properties

谢谢!

I've been checking all the kafka snowflake connector posts but none of them talked about the issue I'm having.

I installed Kafka in local, with zookeper, and I also want to run a Snowflake connector, to copy data from Kafka towards Snowflake.

I run zookeeper, every thing looks right:

zookeeper log

Then I launch the kafka server, looks correct as well:

server log

However when I launch the snowflake-kafka-connector:

sh connect-standalone.sh /usr/local/kafka/kafka_2.11-1.1.0/config/connect-standalone.properties /usr/local/kafka/kafka_2.11-1.1.0/config/SF_connect.properties

, it breaks like this:

[2022-05-27 10:41:37,380] INFO Finished creating connector TEST_CONNECTOR (org.apache.kafka.connect.runtime.Worker:224)
[2022-05-27 10:41:37,380] INFO Skipping reconfiguration of connector kafkatest since it is not running (org.apache.kafka.connect.runtime.standalone.StandaloneHerder:285)
[2022-05-27 10:41:37,381] ERROR Stopping after connector error (org.apache.kafka.connect.cli.ConnectStandalone:113)
java.lang.NullPointerException: Cannot invoke "org.apache.kafka.connect.runtime.rest.entities.ConnectorInfo.name()" because the return value of "org.apache.kafka.connect.runtime.Herder$Created.result()" is null
at org.apache.kafka.connect.cli.ConnectStandalone$1.onCompletion(ConnectStandalone.java:104)
at org.apache.kafka.connect.cli.ConnectStandalone$1.onCompletion(ConnectStandalone.java:98)
at org.apache.kafka.connect.util.ConvertingFutureCallback.onCompletion(ConvertingFutureCallback.java:44)
at org.apache.kafka.connect.runtime.standalone.StandaloneHerder.putConnectorConfig(StandaloneHerder.java:185)
at org.apache.kafka.connect.cli.ConnectStandalone.main(ConnectStandalone.java:107)
[2022-05-27 10:41:37,382] INFO Kafka Connect stopping (org.apache.kafka.connect.runtime.Connect:65)
[2022-05-27 10:41:37,382] INFO Stopping REST server (org.apache.kafka.connect.runtime.rest.RestServer:211)

I tried to find information on what's the matter, but I can't find anything. Can you please help me on that?

This is the sf_connector.properties file:

sf_connector.properties

Thanks!

如果你对这篇内容有疑问,欢迎到本站社区发帖提问 参与讨论,获取更多帮助,或者扫码二维码加入 Web 技术交流群。

扫码二维码加入Web技术交流群

发布评论

需要 登录 才能够评论, 你可以免费 注册 一个本站的账号。
列表为空,暂无数据
我们使用 Cookies 和其他技术来定制您的体验包括您的登录状态等。通过阅读我们的 隐私政策 了解更多相关信息。 单击 接受 或继续使用网站,即表示您同意使用 Cookies 和您的相关数据。
原文