缺少所需的配置“名称”尝试Kafka时没有默认值
我的配置/sf_connect.properties文件
tasks.max=8
topics=topic1,topic2
snowflake.topic2table.map= topic1:table1,topic2:table2
buffer.count.records=10000
buffer.flush.time=60
buffer.size.bytes=5000000
snowflake.url.name=myorganization-myaccount.snowflakecomputing.com:443
snowflake.user.name=jane.smith
snowflake.private.key=xyz123
snowflake.private.key.passphrase=jkladu098jfd089adsq4r
snowflake.database.name=mydb
snowflake.schema.name=myschema
key.converter=org.apache.kafka.connect.storage.StringConverter
value.converter=com.snowflake.kafka.connector.records.SnowflakeAvroConverter
value.converter.schema.registry.url=http://localhost:8081
value.converter.basic.auth.credentials.source=USER_INFO
value.converter.basic.auth.user.info=jane.smith:MyStrongPassword
如下 丢失所需的配置“名称”,在尝试Kafka连接到雪花上没有默认值
Snowflake的正式文档指示名称是必需的参数。因此,我在上面的文件中添加了一个name = somerandomname
。它仍然不起作用。
这是完整的日志,即使是私钥和密码也无效(需要与管理员核对),
java.util.concurrent.ExecutionException: org.apache.kafka.connect.runtime.rest.errors.BadRequestException: Connector configuration is invalid and contains the following 3 error(s):
Missing required configuration "name" which has no default value.
snowflake.private.key is not valid
snowflake.private.key.passphrase is not valid
都需要上述一些帮助。官方文档链接在这里 https> https:// docs。 snowflake.com/en/user-guide/kafka-connector-install.html#configuring-the-kafka-connector
I have my config/SF_connect.properties file like below
tasks.max=8
topics=topic1,topic2
snowflake.topic2table.map= topic1:table1,topic2:table2
buffer.count.records=10000
buffer.flush.time=60
buffer.size.bytes=5000000
snowflake.url.name=myorganization-myaccount.snowflakecomputing.com:443
snowflake.user.name=jane.smith
snowflake.private.key=xyz123
snowflake.private.key.passphrase=jkladu098jfd089adsq4r
snowflake.database.name=mydb
snowflake.schema.name=myschema
key.converter=org.apache.kafka.connect.storage.StringConverter
value.converter=com.snowflake.kafka.connector.records.SnowflakeAvroConverter
value.converter.schema.registry.url=http://localhost:8081
value.converter.basic.auth.credentials.source=USER_INFO
value.converter.basic.auth.user.info=jane.smith:MyStrongPassword
and get the errorMissing required configuration "name" which has no default value when trying a kafka connect to snowflake
The official documentation for snowflake states a name is required parameter. So I added a name=somerandomname
in the above file. It still doesnt work.
This is the full log indicating even the private key and passphrase is not valid (need to check with admin)
java.util.concurrent.ExecutionException: org.apache.kafka.connect.runtime.rest.errors.BadRequestException: Connector configuration is invalid and contains the following 3 error(s):
Missing required configuration "name" which has no default value.
snowflake.private.key is not valid
snowflake.private.key.passphrase is not valid
Need some help on the above. The official documentation link is here
https://docs.snowflake.com/en/user-guide/kafka-connector-install.html#configuring-the-kafka-connector
如果你对这篇内容有疑问,欢迎到本站社区发帖提问 参与讨论,获取更多帮助,或者扫码二维码加入 Web 技术交流群。

绑定邮箱获取回复消息
由于您还没有绑定你的真实邮箱,如果其他用户或者作者回复了您的评论,将不能在第一时间通知您!
发布评论
评论(1)
您仍然需要在文档中遵循“使用密钥对身份验证”部分,并在sf_connect.properties和snowflake中提供snowflake.private.key向kafka用户提供。例如:Alter用户JSMITH设置rsa_public_key ='miibibijanbgkqh ...';
You still need to follow the section "Using Key Pair Authentication & Key Rotation" in the documentation, and provide snowflake.private.key in the SF_connect.properties and public key in Snowflake to Kafka user. Ex.: alter user jsmith set rsa_public_key='MIIBIjANBgkqh...' ;