kafka connect and Hive->合并
鉴于Hive的酸性增量汇总合并的特征,我正在尝试了解:
- 蜂巢镜头下沉: https://docs.lenses.io/5.0/integrations/connectors/connectors/stream-reacctor/sinks/hivesinkconnector/
- confluent hadep anduent Hadoop sink: https://docs.confluent.io/kafka-con/kafka-connect-hdnect-hdnect-hdfs/current/current/current/overview.html
也可以应用增量汇总。我找不到有关它们的本质的文档,即纯净的附加或也有汇总。
汇总更新似乎是一个非常普遍的问题,我希望Kafka Connect家族的OpenSource工具已解决。
Given the Hive's features of ACID incremental rollup Merge, I'm trying to understand if:
- Hive Lenses sink: https://docs.lenses.io/5.0/integrations/connectors/stream-reactor/sinks/hivesinkconnector/
- Confluent Hadoop Sink: https://docs.confluent.io/kafka-connect-hdfs/current/overview.html
can apply the incremental rollups as well. I wasn't able to find documentation about their nature of being pure APPEND-ONLY or having also rollups.
The rollup update seems a pretty common problem that I would expect opensource tools of the Kafka Connect family to have addressed.
如果你对这篇内容有疑问,欢迎到本站社区发帖提问 参与讨论,获取更多帮助,或者扫码二维码加入 Web 技术交流群。
绑定邮箱获取回复消息
由于您还没有绑定你的真实邮箱,如果其他用户或者作者回复了您的评论,将不能在第一时间通知您!
发布评论