Beam/Flink的新手,很高兴在此问题上提供帮助。
我有一个管道,可以从kafka avro消息中读取一些对象转换,然后再次写信给kafka。没有定义任何窗口,因为目前我们想在没有汇总的情况下分别处理每个事件。
我想知道这是否正确。根据我在文档中的了解,似乎我们无法使用默认行为,并定义某种窗口和相关的触发器。
我的理解正确吗?
谢谢
s
New to beam/flink and would appreciate assistance in this issue.
I have a pipeline that reads from kafka avro message does some object transformation and writes again to kafka. ו did not define any window since currently we would like to handle each event separately with no aggregation.
I wonder if this correct. From what i understand in the docs seem like we cannot use the default behaviour and define some kind of window and relevant triggers.
Is my understanding correct?
Thanks
S
发布评论
评论(1)
如果您没有为管道指定窗口策略,它将自动在全局窗口上运行。由于没有汇总或这样做,这还可以。
说:
If you do not specify a windowing strategy for a pipeline, it will automatically run on a global window. Since no aggregations or such are to be made, this is ok.
https://colab.research.google.com/github/apache/beam/blob/master/examples/notebooks/tour-of-beam/windowing.ipynb says: