引起:org.apache.avro.avrotypeexception:找到字符串,期望
我们的Kafka生产商提供了一个包含多个枚举的AVRO模式,其中每个枚举都以相同名称的地图封装。
avro架构
{
"name": "myType",
"type": {
"name": "myType",
"type": "map",
"values": {
"name": "myType",
"type": "enum",
"symbols": ["MY_ONE", "MY_TWO","MY_THREE"]
},
"default": "MY_ONE"
}
},
示例内容
"myType":{
"myTypw":"MY_TWO"
},
试图消耗数据时,抛出的例外...
Caused by: org.apache.kafka.common.errors.SerializationException: Error deserializing Avro message for id 1148
at io.confluent.kafka.serializers.AbstractKafkaAvroDeserializer$DeserializationContext.read(AbstractKafkaAvroDeserializer.java:409) ~[kafka-avro-serializer-7.1.0.jar:na]
at io.confluent.kafka.serializers.AbstractKafkaAvroDeserializer.deserialize(AbstractKafkaAvroDeserializer.java:113) ~[kafka-avro-serializer-7.1.0.jar:na]
at io.confluent.kafka.serializers.KafkaAvroDeserializer.deserialize(KafkaAvroDeserializer.java:55) ~[kafka-avro-serializer-7.1.0.jar:na]
at org.apache.kafka.common.serialization.Deserializer.deserialize(Deserializer.java:60) ~[kafka-clients-3.0.1.jar:na]
at org.apache.kafka.clients.consumer.internals.Fetcher.parseRecord(Fetcher.java:1420) ~[kafka-clients-3.0.1.jar:na]
... 21 common frames omitted
Caused by: org.apache.avro.AvroTypeException: Found string, expecting com.myType
at org.apache.avro.io.ResolvingDecoder.doAction(ResolvingDecoder.java:308) ~[avro-1.11.0.jar:1.11.0]
at org.apache.avro.io.parsing.Parser.advance(Parser.java:86) ~[avro-1.11.0.jar:1.11.0]
at org.apache.avro.io.ResolvingDecoder.readEnum(ResolvingDecoder.java:259) ~[avro-1.11.0.jar:1.11.0]
假设是由于对映射和枚举使用相同名称引起的错误。但这真的是一个问题吗? 这是否意味着源模式无效?还是在Acro Deserializer上的问题?
Our Kafka producer provides an Avro schema that contains several enums, where each enum is encapsulated in a map with same name.
Avro schema
{
"name": "myType",
"type": {
"name": "myType",
"type": "map",
"values": {
"name": "myType",
"type": "enum",
"symbols": ["MY_ONE", "MY_TWO","MY_THREE"]
},
"default": "MY_ONE"
}
},
Example content
"myType":{
"myTypw":"MY_TWO"
},
When trying to consume data an exception in thrown...
Caused by: org.apache.kafka.common.errors.SerializationException: Error deserializing Avro message for id 1148
at io.confluent.kafka.serializers.AbstractKafkaAvroDeserializer$DeserializationContext.read(AbstractKafkaAvroDeserializer.java:409) ~[kafka-avro-serializer-7.1.0.jar:na]
at io.confluent.kafka.serializers.AbstractKafkaAvroDeserializer.deserialize(AbstractKafkaAvroDeserializer.java:113) ~[kafka-avro-serializer-7.1.0.jar:na]
at io.confluent.kafka.serializers.KafkaAvroDeserializer.deserialize(KafkaAvroDeserializer.java:55) ~[kafka-avro-serializer-7.1.0.jar:na]
at org.apache.kafka.common.serialization.Deserializer.deserialize(Deserializer.java:60) ~[kafka-clients-3.0.1.jar:na]
at org.apache.kafka.clients.consumer.internals.Fetcher.parseRecord(Fetcher.java:1420) ~[kafka-clients-3.0.1.jar:na]
... 21 common frames omitted
Caused by: org.apache.avro.AvroTypeException: Found string, expecting com.myType
at org.apache.avro.io.ResolvingDecoder.doAction(ResolvingDecoder.java:308) ~[avro-1.11.0.jar:1.11.0]
at org.apache.avro.io.parsing.Parser.advance(Parser.java:86) ~[avro-1.11.0.jar:1.11.0]
at org.apache.avro.io.ResolvingDecoder.readEnum(ResolvingDecoder.java:259) ~[avro-1.11.0.jar:1.11.0]
Assumption is that error is caused by using same name for map and enum. But is this really an issue?
Does it mean that the source schema is invalid? Or is it an issue on the Acro deserializer?
如果你对这篇内容有疑问,欢迎到本站社区发帖提问 参与讨论,获取更多帮助,或者扫码二维码加入 Web 技术交流群。

绑定邮箱获取回复消息
由于您还没有绑定你的真实邮箱,如果其他用户或者作者回复了您的评论,将不能在第一时间通知您!
发布评论