引起:org.apache.avro.avrotypeexception:找到字符串,期望

发布于 2025-01-25 02:26:24 字数 1798 浏览 2 评论 0原文

我们的Kafka生产商提供了一个包含多个枚举的AVRO模式,其中每个枚举都以相同名称的地图封装。

avro架构

{
  "name": "myType",
  "type": {
    "name": "myType",
    "type": "map",
    "values": {
      "name": "myType",
      "type": "enum",
      "symbols": ["MY_ONE", "MY_TWO","MY_THREE"]
    },
    "default": "MY_ONE"
  }
},

示例内容

"myType":{
   "myTypw":"MY_TWO"
},

试图消耗数据时,抛出的例外...

Caused by: org.apache.kafka.common.errors.SerializationException: Error deserializing Avro message for id 1148
    at io.confluent.kafka.serializers.AbstractKafkaAvroDeserializer$DeserializationContext.read(AbstractKafkaAvroDeserializer.java:409) ~[kafka-avro-serializer-7.1.0.jar:na]
    at io.confluent.kafka.serializers.AbstractKafkaAvroDeserializer.deserialize(AbstractKafkaAvroDeserializer.java:113) ~[kafka-avro-serializer-7.1.0.jar:na]
    at io.confluent.kafka.serializers.KafkaAvroDeserializer.deserialize(KafkaAvroDeserializer.java:55) ~[kafka-avro-serializer-7.1.0.jar:na]
    at org.apache.kafka.common.serialization.Deserializer.deserialize(Deserializer.java:60) ~[kafka-clients-3.0.1.jar:na]
    at org.apache.kafka.clients.consumer.internals.Fetcher.parseRecord(Fetcher.java:1420) ~[kafka-clients-3.0.1.jar:na]
    ... 21 common frames omitted
Caused by: org.apache.avro.AvroTypeException: Found string, expecting com.myType
    at org.apache.avro.io.ResolvingDecoder.doAction(ResolvingDecoder.java:308) ~[avro-1.11.0.jar:1.11.0]
    at org.apache.avro.io.parsing.Parser.advance(Parser.java:86) ~[avro-1.11.0.jar:1.11.0]
    at org.apache.avro.io.ResolvingDecoder.readEnum(ResolvingDecoder.java:259) ~[avro-1.11.0.jar:1.11.0]

假设是由于对映射和枚举使用相同名称引起的错误。但这真的是一个问题吗? 这是否意味着源模式无效?还是在Acro Deserializer上的问题?

Our Kafka producer provides an Avro schema that contains several enums, where each enum is encapsulated in a map with same name.

Avro schema

{
  "name": "myType",
  "type": {
    "name": "myType",
    "type": "map",
    "values": {
      "name": "myType",
      "type": "enum",
      "symbols": ["MY_ONE", "MY_TWO","MY_THREE"]
    },
    "default": "MY_ONE"
  }
},

Example content

"myType":{
   "myTypw":"MY_TWO"
},

When trying to consume data an exception in thrown...

Caused by: org.apache.kafka.common.errors.SerializationException: Error deserializing Avro message for id 1148
    at io.confluent.kafka.serializers.AbstractKafkaAvroDeserializer$DeserializationContext.read(AbstractKafkaAvroDeserializer.java:409) ~[kafka-avro-serializer-7.1.0.jar:na]
    at io.confluent.kafka.serializers.AbstractKafkaAvroDeserializer.deserialize(AbstractKafkaAvroDeserializer.java:113) ~[kafka-avro-serializer-7.1.0.jar:na]
    at io.confluent.kafka.serializers.KafkaAvroDeserializer.deserialize(KafkaAvroDeserializer.java:55) ~[kafka-avro-serializer-7.1.0.jar:na]
    at org.apache.kafka.common.serialization.Deserializer.deserialize(Deserializer.java:60) ~[kafka-clients-3.0.1.jar:na]
    at org.apache.kafka.clients.consumer.internals.Fetcher.parseRecord(Fetcher.java:1420) ~[kafka-clients-3.0.1.jar:na]
    ... 21 common frames omitted
Caused by: org.apache.avro.AvroTypeException: Found string, expecting com.myType
    at org.apache.avro.io.ResolvingDecoder.doAction(ResolvingDecoder.java:308) ~[avro-1.11.0.jar:1.11.0]
    at org.apache.avro.io.parsing.Parser.advance(Parser.java:86) ~[avro-1.11.0.jar:1.11.0]
    at org.apache.avro.io.ResolvingDecoder.readEnum(ResolvingDecoder.java:259) ~[avro-1.11.0.jar:1.11.0]

Assumption is that error is caused by using same name for map and enum. But is this really an issue?
Does it mean that the source schema is invalid? Or is it an issue on the Acro deserializer?

如果你对这篇内容有疑问,欢迎到本站社区发帖提问 参与讨论,获取更多帮助,或者扫码二维码加入 Web 技术交流群。

扫码二维码加入Web技术交流群

发布评论

需要 登录 才能够评论, 你可以免费 注册 一个本站的账号。
列表为空,暂无数据
我们使用 Cookies 和其他技术来定制您的体验包括您的登录状态等。通过阅读我们的 隐私政策 了解更多相关信息。 单击 接受 或继续使用网站,即表示您同意使用 Cookies 和您的相关数据。
原文