线程“main”中的异常java.lang.NoClassDefFoundError: com/fasterxml/jackson/core/util/JacksonFeature

Question

我在使用 Avro serde 在 IntelliJ-Idea IDE 中运行 Kafka 流 Java 应用程序时遇到异常。 相同的主题/应用程序以 JSON 格式运行没有问题。

错误

线程“main”中出现异常java.lang.NoClassDefFoundError： com/fasterxml/jackson/core/util/JacksonFeature 位于 com.fasterxml.jackson.databind.ObjectMapper。（ObjectMapper.java:655） 在 com.fasterxml.jackson.databind.ObjectMapper。（ObjectMapper.java:558） 在 io.confluence.kafka.schemaregistry.utils.JacksonMapper。（JacksonMapper.java:24） 在 io.confluence.kafka.schemaregistry.client.rest.RestService。(RestService.java:151) 在 io.confluence.kafka.schemaregistry.client.CachedSchemaRegistryClient。（CachedSchemaRegistryClient.java:153） 在 io.confluence.kafka.serializers.AbstractKafkaSchemaSerDe.configureClientProperties（AbstractKafkaSchemaSerDe.java:83） 在 io.confluence.kafka.serializers.AbstractKafkaAvroSerializer.configure(AbstractKafkaAvroSerializer.java:56) 在 io.confluence.kafka.serializers.KafkaAvroSerializer.configure(KafkaAvroSerializer.java:50) 在 io.confluence.kafka.streams.serdes.avro.SpecificAvroSerializer.configure(SpecificAvroSerializer.java:58)

所以我已经多次更改了所有可能的杰克逊包 - 没有运气。 我看到 jackson-databind 被调用，但我没有看到它出现在汇合注册表中。 所以我在我的 pom 文件中使用了 jackson-bom - 更改了所有主要版本仍然没有运气。

项目相关文件

POM文件

<?xml version="1.0" encoding="UTF-8"?>
<project xmlns="http://maven.apache.org/POM/4.0.0"
         xmlns:xsi="http://www.w3.org/2001/XMLSchema-instance"
         xsi:schemaLocation="http://maven.apache.org/POM/4.0.0 http://maven.apache.org/xsd/maven-4.0.0.xsd">
    <modelVersion>4.0.0</modelVersion>

    <groupId>pmu</groupId>
    <artifactId>PMU_StreamingAPP_Demo</artifactId>
    <version>0.1.1</version>

    <properties>
        <java.version>1.8</java.version>
        <confluent.version>7.0.1</confluent.version>
        <kafka.version>3.0.1</kafka.version>
        <project.build.sourceEncoding>UTF-8</project.build.sourceEncoding>
        <maven.compiler.source>8</maven.compiler.source>
        <maven.compiler.target>8</maven.compiler.target>
    </properties>


    <repositories>
        <repository>
            <id>confluent</id>
            <url>https://packages.confluent.io/maven/</url>
        </repository>
    </repositories>


    <build>
        <plugins>
            <!-- Maven Compiler Plugin-->
            <plugin>
                <groupId>org.apache.maven.plugins</groupId>
                <artifactId>maven-compiler-plugin</artifactId>
                <version>3.10.1</version>
                <configuration>
                    <source>${java.version}</source>
                    <target>${java.version}</target>
                </configuration>
            </plugin>

            <!-- Maven Avro plugin for generating pojo-->
            <plugin>
                <groupId>org.apache.avro</groupId>
                <artifactId>avro-maven-plugin</artifactId>
                <version>1.10.2</version>
                <executions>
                    <execution>
                        <phase>generate-sources</phase>
                        <goals>
                            <goal>schema</goal>
                        </goals>
                        <configuration>
                            <sourceDirectory>${project.basedir}/src/main/resources/schema/</sourceDirectory>
                            <outputDirectory>${project.basedir}/src/main/java/</outputDirectory>
                        </configuration>
                    </execution>
                </executions>
            </plugin>
        </plugins>
    </build>

    <dependencies>
        <!-- Confluent Kafka Avro Serializer-->
        <dependency>
            <groupId>io.confluent</groupId>
            <artifactId>kafka-streams-avro-serde</artifactId>
            <version>${confluent.version}</version>
        </dependency>
        <!-- Apache Kafka Clients-->
        <dependency>
            <groupId>org.apache.kafka</groupId>
            <artifactId>kafka-streams</artifactId>
            <version>${kafka.version}</version>
        </dependency>
        <!-- Apache Log4J2 binding for SLF4J -->
        <dependency>
            <groupId>org.apache.logging.log4j</groupId>
            <artifactId>log4j-slf4j-impl</artifactId>
            <version>2.17.1</version>
        </dependency>
    </dependencies>

</project>

主题Avro架构（PosInvoice）：

{
  "namespace": "guru.learningjournal.kafka.examples.types",
  "type": "record",
  "name": "PosInvoice",
  "fields": [
    {"name": "InvoiceNumber","type": ["null","string"]},
    {"name": "CreatedTime","type": ["null","long"],"default" : null},
    {"name": "CustomerCardNo","type": ["null","double"]},
    {"name": "TotalAmount","type": ["null","double"]},
    {"name": "NumberOfItems","type": ["null","int"]},
    {"name": "PaymentMethod","type": ["null","string"]},
    {"name": "TaxableAmount","type": ["null","double"]},
    {"name": "CGST","type": ["null","double"]},
    {"name": "SGST","type": ["null","double"]},
    {"name": "CESS","type": ["null","double"]},
    {"name": "StoreID","type": ["null","string"]},
    {"name": "PosID","type": ["null","string"]},
    {"name": "CashierID","type": ["null","string"]},
    {"name": "CustomerType","type": ["null","string"]},
    {"name": "DeliveryType","type": ["null","string"]}
  ]
}

破坏应用程序的Kafka流代码：

流创建/加载正常：

    StreamsBuilder builder = new StreamsBuilder();
    KStream<String, PosInvoice> KS0 = builder.stream(AppConfigs.posTopicName,
        Consumed.with(AppSerdes.String(), AppSerdes.PosInvoice()));

但是之后，此代码破坏了应用程序：

KS0.filter((k, v) -> v.getDeliveryType().equals("Home_Delivery"))
    .to(AppConfigs.shipmentTopicName, Produced.with(AppSerdes.String(), AppSerdes.PosInvoice()));

似乎流序列化正常，但之后代码在 KStream.filter 方法上中断。