Unable to read messages from Kafka Topic after upgrading to PEGA Infinity '23

General
, , ,
1

Hi,

We just upgraded our PEGA PRPC to Infinity '23. We were using Kafka Topic o send and receive messages.

After upgrade we are getting below error when trying to consume message from Kafka Topic.

Any help with regard to this is appreciated.

ERROR - [DF-16713] Preparing retry 7. Next attempt in 1m 4s on data flow [GOORequestDataTESTEnv] on stage [GOO_TEST_YQT_REQUESTS] with affected partitions: [2]
org.apache.kafka.common.KafkaException: Received exception when fetching the next record from GOO_V3_TEST_YQT_REQUESTS-2. If needed, please seek past the record to continue consumption.

Caused by: org.apache.kafka.common.KafkaException: java.lang.RuntimeException: Kafka has detected detected a buggy lz4-java library (< 1.4.x) on the classpath. If you are using Kafka client libraries, make sure your application does not accidentally override the version provided by Kafka or include multiple versions of the library on the classpath. The lz4-java version on the classpath should match the version the Kafka client libraries depend on. Adding -verbose:class to your JVM arguments may help understand which lz4-java version is getting loaded.

Thanks

Jana

2

@JanardhanK0965 please log a support issue via the MSP and provide the INC id here in a reply so that we can track the issue.

3

@JanardhanK0965

We are facing similar issue after pega upgrade. Could you please help us with the steps followed to resolve the issue.

4

@MarijeSchillern

@JanardhanK0965 @Arunreddy_Shyamala

Not sure if it’s solved for you…

I’ve just started to face the same problem in a project and what I’ve seen is that the correct version of lz4-java for kafka-clients.3.4.0.jar is the 1.8.0 as you can see here:

https://mvnrepository.com/artifact/org.apache.kafka/kafka-clients/3.4.0

But seems in Pega-EngineCode for 08.23.01 the library has not been updated in the 23 installation (still version lz4-1.3.0.jar).

This seems a question to be solved by SR.

I hope it helps.

Carlos

5

@chuck8080

Pega system provided new jar of lz4-java to import into our application.

This resolved our issue.

Thanks

Arunreddy