Externalizing Kafka for Pega Platform

[Jey2705 (Jeyachandra Pandiyan Pandiyan)]

Hi,

We are in the process of externalizing Kafka to our organization’s infrastructure using StreamNative. The setup has been completed successfully, and we are now in the validation phase to confirm that the application can handle queue processors and job scheduler runs in an external Kafka environment.

I came across the reference link below, which lists several prconfig/DSS settings. However, I was unable to find many of them, even though they are mentioned as default settings.

Given that we are using Pega Platform 24.1.3, could someone please advise on the recommended prconfig/DSS settings required to productionalize this external Kafka setup for our Pega platform?

I appreciate your help.

Exception handling for pega Kafka producer and consumer

Could you please help in answering the following questions? In the event of brokers unavailability, how can we handle the exception while reading the data from Kafka or publish the data to Kafka? How to retry if reading data from Kafka topic fails? How to retry if writing data to Kafka topic fails? How to stop the real time event data flows if any of the exception happened in Kafka Pega integration ? Is there any API available? Are there any settings at server side or dynamic syst…