Is dedicated Kafka cluster a must in PEGA 8.8.2?

We are upgrading from PEGA 8.5.2 to PEGA 8.8.2. We have below questions.

  1. Is it a must-have to spin up an external kafka cluster for PEGA 8.8.2 to work as expected esp wrt functions that use embedded kafka?

  2. PEGA documentation says, releases starting from PEGA platform 24 will no longer have embedded kafka. PEGA 8.8.2 was released in June 2023, technically this should have embedded kafka. Need confirmation on this.

@ShrikanthN5555 Starting from Pega Platform 8.7, the use of embedded Kafka is deprecated. For Pega 8.8.2, it is recommended to use an external Kafka cluster for new environments. However, if you have updated from an earlier version of Pega Platform, you can still use embedded Kafka, but it is advised to plan a transition to an externally managed Kafka for future compatibility.

Monitoring the Stream service

Deprecated features > Deprecated starting in 8.7: Embedded Kafka deployments

Operating the Stream service

Best practices for Stream service configuration

Configuring the Stream service

Can you have a look at “Stream” node and Kafka forum question?

It seems to cover what you are asking.

@MarijeSchillern , Hello Marije - Would this be applicable for an in-place upgrade from PEGA Platform v8.6.1 to v8.8.4 ?

We are upgrading from pega platform v8.6.1 to v8.8.4 on Redhat OpenShift Container platform. Currently on PEGA platform v8.6.1, we are using embedded kafka, embedded hazelcast and externalized elasticsearch

@AnkurG0647 : Thanks for reaching out and asking the question. Usage of Embedded kafka has been deprecated in Pega v8.7.x & Pega v8.8.x. It’s advised to use an external Kafka since the support will be removed in future pega versions.

To answer your query, all existing older pega deployments should able to upgrade (till pega v8.8.x) with embedded kafka as option.

@malaa1 , thanks Anurag for the swift response - this information help mate :slight_smile: