The error is just the consequence of what’s happening and not the cause of the issue. If you focus on it without analysing global context & setup you might never find the real issue.
@MasashiY the PSC is a great place to get input from a wide variety of Pega users. Frequently you will have SME’s who can answer your questions or point you to the correct resources.
(Many thanks @Anthony_Gourtay for having provided some valuable insight).
As documented:
“Embedded Kafka is deprecated in Pega Platform 8.8, Pega Platform '23 and Pega Platform '24.1. In the following release, Pega Platform '24.2, embedded Kafka will no longer be available. To ensure future compatibility, do not create any new installations using embedded Kafka. For further details, see External Kafka in your deployment.”
The issue with starting Pega as a Stream node and a WebUser node could be due to several reasons. For the Stream service, ensure there is at least one node dedicated to Stream. For the WebUser node, ensure that the nodetype entry in the prconfig.xml file or in dynamic system settings is set to “web” .
The error you’re encountering indicates the system expecting an external Kafka service, but the URL for this service has not been provided. Starting from Pega Platform 8.4.0, it is possible to configure an external Kafka as a stream service provider. However, you mentioned that you want to use embedded Kafka, which is not recommended for Pega '23. If you cannot provision an external Kafka, you may need to consult with your system administrator or Pega Support for further assistance.
Please take a look at Support self-service offerings on the chronology of steps we advise users to follow - if the product is not working as documented then you can contact our Global Client Support team via the MSP portal.
Pega-Engine • prconfig/services/stream/provider/default [ Value: ExternalKafka] exist by default when you install Pega Infinity’23.
In case if you have that DSS< what it means is, Stream Services are starting as Kafka Externalized
I ran into this issue of Caused by: com.pega.platform.stream.StreamServiceException: ‘services/stream/broker/url’ isn’t provided. when I was trying to Externalize the Kafka Services and this setting was no where documented.
Hence I suggest you to make sure none of the settings mentioned in my screenshot shouldnt excist in your freshly installed Infnity 23.
@MasashiY many thanks for clarifying your question, I will see if I can get some further input for you.
We would like to help track your issue with the error you are encountering ("Failed to configure StreamAPI provider…: ‘services/stream/broker/url’ isn’t provided".)
I can see that you already logged support ticket INC-A23747 on 8 November and that our engineers are working on it. Could I suggest that you continue to work with our GCS team? I have made them aware that you are actively seeking help.
@MasashiY I can see that INC-A23747 has been closed following a successful conclusion:
The issue came down to the fact that the prconfig.xml. file was set incorrectly and you were not using External Stream.
This is the point which @SUMAN_GUMUDAVELLY correctly highlighted - many thanks for that!
Starting infinity, the use of embedded Kafka is not encouraged and thus the default configuration looks for external kafka connection for stream service. If the requirement is to use embedded Kafka then please add the below prconfig.xml setting,
You confirmed yesterday that adding config below “internal kafka” to prconfig.xml allowed Stream node to correctly start.