Hi Team,
Hope everyone doing good!
I would like to understand on the below points, please do provide some insights on the same.
-
What if the background nodes which are processing JS Activity, QP activity, Email and File listeners stopped suddenly. What will happen to the data that got stucked in between? How to handle this?
-
What if Kafka server was stopped suddenly ( which in turn pushing the message/pulling the message got stucked). How to handle this scenario?
Thanks,
Vignesh.
@Vigneshk2107
- If background nodes stop suddenly, data being processed might get stuck. For Queue Processors, messages are saved in a database and pushed to Kafka when the stream node is available. For File Listeners, follow best practices to avoid data loss or corruption during shutdown.
- If the Kafka server stops suddenly, messages might get stuck. Ensure Kafka is configured for high availability and fault
This is a GenAI-powered tool. All generated answers require validation against the provided references.tolerance, including replication and rebalancing.
This is a GenAI-powered tool. All generated answers require validation against the provided references.
Queue processor FAQ > What happens when I queue messages with no stream node running?
File listener process interrupted with server restart
Ask the Expert - Background Processing with Prithanka Chatterjee
Externalisation of Kafka service