How to verify data flow is fetching kafka message from topic where can we see the message details

General
, , ,
1

Hi All,
I have configured a data flow which executes a dataset to fetch the kafka message in the start shape of data flow, and in the end shape of the data flow I have configured an activity to create a work object based on the data received on start shape data set.

Here the issue is I am unable see the kafka message data whether data flow fetch the message or not, I am unable to trace the either dataflow or activity.

Is there a way to to check kafka message whether dataflow fetching the data or not?

2

@VeerendraC Configure-> Decisioning-> Decisions-> Data flows-> Real time processing.

You will see your real time data flow here and whenever a message in the topic is consumed you will see the count getting increased.

If you want the message data to debug-> you can extract the message in your activity and log that entry.

But you can run your data set standalone if you just want to check the data which is consumed.

3

Yes logging the message is one approach for testing the message structure in lower environment and in higher environmetn we are not supposed to expose the critical data into log files.