Unable to Pass Parameter from Real Time Data Flow Activity

General
, ,
1

Unable to Pass Parameter from Real Time Data Flow Activity .

  • Create a Data flow and add a data set which reads the message from kafka topic.
  • Create a activity and define a input Param “test” and add a log of Param.test value in activity to makes sure values what we pass from data flow to activity getting set or not.
  • Once activity is created , refer the activity in data flow and give the Param value.
  • Data flow is of (Kafka Data Set + Activity).
  • When real time data flow is executed, whatever the Param.test value we set from data flow is not moved to activity.

Note: When data set is abstract , params are passing as expected.

Issue is only when referring to kafka data set.

2

@AbinayaM2861 it seems like you are facing an issue with passing parameters from a real time data flow to an activity when using a Kafka Data Set. This issue might be related to the configuration of the Kafka Data Set or the way parameters are being handled in the data flow. Here are a few steps you can take to troubleshoot and resolve this issue: 1. Check Kafka Data Set Configuration: Ensure that the Kafka Data Set is correctly configured and that there are no issues with the topic or the connection to the Kafka server. Verify that the topic exists and that there are no firewall or access control issues preventing communication with the Kafka server. 2. Log Parameter Values: In your activity add logging to capture the value of Param.test to verify if the parameter is being passed correctly. This will help you identify if the issue is with the parameter passing or with the data flow execution. 3. Data Flow Execution: Ensure that the data flow is correctly set up to pass parameters to the activity. Double check the configuration of the data flow and the activity to ensure that parameters are being passed as expected. 4. Test with Abstract Data Set: Since you mentioned that parameters are passing as expected with an abstract data set compare the configurations of the abstract data set and the Kafka Data Set to identify any differences that might be causing the issue. If the issue persists you may need to further investigate the specific configurations and logs to identify the root cause of the problem.

:warning: This is a GenAI-powered tool. All generated answers require validation against the provided references.

Troubleshooting Kafka Data Sets

Kafka Data Flow Error

3

@MarijeSchillern Issue is resolved. Recommended fix :

real time data flow run is to be stopped and started between every change. The data flow threads have to pick up the new generated code for the data flow rule, by restarting or stopping and starting the run again.

So when ever there is any change in the data flow need to do a restart or stop and start the real time data flow to apply the changes.