Say we have a data flow-> Which reads from a data source , do some filtration ->Update the filtered data to a destination . Now , say from the Source 1000 records are flown and in the Filter logic i need to filter first X no of records out of that 1000 . As per our understanding , In Data flow , each records are getting processed independently . So considering that , this type of Filtering is possible where we will refer some internal property ( if PEGA maintains , to keep track of the current rows execution reference ) and use it in the filter condition ? If Not ->Is there any way like using Decision strategy or something like that to achieve this?
The first X records in the sense any first X records processing by data flow or first X records in the source system?
Ideally , X=First X records , Processed by the data flow . However , you can advise , for First X records in source system scenario as well .
If source system can add additionally another field like index or something, you can keep a filter and mentioned 1-10 inside the filter. If that is not possible, then have a separate data type to store all 1000 records, then save all the records to that data type. Then fetch X number of records from this data type to your original data type where you have to store the X number of records.