How a Job scheduler can fetch records from connect rest if the connector itself is lagging?

Asked in an Interview-There is a job scheduler and it is fetching records from a Connect Rest on a regular basis say 3-4 hours a day on business day and but there can be a lagging in getting the records.

How to configure this.

@TanyaS58

You can either use the connector run in parallel or load datapage with this connector as source and use the connect wait method.By this way the connector can run asynchrously in the child requestor. This would improve the performance.

If the rest service still taking more time then based on the connection timeout configuration in connector rule, it gets timedout and in the jump condition transition to the a step which adds some logger or trigger an email saing that it got failed. Use pxErrorhandlingtemplate for this kind of requirements.

@P.Siva.Praveen Thanku