To illustrate how the DataConnector operator determines if the number of errors has reached the Error Limit, consider these examples if there are two instances running and the Error Limit has been set to 1000:
- If either instance by itself reaches 1000, it will terminate the job by returning a fatal error.
- If instance #1 processes 500 error rows and instance #2 processes 500 error rows but does not reach a checkpoint, the job will continue processing.
- If instance #1 processes 500 error rows and instance #2 processes 500 error rows but does reach a checkpoint., the total number of error rows for all instances combined is determined at checkpoint time and at the end of the input data processing phase. If the total of all instances exceeds the error limit at that time, the job will terminate with an error.