Error Limits For DataConnector Operator
To illustrate how the DataConnector operator determines if the number of errors has
reached the Error Limit, consider these examples if there are two instances running
and the Error Limit has been set to 1000:
If either instance by itself reaches 1000, it will terminate the job by returning
a fatal error.
If instance #1 processes 500 error rows and instance #2 processes 500 error rows but
does not reach a checkpoint, the job will continue processing.
If instance #1 processes 500 error rows and instance #2 processes 500 error rows but
does reach a checkpoint., the total number of error rows for all instances combined
is determined at checkpoint time and at the end of the input data processing phase.
If the total of all instances exceeds the error limit at that time, the job will terminate
with an error.