This restarted upsert example uses two IMPORT clauses. The first one loads half of the records from the data source into an empty table. The second one does an upsert using all the records in the same data file. The result is that it updates the rows inserted during the first import and inserts all of the rows that the first import skipped.
/***********************************************/
/* Script Name: TP0734 */
/* Description: WIN32 script. */
/***********************************************/
.LOGTABLE TPLOG0734a;
.LOGON NODEID/HEMANTHDB,HEMANTHDB;
DROP TABLE TPTBL0734;
DROP TABLE TPERR0734;
/***********************************************/
/* STEP01 CREATES THE TABLES FOR THE TPump JOB */
/***********************************************/
CREATE TABLE TPTBL0734, FALLBACK(
F1 INTEGER, F2 CHAR(50),
F3 VARCHAR(50), F4 FLOAT,
F5 BYTE (10), F6 VARBYTE (10),
F7 DECIMAL(8,2),F8 BYTEINT,
F9 SMALLINT, F10 DATE,
F11 BIGINT, F12 DECIMAL(38,0))
UNIQUE PRIMARY INDEX (F1);
/***********************************************/
/* BEGIN LOAD WITH ALL THE OPTIONS SPECIFIED */
/* SUCH AS ERRLIMIT, CHECKPOINT, SESSIONS, */
/* TENACITY, etc. */
/***********************************************/
.BEGIN LOAD CHECKPOINT 15 SESSIONS 4 1
TENACITY 2 ERRORTABLE TPERR0734
ERRLIMIT 10 ROBUST OFF
PACK 500 DATAENCRYPTION ON
ARRAYSUPPORT OFF RATE 200
RETRYTIMES 200 SLEEP 40
NOATOMICUPSERT MACRODB HEMANTHDB
NOTIFY OFF SERIALIZE ON;
.LAYOUT LAY0734;
.FIELD FF1 * INTEGER KEY;
.FIELD FF2 * CHAR(50);
.FIELD FF3 * VARCHAR(50);
.FIELD FF4 * FLOAT;
.FIELD FF5 * BYTE(10);
.FIELD FF6 * VARBYTE(10);
.FIELD FF7 * DECIMAL(8,2);
.FIELD FF8 * BYTEINT;
.FIELD FF9 * SMALLINT;
.FIELD FF10 * DATE;
.FIELD FF11 * BIGINT;
.FIELD FF12 * DECIMAL(38,0);
/* insert half of the rows ......................*/
.DML LABEL LABEL0734A IGNORE DUPLICATE ROWS
IGNORE MISSING ROWS
IGNORE EXTRA ROWS;
INSERT INTO TPTBL0734 VALUES ( :FF1, :FF2, :FF3, :FF4,
:FF5, :FF6, :FF7, :FF8,
:FF9, :FF10, :FF11, :FF12);
/* ... and then upsert all of the rows ..........*/
.DML LABEL LABEL0734B IGNORE DUPLICATE ROWS
IGNORE MISSING ROWS
IGNORE EXTRA ROWS
DO INSERT FOR MISSING UPDATE ROWS;
UPDATE TPTBL0734 SET F7 = F7 + 1 WHERE F1 = :FF1;
INSERT INTO TPTBL0734 VALUES ( :FF1, :FF2, :FF3, :FF4,
:FF5, :FF6, :FF7, :FF8,
:FF9, :FF10, :FF11, :FF12);
/* should result in an upsert with half inserts and half updates */
.IMPORT INFILE ./ALLTYPE.data
LAYOUT LAY0734 FROM 1 FOR 400
APPLY LABEL0734A WHERE FF3 = 'TERADATA';
.IMPORT INFILE ./ALLTYPE.data
LAYOUT LAY0734 FROM 1 FOR 400
APPLY LABEL0734B;
.END LOAD;
.LOGOFF;
This script produces the following output (assuming it was restarted during the second import):
========================================================================
= =
= Teradata Parallel Data Pump Utility Release 17.20.00.03 =
= Platform WIN 64-bit =
= PID 4752 =
= =
= Teradata Parallel Data Pump Utility is DEPRECATED. =
= It is provided to run existing workloads created =
= prior to 07-SEP-2023. =
= Please use Teradata Parallel Transporter for =
= workloads. =
= =
========================================================================
= =
= Copyright 1997-2023 Teradata. All rights reserved. =
= =
========================================================================
**** 03:54:32 UTY2411 Processing start date: SUN SEP 10, 2023
========================================================================
= =
= Logon/Connection =
= =
========================================================================
0001 /************************************************/
/* Script Name: TP0734 */
/* Description: WIN 64-bit script. */
/***********************************************/
.LOGTABLE TPLOG0044;
0002 .LOGON NODEID/FLUSER,;
**** 03:54:32 UTY8400 Teradata Database Release: 17.20.00.00
**** 03:54:32 UTY8400 Teradata Database Version: 17.20.00.00
**** 03:54:32 UTY8400 Default character set: ASCII
**** 03:54:32 UTY8400 Current RDBMS has UDT support
**** 03:54:32 UTY8400 Current RDBMS has Large Decimal support
**** 03:54:32 UTY8400 Current RDBMS has Statement Info Parcel support
**** 03:54:32 UTY8400 Maximum supported buffer size: 1M
**** 03:54:32 UTY8400 Upsert supported by RDBMS server
**** 03:54:32 UTY8400 Data Encryption supported by RDBMS server
**** 03:54:32 UTY8400 Array Support supported by RDBMS server
**** 03:54:32 UTY8400 Statement Independence supported by RDBMS server
**** 03:54:32 UTY6211 A successful connect was made to the RDBMS.
**** 03:54:32 UTY6217 Logtable 'FLUSER.TPLOG0044' has been created.
========================================================================
= =
= Processing Control Statements =
= =
========================================================================
0003 DROP TABLE TPTBL0734;
**** 03:54:32 UTY1008 RDBMS failure: 3807, Object 'TPTBL0734' does not exist.
0004 DROP TABLE TPERR0734;
**** 03:54:32 UTY1008 RDBMS failure: 3807, Object 'TPERR0734' does not exist.
0005 /***********************************************/
/* STEP01 CREATES THE TABLES FOR THE TPump JOB */
/***********************************************/
CREATE TABLE TPTBL0734, FALLBACK(
F1 INTEGER,F2 CHAR(50),
F3 VARCHAR(50),F4 FLOAT,
F5 BYTE (10),F6 VARBYTE (10),
F7 DECIMAL(8,2),F8 BYTEINT,
F9 SMALLINT,F10 DATE,
F11 BIGINT,F12 DECIMAL(38,0))
UNIQUE PRIMARY INDEX (F1);
**** 03:54:33 UTY1016 'CREATE' request successful.
0006 /***********************************************/
/* BEGIN LOAD WITH ALL THE OPTIONS SPECIFIED */
/* SUCH AS ERRLIMIT, CHECKPOINT, SESSIONS, */
/* TENACITY, etc. */
/***********************************************/
.BEGIN LOAD CHECKPOINT 15 SESSIONS 4 1
TENACITY 2 ERRORTABLE TPERR0734
ERRLIMIT 10ROBUST OFF
PACK 500 DATAENCRYPTION ON
ARRAYSUPPORT OFF RATE 200
RETRYTIMES 200 SLEEP 40
NOATOMICUPSERT MACRODB TPUSER
NOTIFY OFF SERIALIZE ON;
========================================================================
= =
= Processing TPump Statements =
= =
========================================================================
0007 .LAYOUT LAY0734;
0008 .FIELD FF1 * INTEGER KEY;
0009 .FIELD FF2 * CHAR(50);
0010 .FIELD FF3 * VARCHAR(50);
0011 .FIELD FF4 * FLOAT;
0012 .FIELD FF5 * BYTE(10);
0013 .FIELD FF6 * VARBYTE(10);
0014 .FIELD FF7 * DECIMAL(8,2);
0015 .FIELD FF8 * BYTEINT;
0016 .FIELD FF9 * SMALLINT;
0017 .FIELD FF10 * DATE;
0018 .FIELD FF11 * BIGINT;
0019 .FIELD FF12 * DECIMAL(38,0);
0020 /* insert half of the rows ......................*/
.DML LABEL LABEL0734A IGNORE DUPLICATE ROWS
IGNORE MISSING ROWS
IGNORE EXTRA ROWS;
0021 INSERT INTO TPTBL0734 VALUES ( :FF1, :FF2, :FF3, :FF4,
:FF5, :FF6, :FF7, :FF8,
:FF9, :FF10, :FF11, :FF12);
0022 /* ... and then upsert all of the rows ..........*/
.DML LABEL LABEL0734B IGNORE DUPLICATE ROWS
IGNORE MISSING ROWS
IGNORE EXTRA ROWS
DO INSERT FOR MISSING UPDATE ROWS;
0023 UPDATE TPTBL0734 SET F7 = F7 + 1 WHERE F1 = :FF1;
0024 INSERT INTO TPTBL0734 VALUES ( :FF1, :FF2, :FF3, :FF4,
:FF5, :FF6, :FF7, :FF8,
:FF9, :FF10, :FF11, :FF12);
0025 /* should result in an upsert with half inserts and half updates */
.IMPORT INFILE ./ALLTYPE.data
LAYOUT LAY0734 FROM 1 FOR 400
APPLY LABEL0734A WHERE FF3 = 'TERADATA';
0026 .IMPORT INFILE ./ALLTYPE.data
LAYOUT LAY0734 FROM 1 FOR 400
APPLY LABEL0734B;
0027 .END LOAD;
**** 03:54:33 UTY6609 Starting to log on sessions...
**** 03:54:33 UTY6610 Logged on 3 sessions.
========================================================================
= =
= TPump Import(s) Beginning =
= =
========================================================================
**** 03:54:33 UTY6630 Options in effect for following TPump Import(s):
. Tenacity: 2 hour limit to successfully connect load sessions.
. Max Sessions: 4 session(s).
. Min Sessions: 1 session(s).
. Checkpoint: 15 minute(s).
. Errlimit: 10 rejected record(s).
. Restart Mode: SIMPLE.
. Serialization: ON.
Packing: 500 Statements per Request.
. StartUp Rate: 200 Statements per Minute.
. Rate Per Period: 50 Statements per 15000 milliseconds.
. Atomic Upsert: DISABLED.
**** 03:54:59 UTY6625 WARNING: Packing has changed to 211 statement(s) per
request.
**** 03:54:59 UTY6664 PACK factor was determined by the USING variable limit.
Apply: 1, Stmt: 1.
**** 03:54:59 UTY8802 WARNING: Rate Monitoring turned off - database
TPumpMacro does not exist.
**** 03:54:59 UTY6608 Import 1 begins.
**** 03:55:59 UTY6641 Since last chkpt., 400 recs. in, 200 stmts., 8 reqs
**** 03:55:59 UTY6647 Since last chkpt., avg. DBS wait time: 91.63
**** 03:55:59 UTY6612 Beginning final checkpoint...
**** 03:55:59 UTY6641 Since last chkpt., 400 recs. in, 200 stmts., 8 reqs
**** 03:55:59 UTY6647 Since last chkpt., avg. DBS wait time: 91.63
**** 03:55:59 UTY6607 Checkpoint Completes with 200 rows sent.
**** 03:55:59 UTY6642 Import 1 statements: 200, requests: 8
**** 03:55:59 UTY6643 Import 1 average statements per request: 25.00
**** 03:55:59 UTY6644 Import 1 average statements per record: 1.00
**** 03:55:59 UTY6645 Import 1 statements/session: avg. 66.67, min. 66.00,
max. 67.00
**** 03:55:59 UTY6646 Import 1 requests/session: average 2.67, minimum 2.00,
maximum 3.00
**** 03:55:59 UTY6648 Import 1 DBS wait time/session: avg. 244.33, min. 15.00,
max. 499.00
**** 03:55:59 UTY6649 Import 1 DBS wait time/request: avg. 82.28, min. 7.50,
max. 166.33
**** 03:55:59 UTY1823 Import processing statistics
. IMPORT 1 Total thus far
. ========= ==============
Candidate records considered:.... 400 400
Apply conditions satisfied:...... 200 200
Records logable to error table:.. 0 0
Candidate records rejected:...... 0 0
**** Statistics for Apply Label : LABEL0734A
Type: I
Database: TPUSER
Table or Macro Name: TPTBL0734
Activity: 200
**** 03:55:59 UTY6677 Loading phase statistics
Elapsed time: 00:00:01:00(dd:hh:mm:ss)
CPU time: 0 Seconds
MB/sec: 0.000403333
MB/cpusec: N/A
**** 03:56:07 UTY8802 WARNING: Rate Monitoring turned off - database
TPumpMacro does not exist.
**** 03:56:07 UTY6608 Import 2 begins.
**** 03:58:08 UTY6641 Since last chkpt., 400 recs. in, 600 stmts., 24 reqs
**** 03:58:08 UTY6647 Since last chkpt., avg. DBS wait time: 107.92
**** 03:58:08 UTY6612 Beginning final checkpoint...
**** 03:58:08 UTY6641 Since last chkpt., 400 recs. in, 600 stmts., 24 reqs
**** 03:58:08 UTY6647 Since last chkpt., avg. DBS wait time: 107.92
**** 03:58:08 UTY6607 Checkpoint Completes with 400 rows sent.
**** 03:58:08 UTY6642 Import 2 statements: 600, requests: 24
**** 03:58:08 UTY6643 Import 2 average statements per request: 25.00
**** 03:58:08 UTY6644 Import 2 average statements per record: 1.50
**** 03:58:08 UTY6645 Import 2 statements/session: avg. 200.00, min. 199.00,
max. 201.00
**** 03:58:08 UTY6646 Import 2 requests/session: average 8.00, minimum 6.00,
maximum 10.00
**** 03:58:08 UTY6648 Import 2 DBS wait time/session: avg. 863.33, min. 94.00,
max. 2028.00
**** 03:58:08 UTY6649 Import 2 DBS wait time/request: avg. 92.32, min. 15.67,
max. 202.80
**** 03:58:08 UTY1823 Import processing statistics
. IMPORT 2 Total thus far
. ========= ==============
Candidate records considered:.... 400 800
Apply conditions satisfied:...... 400 600
Records logable to error table:.. 0 0
Candidate records rejected:...... 0 0
**** Statistics for Apply Label : LABEL0734B
Type: U
Database: TPUSER
Table or Macro Name: TPTBL0734
Activity: 200
Type: I
Database: TPUSER
Table or Macro Name: TPTBL0734
Activity: 200
**** 03:58:08 UTY6677 Loading phase statistics
Elapsed time: 00:00:02:01(dd:hh:mm:ss)
CPU time: 0.0312002 Seconds
MB/sec: 0.0004
MB/cpusec: 1.55127
**** 03:58:08 UTY0821 Error table TPUSER.TPERR0734 is EMPTY, dropping table.
0028 .LOGOFF;
========================================================================
= =
= Logoff/Disconnect =
= =
========================================================================
**** 3:58:09 UTY6216 The restart log table has been dropped.
**** 3:58:09 UTY6212 A successful disconnect was made from the RDBMS.
**** 3:58:09 UTY2410 Total processor time used = '4.30563 Seconds'
. Start : 03:54:05 - WED JUN 09, 2021
. End : 03:58:06 - WED JUN 09, 2021
. Highest return code encountered = '0'.