再始動UPSERTの例 - Parallel Data Pump

Teradata® Parallel Data Pumpリファレンス - 17.20

Product
Parallel Data Pump
Release Number
17.20
Published
2022年10月10日
Language
日本語
Last Update
2022-11-21
dita:mapPath
ja-JP/kpf1641281806652.ditamap
dita:ditavalPath
ja-JP/ovd1619195504008.ditaval
dita:id
B035-3021
Product Category
Teradata Tools and Utilities

この再始動されたUPSERTの例では、2つのIMPORT句を使用します。最初の句は、レコードの半数をデータ ソースから空のテーブルにロードします。2番目の句は、同じデータ ファイルのすべてのレコードを使ってUPSERTを実行します。その結果、最初のインポート中に挿入された行は更新され、最初のインポートで省略されたすべての行が挿入されます。

/***********************************************/
/*   Script Name:  TP0734                      */
/*   Description:  WIN32 script.               */
/***********************************************/
.LOGTABLE TPLOG0734a;
.LOGON NODEID/HEMANTHDB,HEMANTHDB;

DROP TABLE TPTBL0734;
DROP TABLE TPERR0734;

/***********************************************/
/* STEP01 CREATES THE TABLES FOR THE TPump JOB */
/***********************************************/

CREATE TABLE TPTBL0734, FALLBACK(
	F1 INTEGER,	F2 CHAR(50),
	F3 VARCHAR(50),	F4 FLOAT,
	F5 BYTE (10),	F6 VARBYTE (10),
	F7 DECIMAL(8,2),F8 BYTEINT,
	F9 SMALLINT,	F10 DATE,
	F11 BIGINT,	F12 DECIMAL(38,0))
UNIQUE PRIMARY INDEX (F1);

/***********************************************/
/* BEGIN LOAD WITH ALL THE OPTIONS SPECIFIED   */
/* SUCH AS ERRLIMIT, CHECKPOINT, SESSIONS,     */
/* TENACITY, etc.                              */
/***********************************************/
.BEGIN LOAD	CHECKPOINT 15	SESSIONS 4 1
		TENACITY 2	ERRORTABLE TPERR0734
		ERRLIMIT 10	ROBUST OFF
		PACK 500	DATAENCRYPTION ON
		ARRAYSUPPORT OFF RATE 200
		RETRYTIMES 200  SLEEP 40
		NOATOMICUPSERT  MACRODB HEMANTHDB
		NOTIFY OFF	SERIALIZE ON;
.LAYOUT LAY0734;
.FIELD FF1 * INTEGER KEY;
.FIELD FF2 * CHAR(50);
.FIELD FF3 * VARCHAR(50);
.FIELD FF4 * FLOAT;
.FIELD FF5 * BYTE(10);
.FIELD FF6 * VARBYTE(10);
.FIELD FF7 * DECIMAL(8,2);
.FIELD FF8 * BYTEINT;
.FIELD FF9 * SMALLINT;
.FIELD FF10 * DATE;
.FIELD FF11 * BIGINT;
.FIELD FF12 * DECIMAL(38,0);
/* insert half of the rows ......................*/
     .DML LABEL LABEL0734A      IGNORE DUPLICATE ROWS
                                IGNORE MISSING ROWS
                                IGNORE EXTRA ROWS;
  INSERT INTO TPTBL0734 VALUES (    :FF1,   :FF2,   :FF3,   :FF4,
                                :FF5,   :FF6,   :FF7,   :FF8,
                                :FF9,   :FF10,  :FF11,  :FF12);
/* ... and then upsert all of the rows ..........*/
     .DML LABEL LABEL0734B      IGNORE DUPLICATE ROWS
                                IGNORE MISSING ROWS
                                IGNORE EXTRA ROWS
                                DO INSERT FOR MISSING UPDATE ROWS;
UPDATE TPTBL0734 SET F7 = F7 + 1 WHERE F1 = :FF1;
INSERT INTO TPTBL0734 VALUES (    :FF1,   :FF2,   :FF3,   :FF4,
                                :FF5,   :FF6,   :FF7,   :FF8,
                                :FF9,   :FF10,  :FF11,  :FF12);
/* should result in an upsert with half inserts and half updates */
     .IMPORT INFILE ./ALLTYPE.data
        LAYOUT LAY0734 FROM 1 FOR 400
        APPLY LABEL0734A WHERE FF3 = 'TERADATA';
.IMPORT INFILE ./ALLTYPE.data
        LAYOUT LAY0734 FROM 1 FOR 400
        APPLY LABEL0734B;
.END LOAD;
.LOGOFF;

このスクリプトは、次の出力を生成します(2回目のインポート中に再起動されたと想定)。

  
     ========================================================================
     =                                                                      =
     =          Teradata Parallel Data Pump Utility    Release 17.20.00.02  =
     =          Platform WIN 64-bit                                         =
     =          PID      14184                                              =
     =                                                                      =
     ========================================================================
     =                                                                      =
     =     Copyright 1997-2022 Teradata. All rights reserved.               =
     =                                                                      =
     ========================================================================
**** 03:54:32 UTY2411 Processing start date: FRI MAY 20, 2022
     ========================================================================
     =                                                                      =
     =          Logon/Connection                                            =
     =                                                                      =
     ========================================================================
0001 /************************************************/
     /* Script Name: TP0734                          */
     /* Description: WIN 64-bit script.              */
     /***********************************************/
 .LOGTABLE TPLOG0044;
0002 .LOGON NODEID/FLUSER,;
**** 03:54:32 UTY8400 Teradata Database Release: 17.20.00.00
**** 03:54:32 UTY8400 Teradata Database Version: 17.20.00.00
**** 03:54:32 UTY8400 Default character set: ASCII
**** 03:54:32 UTY8400 Current RDBMS has UDT support
**** 03:54:32 UTY8400 Current RDBMS has Large Decimal support
**** 03:54:32 UTY8400 Current RDBMS has Statement Info Parcel support
**** 03:54:32 UTY8400 Maximum supported buffer size: 1M
**** 03:54:32 UTY8400 Upsert supported by RDBMS server
**** 03:54:32 UTY8400 Data Encryption supported by RDBMS server
**** 03:54:32 UTY8400 Array Support supported by RDBMS server
**** 03:54:32 UTY8400 Statement Independence supported by RDBMS server
**** 03:54:32 UTY6211 A successful connect was made to the RDBMS.
**** 03:54:32 UTY6217 Logtable 'FLUSER.TPLOG0044' has been created.
     ========================================================================
     =                                                                      =
     =                      Processing Control Statements                   =
     =                                                                      =
     ========================================================================

0003 DROP TABLE TPTBL0734;
**** 03:54:32 UTY1008 RDBMS failure: 3807, Object 'TPTBL0734' does not exist.
0004 DROP TABLE TPERR0734;
**** 03:54:32 UTY1008 RDBMS failure: 3807, Object 'TPERR0734' does not exist.

0005 /***********************************************/
     /* STEP01 CREATES THE TABLES FOR THE TPump JOB */ 
     /***********************************************/

     CREATE TABLE TPTBL0734, FALLBACK(
            F1 INTEGER,F2 CHAR(50),
            F3 VARCHAR(50),F4 FLOAT,
            F5 BYTE (10),F6 VARBYTE (10),
            F7 DECIMAL(8,2),F8 BYTEINT,
           F9 SMALLINT,F10 DATE,
           F11 BIGINT,F12 DECIMAL(38,0))
           UNIQUE PRIMARY INDEX (F1);
**** 03:54:33 UTY1016 'CREATE' request successful.

0006 /***********************************************/
     /* BEGIN LOAD WITH ALL THE OPTIONS SPECIFIED */
     /* SUCH AS ERRLIMIT, CHECKPOINT, SESSIONS, */
     /* TENACITY, etc. */
    /***********************************************/
.BEGIN LOAD CHECKPOINT 15 SESSIONS 4 1
            TENACITY 2 ERRORTABLE TPERR0734 
            ERRLIMIT 10ROBUST OFF
            PACK 500 DATAENCRYPTION ON
            ARRAYSUPPORT OFF RATE 200
            RETRYTIMES 200 SLEEP 40
            NOATOMICUPSERT MACRODB TPUSER 
            NOTIFY OFF SERIALIZE ON; 

  ========================================================================
  =                                                                      =
  =                       Processing TPump Statements                    =
  =                                                                      =
  ========================================================================
0007 .LAYOUT LAY0734;
0008 .FIELD FF1 * INTEGER KEY;
0009 .FIELD FF2 * CHAR(50);
0010 .FIELD FF3 * VARCHAR(50);
0011 .FIELD FF4 * FLOAT;
0012 .FIELD FF5 * BYTE(10);
0013 .FIELD FF6 * VARBYTE(10);
0014 .FIELD FF7 * DECIMAL(8,2);
0015 .FIELD FF8 * BYTEINT;
0016 .FIELD FF9 * SMALLINT;
0017 .FIELD FF10 * DATE;
0018 .FIELD FF11 * BIGINT;
0019 .FIELD FF12 * DECIMAL(38,0);

0020 /* insert half of the rows ......................*/
.DML LABEL LABEL0734A IGNORE DUPLICATE ROWS
                      IGNORE MISSING ROWS
                      IGNORE EXTRA ROWS;
0021 INSERT INTO TPTBL0734 VALUES ( :FF1, :FF2, :FF3, :FF4,
                                    :FF5, :FF6, :FF7, :FF8,
                                    :FF9, :FF10, :FF11, :FF12);
0022 /* ... and then upsert all of the rows ..........*/
     .DML LABEL LABEL0734B IGNORE DUPLICATE ROWS 
                           IGNORE MISSING ROWS
                           IGNORE EXTRA ROWS
                           DO INSERT FOR MISSING UPDATE ROWS;
0023 UPDATE TPTBL0734 SET F7 = F7 + 1 WHERE F1 = :FF1;
0024 INSERT INTO TPTBL0734 VALUES ( :FF1, :FF2, :FF3, :FF4,
                                    :FF5, :FF6, :FF7, :FF8,
                                   :FF9, :FF10, :FF11, :FF12);
0025 /* should result in an upsert with half inserts and half updates */
     .IMPORT INFILE ./ALLTYPE.data
             LAYOUT LAY0734 FROM 1 FOR 400
             APPLY LABEL0734A WHERE FF3 = 'TERADATA';
0026 .IMPORT INFILE ./ALLTYPE.data
             LAYOUT LAY0734 FROM 1 FOR 400
             APPLY LABEL0734B;
0027 .END LOAD;
**** 03:54:33 UTY6609 Starting to log on sessions...
**** 03:54:33 UTY6610 Logged on 3 sessions.
     ========================================================================
     =                                                                      =
     =                       TPump Import(s) Beginning                      =
     =                                                                      =
     ========================================================================
**** 03:54:33 UTY6630 Options in effect for following TPump Import(s):
     .        Tenacity: 2 hour limit to successfully connect load sessions.
     .        Max Sessions: 4 session(s).
     .        Min Sessions: 1 session(s).
     .        Checkpoint: 15 minute(s).
     .        Errlimit: 10 rejected record(s).
     .        Restart Mode: SIMPLE. 
     .        Serialization: ON.
              Packing: 500 Statements per Request.
     .        StartUp Rate: 200 Statements per Minute.
     .        Rate Per Period: 50 Statements per 15000 milliseconds.
     .        Atomic Upsert: DISABLED.
**** 03:54:59 UTY6625 WARNING: Packing has changed to 211 statement(s) per
     request.
**** 03:54:59 UTY6664 PACK factor was determined by the USING variable limit.
     Apply: 1, Stmt: 1.
**** 03:54:59 UTY8802 WARNING: Rate Monitoring turned off - database       
     TPumpMacro does not exist.
**** 03:54:59 UTY6608 Import 1 begins.
**** 03:55:59 UTY6641 Since last chkpt., 400 recs. in, 200 stmts., 8 reqs
**** 03:55:59 UTY6647 Since last chkpt., avg. DBS wait time: 91.63
**** 03:55:59 UTY6612 Beginning final checkpoint...
**** 03:55:59 UTY6641 Since last chkpt., 400 recs. in, 200 stmts., 8 reqs
**** 03:55:59 UTY6647 Since last chkpt., avg. DBS wait time: 91.63
**** 03:55:59 UTY6607 Checkpoint Completes with 200 rows sent.
**** 03:55:59 UTY6642 Import 1 statements: 200, requests: 8
**** 03:55:59 UTY6643 Import 1 average statements per request: 25.00
**** 03:55:59 UTY6644 Import 1 average statements per record: 1.00
**** 03:55:59 UTY6645 Import 1 statements/session: avg. 66.67, min. 66.00,         
     max. 67.00
**** 03:55:59 UTY6646 Import 1 requests/session: average 2.67, minimum 2.00,
     maximum 3.00
**** 03:55:59 UTY6648 Import 1 DBS wait time/session: avg. 244.33, min. 15.00,
     max. 499.00
**** 03:55:59 UTY6649 Import 1 DBS wait time/request: avg. 82.28, min. 7.50,
     max. 166.33
**** 03:55:59 UTY1823 Import processing statistics
     .                                           IMPORT 1 Total thus far
     .                                           ========= ==============
     Candidate records considered:....                 400 400
     Apply conditions satisfied:......                 200 200
     Records logable to error table:..                   0 0
     Candidate records rejected:......                   0 0
**** Statistics for Apply Label : LABEL0734A
     Type: I
     Database: TPUSER
     Table or Macro Name: TPTBL0734
     Activity: 200
**** 03:55:59 UTY6677 Loading phase statistics
     Elapsed time: 00:00:01:00(dd:hh:mm:ss)
     CPU time: 0 Seconds
     MB/sec: 0.000403333
     MB/cpusec: N/A
**** 03:56:07 UTY8802 WARNING: Rate Monitoring turned off - database    
     TPumpMacro does not exist.
**** 03:56:07 UTY6608 Import 2 begins.
**** 03:58:08 UTY6641 Since last chkpt., 400 recs. in, 600 stmts., 24 reqs
**** 03:58:08 UTY6647 Since last chkpt., avg. DBS wait time: 107.92
**** 03:58:08 UTY6612 Beginning final checkpoint...
**** 03:58:08 UTY6641 Since last chkpt., 400 recs. in, 600 stmts., 24 reqs
**** 03:58:08 UTY6647 Since last chkpt., avg. DBS wait time: 107.92
**** 03:58:08 UTY6607 Checkpoint Completes with 400 rows sent.
**** 03:58:08 UTY6642 Import 2 statements: 600, requests: 24
**** 03:58:08 UTY6643 Import 2 average statements per request: 25.00
**** 03:58:08 UTY6644 Import 2 average statements per record: 1.50
**** 03:58:08 UTY6645 Import 2 statements/session: avg. 200.00, min. 199.00,
     max. 201.00
**** 03:58:08 UTY6646 Import 2 requests/session: average 8.00, minimum 6.00,
     maximum 10.00
**** 03:58:08 UTY6648 Import 2 DBS wait time/session: avg. 863.33, min. 94.00,
     max. 2028.00
**** 03:58:08 UTY6649 Import 2 DBS wait time/request: avg. 92.32, min. 15.67,
     max. 202.80
**** 03:58:08 UTY1823 Import processing statistics
     .                                                IMPORT 2 Total thus far
     .                                                ========= ==============
     Candidate records considered:....                      400 800
     Apply conditions satisfied:......                      400 600
     Records logable to error table:..                        0 0
     Candidate records rejected:......                        0 0
**** Statistics for Apply Label : LABEL0734B
     Type: U
     Database: TPUSER
     Table or Macro Name: TPTBL0734
     Activity: 200
     Type: I
     Database: TPUSER
     Table or Macro Name: TPTBL0734
     Activity: 200
**** 03:58:08 UTY6677 Loading phase statistics
     Elapsed time: 00:00:02:01(dd:hh:mm:ss)
     CPU time: 0.0312002 Seconds
     MB/sec: 0.0004
     MB/cpusec: 1.55127
**** 03:58:08 UTY0821 Error table TPUSER.TPERR0734 is EMPTY, dropping table.
0028 .LOGOFF;
     ========================================================================
     =                                                                      =
     =                  Logoff/Disconnect                                   =
     =                                                                      =
     ========================================================================
**** 3:58:09 UTY6216 The restart log table has been dropped.
**** 3:58:09 UTY6212 A successful disconnect was made from the RDBMS.
**** 3:58:09 UTY2410 Total processor time used = '4.30563 Seconds'
     .       Start : 03:54:05 - FRI MAY 20, 2022
     .       End :   03:58:06 - FRI MAY 20, 2022
     .       Highest return code encountered = '0'.