17.10 - Multiple DataConnector Instance Support - Access Module

Teradata® Tools and Utilities Access Module Reference

Product
Access Module
Release Number
17.10
Published
October 2021
Language
English (United States)
Last Update
2021-11-02
dita:mapPath
uur1608578381725.ditamap
dita:ditavalPath
obe1474387269547.ditaval

Starting with TTU 16.20, Teradata Access Module for Azure Blob supports multiple DataConnector instances.

You can export data parallelly using multiple instances of TPT DC operator from Teradata to blob storage with higher throughput and import data using multiple instances of TPT DC operator.

Teradata Access Module for Azure Blob receives information about the number of TPT DC instances and instance number of each TPT DC instance number from TPT.

The access module appends the instance numbers to the blob object files.
  • In the export job, it appends the instance number to the blob object files which allows writing data to multiple blob object files parallelly.
  • In the import job, it appends the instance number to the blob object files so that every tpt dc instance will have a unique blob object to read.

Example

DEFINE JOB EXPORT_FROM_TERADATA
DESCRIPTION 'Export data from Teradata to Azure blob storage using Multiple FileWriter instance'
(
      STEP EXPORT_THE_DATA
      (
         APPLY TO OPERATOR ( $FILE_WRITER()[8]
         ATTR
         (
           AccessModuleName = 'libazureaxsmod.so',
           AccessModuleInitStr = '-Container  <container> -Prefix <prefix> -Object <blobojectfile> -SinglePartFile True'
          )
        )
      SELECT * FROM OPERATOR ( $EXPORT
      ATTR
      (
         SelectStmt = 'SELECT * FROM S3W001_src;'
      )
     );
   );
);

Procedure to Run

tbuild -C -f TPT_EXPORT_WITHMultiInstance.tpt -v jobvar_multiinstance -j explog22

Output

Teradata Access Module for Azure Blob will create 8 blob object files and the export job will be performed parallelly using 8 TPT DC instances.

Teradata Parallel Transporter Version 17.10.00.12 64-Bit
The global configuration file '/opt/teradata/client/17.10/tbuild/twbcfg.ini' is used.
   Log Directory: /opt/teradata/client/17.10/tbuild/logs
   Checkpoint Directory: /opt/teradata/client/17.10/tbuild/checkpoint


Job log: /opt/teradata/client/17.10/tbuild/logs/explog22-1.out
Job id is explog22-1, running on Machine0001
Teradata Parallel Transporter Export Operator Version 17.10.00.12
$EXPORT: private log specified: EXPORT_OPERATOR_LOG
$FILE_WRITER[4]: Instance 4 directing private log report to 'FILE_WRITER_LOG-4'.
$FILE_WRITER[8]: Instance 8 directing private log report to 'FILE_WRITER_LOG-8'.
Teradata Parallel Transporter DataConnector Operator Version 17.10.00.12
$FILE_WRITER[5]: Instance 5 directing private log report to 'FILE_WRITER_LOG-5'.
$FILE_WRITER[6]: Instance 6 directing private log report to 'FILE_WRITER_LOG-6'.
$FILE_WRITER[3]: Instance 3 directing private log report to 'FILE_WRITER_LOG-3'.
AZUREAXM [18062]:  'MODULE_NAME=Teradata Access Module for Microsoft Azure' Version: MODULE_VERS=17.10.00.06.
AZUREAXM [18062]: COPYRIGHT 2021, Teradata Corporation.  ALL RIGHTS RESERVED.
AZUREAXM [18062]: Compiled for PLATFORM_ID=Linux x8664 (64 bit) on Oct 19 2021
AZUREAXM [18062]: pmdcomt header version 'Common 17.10.00.02', packing 'pack (push, 1)'
AZUREAXM [18062]: pmddamt header version 'Common 17.10.00.00', packing 'pack (push, 1)'
AZUREAXM [18064]:  'MODULE_NAME=Teradata Access Module for Microsoft Azure' Version: MODULE_VERS=17.10.00.06.
AZUREAXM [18064]: COPYRIGHT 2021, Teradata Corporation.  ALL RIGHTS RESERVED.
AZUREAXM [18064]: Compiled for PLATFORM_ID=Linux x8664 (64 bit) on Oct 19 2020
AZUREAXM [18064]: pmdcomt header version 'Common 17.10.00.02', packing 'pack (push, 1)'
AZUREAXM [18064]: pmddamt header version 'Common 17.10.00.00', packing 'pack (push, 1)'
AZUREAXM [18061]:  'MODULE_NAME=Teradata Access Module for Microsoft Azure' Version: MODULE_VERS=17.10.00.06.
AZUREAXM [18061]: COPYRIGHT 2021, Teradata Corporation.  ALL RIGHTS RESERVED.
AZUREAXM [18061]: Compiled for PLATFORM_ID=Linux x8664 (64 bit) on Oct 19 2020
AZUREAXM [18061]: pmdcomt header version 'Common 17.10.00.02', packing 'pack (push, 1)'
AZUREAXM [18061]: pmddamt header version 'Common 17.10.00.00', packing 'pack (push, 1)'
AZUREAXM [18064]: AXMS3 Library built on Oct 25 2019 17:11:42
AZUREAXM [18064]: Initialization String is '-Container  <<Container>> -Prefix "<<Prefix>>/" -Object multi_part_exp -SinglePartFile True'
AZUREAXM [18064]: Default Azure axsmod Credentials directory set from $HOME to: /root/azureaxsmod
AZUREAXM [18064]: Attribute Set Request type 2: 'TBR_OP_HANDLE'
AZUREAXM [18064]: Running in Multi-Stream mode. This is session 8 of 8
AZUREAXM [18064]: Attribute Set Request type 1: 'CHARSET_NAME=ASCII'
AZUREAXM [18064]: Attribute Set Request type 1: 'PRESERVE_RESTART_INFO=YES'
AZUREAXM [18059]:  'MODULE_NAME=Teradata Access Module for Microsoft Azure' Version: MODULE_VERS=17.10.00.06.
AZUREAXM [18059]: COPYRIGHT 2021, Teradata Corporation.  ALL RIGHTS RESERVED.
AZUREAXM [18059]: Compiled for PLATFORM_ID=Linux x8664 (64 bit) on Oct 19 2020
AZUREAXM [18059]: pmdcomt header version 'Common 17.10.00.02', packing 'pack (push, 1)'
AZUREAXM [18059]: pmddamt header version 'Common 17.10.00.00', packing 'pack (push, 1)'
AZUREAXM [18060]:  'MODULE_NAME=Teradata Access Module for Microsoft Azure' Version: MODULE_VERS=17.10.00.06.
AZUREAXM [18060]: COPYRIGHT 2021, Teradata Corporation.  ALL RIGHTS RESERVED.
AZUREAXM [18060]: Compiled for PLATFORM_ID=Linux x8664 (64 bit) on Oct 19 2020
AZUREAXM [18060]: pmdcomt header version 'Common 17.10.00.02', packing 'pack (push, 1)'
AZUREAXM [18060]: pmddamt header version 'Common 17.10.00.00', packing 'pack (push, 1)'
AZUREAXM [18060]: AXMS3 Library built on Oct 25 2019 17:11:42
AZUREAXM [18060]: Initialization String is '-Container  <<Container>> -Prefix "<<Prefix>>/" -Object multi_part_exp -SinglePartFile True'
AZUREAXM [18060]: Default Azure axsmod Credentials directory set from $HOME to: /root/azureaxsmod
$FILE_WRITER[7]: Instance 7 directing private log report to 'FILE_WRITER_LOG-7'.
$FILE_WRITER[1]: Instance 1 directing private log report to 'FILE_WRITER_LOG-1'.
$FILE_WRITER[2]: Instance 2 directing private log report to 'FILE_WRITER_LOG-2'.
AZUREAXM [18060]: Attribute Set Request type 2: 'TBR_OP_HANDLE'
AZUREAXM [18060]: Running in Multi-Stream mode. This is session 4 of 8
AZUREAXM [18060]: Attribute Set Request type 1: 'CHARSET_NAME=ASCII'
AZUREAXM [18060]: Attribute Set Request type 1: 'PRESERVE_RESTART_INFO=YES'
AZUREAXM [18058]:  'MODULE_NAME=Teradata Access Module for Microsoft Azure' Version: MODULE_VERS=17.10.00.06.
AZUREAXM [18058]: COPYRIGHT 2021, Teradata Corporation.  ALL RIGHTS RESERVED.
AZUREAXM [18058]: Compiled for PLATFORM_ID=Linux x8664 (64 bit) on Oct 19 2020
AZUREAXM [18058]: pmdcomt header version 'Common 17.10.00.02', packing 'pack (push, 1)'
AZUREAXM [18058]: pmddamt header version 'Common 17.10.00.00', packing 'pack (push, 1)'
AZUREAXM [18064]: Attribute Set Request type 2: 'RECORD_TYPE'
AZUREAXM [18063]:  'MODULE_NAME=Teradata Access Module for Microsoft Azure' Version: MODULE_VERS=17.10.00.06.
AZUREAXM [18063]: COPYRIGHT 2021, Teradata Corporation.  ALL RIGHTS RESERVED.
AZUREAXM [18063]: Compiled for PLATFORM_ID=Linux x8664 (64 bit) on Oct 19 2020
AZUREAXM [18063]: pmdcomt header version 'Common 17.10.00.02', packing 'pack (push, 1)'
AZUREAXM [18063]: pmddamt header version 'Common 17.10.00.00', packing 'pack (push, 1)'
$FILE_WRITER[1]: DataConnector Consumer operator Instances: 8
AZUREAXM [18060]: Attribute Set Request type 2: 'RECORD_TYPE'
AZUREAXM [18057]:  'MODULE_NAME=Teradata Access Module for Microsoft Azure' Version: MODULE_VERS=17.10.00.06.
AZUREAXM [18057]: COPYRIGHT 2021, Teradata Corporation.  ALL RIGHTS RESERVED.
AZUREAXM [18057]: Compiled for PLATFORM_ID=Linux x8664 (64 bit) on Oct 19 2020
AZUREAXM [18057]: pmdcomt header version 'Common 17.10.00.02', packing 'pack (push, 1)'
AZUREAXM [18057]: pmddamt header version 'Common 17.10.00.00', packing 'pack (push, 1)'
AZUREAXM [18061]: AXMS3 Library built on Oct 25 2019 17:11:42
AZUREAXM [18061]: Initialization String is '-Container  <<Container>> -Prefix "<<Prefix>>/" -Object multi_part_exp -SinglePartFile True'
AZUREAXM [18061]: Default Azure axsmod Credentials directory set from $HOME to: /root/azureaxsmod
AZUREAXM [18061]: Attribute Set Request type 2: 'TBR_OP_HANDLE'
AZUREAXM [18057]: AXMS3 Library built on Oct 25 2019 17:11:42
AZUREAXM [18057]: Initialization String is '-Container  <<Container>> -Prefix "<<Prefix>>/" -Object multi_part_exp -SinglePartFile True'
AZUREAXM [18057]: Default Azure axsmod Credentials directory set from $HOME to: /root/azureaxsmod
AZUREAXM [18057]: Attribute Set Request type 2: 'TBR_OP_HANDLE'
AZUREAXM [18057]: Running in Multi-Stream mode. This is session 1 of 8
AZUREAXM [18057]: Attribute Set Request type 1: 'CHARSET_NAME=ASCII'
AZUREAXM [18057]: Attribute Set Request type 1: 'PRESERVE_RESTART_INFO=YES'
AZUREAXM [18063]: AXMS3 Library built on Oct 25 2019 17:11:42
AZUREAXM [18063]: Initialization String is '-Container  <<Container>> -Prefix "<<Prefix>>/" -Object multi_part_exp -SinglePartFile True'
AZUREAXM [18063]: Default Azure axsmod Credentials directory set from $HOME to: /root/azureaxsmod
AZUREAXM [18063]: Attribute Set Request type 2: 'TBR_OP_HANDLE'
AZUREAXM [18063]: Running in Multi-Stream mode. This is session 7 of 8
AZUREAXM [18063]: Attribute Set Request type 1: 'CHARSET_NAME=ASCII'
AZUREAXM [18063]: Attribute Set Request type 1: 'PRESERVE_RESTART_INFO=YES'
AZUREAXM [18059]: AXMS3 Library built on Oct 25 2019 17:11:42
AZUREAXM [18059]: Initialization String is '-Container  <<Container>> -Prefix "<<Prefix>>/" -Object multi_part_exp -SinglePartFile True'
AZUREAXM [18059]: Default Azure axsmod Credentials directory set from $HOME to: /root/azureaxsmod
AZUREAXM [18059]: Attribute Set Request type 2: 'TBR_OP_HANDLE'
AZUREAXM [18059]: Running in Multi-Stream mode. This is session 3 of 8
AZUREAXM [18059]: Attribute Set Request type 1: 'CHARSET_NAME=ASCII'
AZUREAXM [18059]: Attribute Set Request type 1: 'PRESERVE_RESTART_INFO=YES'
AZUREAXM [18059]: Attribute Set Request type 2: 'RECORD_TYPE'
AZUREAXM [18058]: AXMS3 Library built on Oct 25 2019 17:11:42
AZUREAXM [18058]: Initialization String is '-Container  <<Container>> -Prefix "<<Prefix>>/" -Object multi_part_exp -SinglePartFile True'
AZUREAXM [18058]: Default Azure axsmod Credentials directory set from $HOME to: /root/azureaxsmod
AZUREAXM [18058]: Attribute Set Request type 2: 'TBR_OP_HANDLE'
AZUREAXM [18058]: Running in Multi-Stream mode. This is session 2 of 8
AZUREAXM [18058]: Attribute Set Request type 1: 'CHARSET_NAME=ASCII'
AZUREAXM [18058]: Attribute Set Request type 1: 'PRESERVE_RESTART_INFO=YES'
AZUREAXM [18062]: AXMS3 Library built on Oct 25 2019 17:11:42
AZUREAXM [18062]: Initialization String is '-Container  <<Container>> -Prefix "<<Prefix>>/" -Object multi_part_exp -SinglePartFile True'
AZUREAXM [18062]: Default Azure axsmod Credentials directory set from $HOME to: /root/azureaxsmod
AZUREAXM [18062]: Attribute Set Request type 2: 'TBR_OP_HANDLE'
AZUREAXM [18062]: Running in Multi-Stream mode. This is session 6 of 8
AZUREAXM [18062]: Attribute Set Request type 1: 'CHARSET_NAME=ASCII'
AZUREAXM [18062]: Attribute Set Request type 1: 'PRESERVE_RESTART_INFO=YES'
AZUREAXM [18062]: Attribute Set Request type 2: 'RECORD_TYPE'
AZUREAXM [18061]: Running in Multi-Stream mode. This is session 5 of 8
AZUREAXM [18061]: Attribute Set Request type 1: 'CHARSET_NAME=ASCII'
AZUREAXM [18061]: Attribute Set Request type 1: 'PRESERVE_RESTART_INFO=YES'
AZUREAXM [18061]: Attribute Set Request type 2: 'RECORD_TYPE'
$EXPORT: connecting sessions
AZUREAXM [18058]: Attribute Set Request type 2: 'RECORD_TYPE'
AZUREAXM [18063]: Attribute Set Request type 2: 'RECORD_TYPE'
AZUREAXM [18057]: Attribute Set Request type 2: 'RECORD_TYPE'
$FILE_WRITER[1]: ECI operator ID: '$FILE_WRITER-18057'
AZUREAXM [18064]:   Parameter Name                Parameter Value                     Parameter Origin
AZUREAXM [18064]:   --------------------          --------------------------------    ---------------------
AZUREAXM [18064]:   ConfigDir                   = /root/azureaxsmod                   Default
AZUREAXM [18064]:   JobProfile                  = default                             Default
AZUREAXM [18064]:   Container                   = <<Container>>                       Module Parameters
AZUREAXM [18064]:   Prefix                      = <<Prefix>>/                        Module Parameters
AZUREAXM [18064]:   Object                      = multi_part_exp-8                    Module Parameters
AZUREAXM [18064]:   ConnectionCount             = 10                                  Default
AZUREAXM [18064]:   BufferCount                 = 20                                  Computed Default
AZUREAXM [18064]:   BufferSize                  = 4194304                             Default
AZUREAXM [18064]:   SinglePartFile              = True                                Module Parameters
AZUREAXM [18064]:   PartsPerFile                = 50000                               Default
AZUREAXM [18064]:   StorageAccountName          = <<UserStorageAccount>>                 AZUREAXSMOD "credentials" file
AZUREAXM [18064]:   StorageAccountEndPoint      = <<UserStorageAccEndPoint>>              AZUREAXSMOD "credentials" file
AZUREAXM [18064]:   DontSplitRows               = False                               Default
AZUREAXM [18064]:   MaxObjectSize               = 209715200000                        Computed Default
AZUREAXM [18064]:   ---------------------------------------------------------------------------------------
AZUREAXM [18059]:   Parameter Name                Parameter Value                     Parameter Origin
AZUREAXM [18059]:   --------------------          --------------------------------    ---------------------
AZUREAXM [18059]:   ConfigDir                   = /root/azureaxsmod                   Default
AZUREAXM [18059]:   JobProfile                  = default                             Default
AZUREAXM [18059]:   Container                   = <<Container>>                       Module Parameters
AZUREAXM [18059]:   Prefix                      = <<Prefix>>/                        Module Parameters
AZUREAXM [18059]:   Object                      = multi_part_exp-3                    Module Parameters
AZUREAXM [18059]:   ConnectionCount             = 10                                  Default
AZUREAXM [18059]:   BufferCount                 = 20                                  Computed Default
AZUREAXM [18059]:   BufferSize                  = 4194304                             Default
AZUREAXM [18059]:   SinglePartFile              = True                                Module Parameters
AZUREAXM [18059]:   PartsPerFile                = 50000                               Default
AZUREAXM [18059]:   StorageAccountName          = <<UserStorageAccount>>                 AZUREAXSMOD "credentials" file
AZUREAXM [18059]:   StorageAccountEndPoint      = <<UserStorageAccEndPoint>>              AZUREAXSMOD "credentials" file
AZUREAXM [18059]:   DontSplitRows               = False                               Default
AZUREAXM [18059]:   MaxObjectSize               = 209715200000                        Computed Default
AZUREAXM [18059]:   ---------------------------------------------------------------------------------------
AZUREAXM [18060]:   Parameter Name                Parameter Value                     Parameter Origin
AZUREAXM [18060]:   --------------------          --------------------------------    ---------------------
AZUREAXM [18060]:   ConfigDir                   = /root/azureaxsmod                   Default
AZUREAXM [18060]:   JobProfile                  = default                             Default
AZUREAXM [18060]:   Container                   = <<Container>>                       Module Parameters
AZUREAXM [18060]:   Prefix                      = <<Prefix>>/                        Module Parameters
AZUREAXM [18060]:   Object                      = multi_part_exp-4                    Module Parameters
AZUREAXM [18060]:   ConnectionCount             = 10                                  Default
AZUREAXM [18060]:   BufferCount                 = 20                                  Computed Default
AZUREAXM [18060]:   BufferSize                  = 4194304                             Default
AZUREAXM [18060]:   SinglePartFile              = True                                Module Parameters
AZUREAXM [18060]:   PartsPerFile                = 50000                               Default
AZUREAXM [18060]:   StorageAccountName          = <<UserStorageAccount>>                 AZUREAXSMOD "credentials" file
AZUREAXM [18060]:   StorageAccountEndPoint      = <<UserStorageAccEndPoint>>              AZUREAXSMOD "credentials" file
AZUREAXM [18060]:   DontSplitRows               = False                               Default
AZUREAXM [18060]:   MaxObjectSize               = 209715200000                        Computed Default
AZUREAXM [18060]:   ---------------------------------------------------------------------------------------
AZUREAXM [18061]:   Parameter Name                Parameter Value                     Parameter Origin
AZUREAXM [18061]:   --------------------          --------------------------------    ---------------------
AZUREAXM [18061]:   ConfigDir                   = /root/azureaxsmod                   Default
AZUREAXM [18061]:   JobProfile                  = default                             Default
AZUREAXM [18061]:   Container                   = <<Container>>                       Module Parameters
AZUREAXM [18061]:   Prefix                      = <<Prefix>>/                        Module Parameters
AZUREAXM [18061]:   Object                      = multi_part_exp-5                    Module Parameters
AZUREAXM [18061]:   ConnectionCount             = 10                                  Default
AZUREAXM [18061]:   BufferCount                 = 20                                  Computed Default
AZUREAXM [18061]:   BufferSize                  = 4194304                             Default
AZUREAXM [18061]:   SinglePartFile              = True                                Module Parameters
AZUREAXM [18061]:   PartsPerFile                = 50000                               Default
AZUREAXM [18061]:   StorageAccountName          = <<UserStorageAccount>>                 AZUREAXSMOD "credentials" file
AZUREAXM [18061]:   StorageAccountEndPoint      = <<UserStorageAccEndPoint>>              AZUREAXSMOD "credentials" file
AZUREAXM [18061]:   DontSplitRows               = False                               Default
AZUREAXM [18061]:   MaxObjectSize               = 209715200000                        Computed Default
AZUREAXM [18061]:   ---------------------------------------------------------------------------------------
AZUREAXM [18062]:   Parameter Name                Parameter Value                     Parameter Origin
AZUREAXM [18062]:   --------------------          --------------------------------    ---------------------
AZUREAXM [18062]:   ConfigDir                   = /root/azureaxsmod                   Default
AZUREAXM [18062]:   JobProfile                  = default                             Default
AZUREAXM [18062]:   Container                   = <<Container>>                       Module Parameters
AZUREAXM [18062]:   Prefix                      = <<Prefix>>/                        Module Parameters
AZUREAXM [18062]:   Object                      = multi_part_exp-6                    Module Parameters
AZUREAXM [18062]:   ConnectionCount             = 10                                  Default
AZUREAXM [18062]:   BufferCount                 = 20                                  Computed Default
AZUREAXM [18062]:   BufferSize                  = 4194304                             Default
AZUREAXM [18062]:   SinglePartFile              = True                                Module Parameters
AZUREAXM [18062]:   PartsPerFile                = 50000                               Default
AZUREAXM [18062]:   StorageAccountName          = <<UserStorageAccount>>                 AZUREAXSMOD "credentials" file
AZUREAXM [18062]:   StorageAccountEndPoint      = <<UserStorageAccEndPoint>>              AZUREAXSMOD "credentials" file
AZUREAXM [18062]:   DontSplitRows               = False                               Default
AZUREAXM [18062]:   MaxObjectSize               = 209715200000                        Computed Default
AZUREAXM [18062]:   ---------------------------------------------------------------------------------------
AZUREAXM [18063]:   Parameter Name                Parameter Value                     Parameter Origin
AZUREAXM [18063]:   --------------------          --------------------------------    ---------------------
AZUREAXM [18063]:   ConfigDir                   = /root/azureaxsmod                   Default
AZUREAXM [18063]:   JobProfile                  = default                             Default
AZUREAXM [18063]:   Container                   = <<Container>>                       Module Parameters
AZUREAXM [18063]:   Prefix                      = <<Prefix>>/                        Module Parameters
AZUREAXM [18063]:   Object                      = multi_part_exp-7                    Module Parameters
AZUREAXM [18063]:   ConnectionCount             = 10                                  Default
AZUREAXM [18063]:   BufferCount                 = 20                                  Computed Default
AZUREAXM [18063]:   BufferSize                  = 4194304                             Default
AZUREAXM [18063]:   SinglePartFile              = True                                Module Parameters
AZUREAXM [18063]:   PartsPerFile                = 50000                               Default
AZUREAXM [18063]:   StorageAccountName          = <<UserStorageAccount>>                 AZUREAXSMOD "credentials" file
AZUREAXM [18063]:   StorageAccountEndPoint      = <<UserStorageAccEndPoint>>              AZUREAXSMOD "credentials" file
AZUREAXM [18063]:   DontSplitRows               = False                               Default
AZUREAXM [18063]:   MaxObjectSize               = 209715200000                        Computed Default
AZUREAXM [18063]:   ---------------------------------------------------------------------------------------
AZUREAXM [18058]:   Parameter Name                Parameter Value                     Parameter Origin
AZUREAXM [18058]:   --------------------          --------------------------------    ---------------------
AZUREAXM [18058]:   ConfigDir                   = /root/azureaxsmod                   Default
AZUREAXM [18058]:   JobProfile                  = default                             Default
AZUREAXM [18058]:   Container                   = <<Container>>                       Module Parameters
AZUREAXM [18058]:   Prefix                      = <<Prefix>>/                        Module Parameters
AZUREAXM [18058]:   Object                      = multi_part_exp-2                    Module Parameters
AZUREAXM [18058]:   ConnectionCount             = 10                                  Default
AZUREAXM [18058]:   BufferCount                 = 20                                  Computed Default
AZUREAXM [18058]:   BufferSize                  = 4194304                             Default
AZUREAXM [18058]:   SinglePartFile              = True                                Module Parameters
AZUREAXM [18058]:   PartsPerFile                = 50000                               Default
AZUREAXM [18058]:   StorageAccountName          = <<UserStorageAccount>>                 AZUREAXSMOD "credentials" file
AZUREAXM [18058]:   StorageAccountEndPoint      = <<UserStorageAccEndPoint>>              AZUREAXSMOD "credentials" file
AZUREAXM [18058]:   DontSplitRows               = False                               Default
AZUREAXM [18058]:   MaxObjectSize               = 209715200000                        Computed Default
AZUREAXM [18058]:   ---------------------------------------------------------------------------------------
AZUREAXM [18057]:   Parameter Name                Parameter Value                     Parameter Origin
AZUREAXM [18057]:   --------------------          --------------------------------    ---------------------
AZUREAXM [18057]:   ConfigDir                   = /root/azureaxsmod                   Default
AZUREAXM [18057]:   JobProfile                  = default                             Default
AZUREAXM [18057]:   Container                   = <<Container>>                       Module Parameters
AZUREAXM [18057]:   Prefix                      = <<Prefix>>/                        Module Parameters
AZUREAXM [18057]:   Object                      = multi_part_exp-1                    Module Parameters
AZUREAXM [18057]:   ConnectionCount             = 10                                  Default
AZUREAXM [18057]:   BufferCount                 = 20                                  Computed Default
AZUREAXM [18057]:   BufferSize                  = 4194304                             Default
AZUREAXM [18057]:   SinglePartFile              = True                                Module Parameters
AZUREAXM [18057]:   PartsPerFile                = 50000                               Default
AZUREAXM [18057]:   StorageAccountName          = <<UserStorageAccount>>                 AZUREAXSMOD "credentials" file
AZUREAXM [18057]:   StorageAccountEndPoint      = <<UserStorageAccEndPoint>>              AZUREAXSMOD "credentials" file
AZUREAXM [18057]:   DontSplitRows               = False                               Default
AZUREAXM [18057]:   MaxObjectSize               = 209715200000                        Computed Default
AZUREAXM [18057]:   ---------------------------------------------------------------------------------------
$EXPORT: sending SELECT request
$EXPORT: entering End Export Phase
$EXPORT: Total Rows Exported:  1342177280
$EXPORT: Total Rows Discarded: 0
AZUREAXM [18058]: EOF Statistics:  15527.887 megabytes sent to Azure Blob Storage in 1693.6 secs,   9.17 megabytes/sec,  28.1 sec user   6.8 sec system
AZUREAXM [18063]: EOF Statistics:  15526.885 megabytes sent to Azure Blob Storage in 1693.5 secs,   9.17 megabytes/sec,  27.6 sec user   6.7 sec system
AZUREAXM [18059]: EOF Statistics:  15527.888 megabytes sent to Azure Blob Storage in 1693.6 secs,   9.17 megabytes/sec,  27.8 sec user   6.3 sec system
AZUREAXM [18062]: EOF Statistics:  15526.886 megabytes sent to Azure Blob Storage in 1693.5 secs,   9.17 megabytes/sec,  28.0 sec user   6.5 sec system
AZUREAXM [18057]: EOF Statistics:  15527.887 megabytes sent to Azure Blob Storage in 1693.6 secs,   9.17 megabytes/sec,  28.4 sec user   7.0 sec system
AZUREAXM [18061]: EOF Statistics:  15526.885 megabytes sent to Azure Blob Storage in 1693.6 secs,   9.17 megabytes/sec,  27.6 sec user   6.6 sec system
AZUREAXM [18060]: EOF Statistics:  15527.305 megabytes sent to Azure Blob Storage in 1693.6 secs,   9.17 megabytes/sec,  27.8 sec user   6.4 sec system
AZUREAXM [18064]: EOF Statistics:  15526.885 megabytes sent to Azure Blob Storage in 1693.5 secs,   9.17 megabytes/sec,  28.0 sec user   6.7 sec system
AZUREAXM [18059]: Attribute Set Request type 1: 'PRESERVE_RESTART_INFO=NO'
AZUREAXM [18059]: Azure Access Module Shutdown Completed
AZUREAXM [18063]: Attribute Set Request type 1: 'PRESERVE_RESTART_INFO=NO'
AZUREAXM [18063]: Azure Access Module Shutdown Completed
AZUREAXM [18057]: Attribute Set Request type 1: 'PRESERVE_RESTART_INFO=NO'
AZUREAXM [18057]: Azure Access Module Shutdown Completed
AZUREAXM [18060]: Attribute Set Request type 1: 'PRESERVE_RESTART_INFO=NO'
AZUREAXM [18060]: Azure Access Module Shutdown Completed
AZUREAXM [18062]: Attribute Set Request type 1: 'PRESERVE_RESTART_INFO=NO'
AZUREAXM [18062]: Azure Access Module Shutdown Completed
AZUREAXM [18061]: Attribute Set Request type 1: 'PRESERVE_RESTART_INFO=NO'
AZUREAXM [18061]: Azure Access Module Shutdown Completed
AZUREAXM [18058]: Attribute Set Request type 1: 'PRESERVE_RESTART_INFO=NO'
AZUREAXM [18058]: Azure Access Module Shutdown Completed
$EXPORT: disconnecting sessions
AZUREAXM [18064]: Attribute Set Request type 1: 'PRESERVE_RESTART_INFO=NO'
AZUREAXM [18064]: Azure Access Module Shutdown Completed
$FILE_WRITER[1]: Total files processed: 8.
$EXPORT: Performance metrics:
$EXPORT:     MB/sec in Export phase: 68.542
$EXPORT:     Elapsed time from start to Select phase:   1 second(s)
$EXPORT:     Elapsed time in Select phase:   737 second(s)
$EXPORT:     Elapsed time in Export phase:   1691 second(s)
$EXPORT:     Elapsed time from Export phase to end:   7 second(s)
$EXPORT: Total processor time used = '243.956 Second(s)'
$EXPORT: Start : Thu Jun  5 23:05:55 2021