2.10 - Solutions for Job Problems - Teradata QueryGrid

Teradata® QueryGrid™ Installation and User Guide

prodname
Teradata QueryGrid
vrm_release
2.10
created_date
September 2019
category
Administration
Configuration
Installation
User Guide
featnum
B035-5991-099K
If errors occur without explanation on why queries are failing, enable logging and increase the messaging count to have errors and messages collected in a support bundle. Send the support bundle to the QueryGrid Manager for troubleshooting. See Logging and Error Handling for information on enabling logging levels.
The following errors originate from the initiating Teradata system.
Problem Description Error Message Solution
Allowed OS user is not correctly configured on initiator system. QGInitiatorExportContract: 2689: (NO UUID YET) ExportMeta : Connection not allowed for OS user id 14 Update allowed OS user on initiator connector. For more information, see Teradata QueryGrid Security.
Allowed OS user is not correctly configured on target system. QGInitiatorExport: 9134: (a14554a5-8a07-492a-be57-000000000004) InitiatorDataExportReq : [Error 9134] QGRemoteImport: 2689: RemoteDataImportReq : Connection not allowed for OS user id 14 Update allowed OS user on target connector. For more information, see Teradata QueryGrid Security.
System memory not sufficient on initiator system. QGInitiatorExport: 10201: (7031532d-f2a4-4a7e-a983-000000000001) InitiatorDataExportReq : shm alloc failed. requested 4198400b + existing 4198400b > max 5mb, linkbuffer size:count 1048576b:4 Increase system memory for initiator system.
System memory not sufficient on target system. qginitiatorimport: 9134: (4bb2afaf-e428-45f1-90e8-000000000001) initiatordataimportreq : [error 9134] qgremoteexport: 10201: remotedataexportreq : shm alloc failed. requested 4198400b + existing 4198400b > max 5mb, linkbuffer size:count 1048576b:4 Increase system memory for target system.
The (link buffer size * link buffer) count is higher than the allowed value. qginitiatorexportcontract: 2001: (no uuid yet) exportmeta : requested segment size for reader 1000000000b is larger than max allowed 16777216b Decrease link buffer size and link buffer count on initiator connector.
LinkHandshake timeout not sufficient on initiator connector. QGInitiatorExportContract: 2001: (NO UUID YET) ExportMeta : Handshake with Fabric hit timeout limit of 0 ms. Increase Link Handshake Timeout and retry query Increase LinkHandshake timeout in the initiator connector properties.
LinkHandshake timeout not sufficient on target connector. QGInitiatorExport: 9134: (9c7d074e-4529-4a54-a664-000000000002) InitiatorDataExportReq : [Error 9134] QGRemoteImport: 2001: RemoteDataImportReq :Handshake with Fabric hit timeout limit of 0 ms. Increase Link Handshake Timeout and retry query Increase LinkHandshake timeout in the target connector properties.
Driver not started/offline on target system or incorrect java path set. QGInitiatorExportContract: 24585: (06592ddf-84cb-460b-afcd-000000000003) ExportMeta : Driver TDdriver unreachable by fabric on node sdt11134 Check driver status for target connector. If driver is offline, restart tdqg-node service on the node.
Incorrect server name in target connector. QGInitiatorExportContract: 24582: (9c7d074e-4529-4a54-a664-000000000004) ExportMeta : [Error 1000] Login failure for Connection to fakehost Thu May 10 08:45:52 PDT 2018 Fix the server name target connector property as an IP address or DBS name of the target host.
Table does not exist on the target system. QGInitiatorExportContract: 3706: (9c7d074e-4529-4a54-a664-000000000004) ExportMeta : [Error 3807] Object 'testuser.temp_table_non_exist' does not exist. Confirm that the table exists and the query has the correct reference.
Syntax error on the target system. QGInitiatorExportContract: 3706: (9c7d074e-4529-4a54-a664-000000000004) ExportMeta : [Error 3706] Syntax error: SELECT * must have a FROM clause. Check the query submitted and if there is a valid syntax on target system.
Syntax error for foreignSQL pass through.

EXECUTEFOREIGNSQL:Error: 3707 (50081586-bd87-4516-9285-000

000000017) ForeignFunctionDataExec : [Error 3707] Syntax error, expected some

thing like ‘(’ between the word ‘xx’ and ‘;’.

Check the query submitted in ExecuteForeignSQL SP and if there is a valid syntax on the target system.
QueryGrid fastpath function, QGRemoteExport, does not exist on the target system. QGInitiatorImport: 3706: (9c7d074e-4529-4a54-a664-000000000004) InitiatorDataImportReq : [Error 3706] Syntax error, expected something like ';' between the word 'QGRemoteExport' Run the DIP script System Functions if the fastpath functions do not exists under TD_SYSFNLIB on the target Teradata system.
QueryGrid fastpath function, QGRemoteImport does not exist on the target system. QGInitiatorExport: 3706: (9c7d074e-4529-4a54-a664-000000000004) InitiatorDataExportReq : [Error 3706] Syntax error, expected something like ';' between the word 'QGRemoteImport' Run the DIP script System Functions if the fastpath functions do not exists under TD_SYSFNLIB on the target Teradata system.
Read timeout exceeded to get the buffer for metadata request on the initiator system. QGInitiatorImportContract: 2002: (9c7d074e-4529-4a54-a664-000000000006) ImportMeta : Hit read timeout (100ms) getting metadata buffer Increase readTimeout in the initiator connector properties.
Read timeout exceeded to get the buffer for data transfer on the target system. QGInitiatorExport: 9134: (f942f99a-3011-413b-bf40-000000000008) InitiatorDataExportReq : [Error 9134] QGRemoteImport: 2002: ExecRemoteImport : Hit read timeout (100ms) getting read buffer Increase readTimeout in the target connector properties.
Write timeout exceeded to get the buffer for data transfer on the initiator system. QGInitiatorExport: 2003: (f942f99a-3011-413b-bf40-000000000009) ExecInitExport : Hit write timeout (100ms) getting write buffer Increase writeTimeout in the initiator connector properties.
Write timeout exceeded to get the buffer for data transfer on the target system. QGInitiatorImport: 9134: (43b11795-2f81-42dc-892c-000000000001) InitiatorDataImportReq : [Error 9134] QGRemoteExport: 2003: Hit timeout (50ms) getting write buffer Increase writeTimeout in the target connector properties.
Out of spool space on target system during data transfer. QGInitiatorExport: 2646: (a18b6bce-ce8a-4ea0-97b3-000000000008) InitiatorDataExportReq : [Error 2646] No more spool space in testuser. Increase the spool space for the user on the target system or reduce data set for the query.
Error during data conversion on initiator system. QGInitiatorImport: 1018: (341cab15-7eb7-46b2-b78d-000000000ef2) UDT transform to internal format failed Data transformation error could be due to mismatch in data types on the initiator and target system.
Error during data conversion on target system. QGInitiatorExport: 40008: (6268d8db-a3c3-4b62-82bd-000000000002) Export failed. [Error 9134] QGRemoteImport: 1018: UDT transform to internal format failed Data transformation error could be due to a mismatch in data types on the initiator and target system.
Incorrect initiator network interface setup in link. QGInitiatorExport: 9134: (f0744a27-19bf-4ddb-b543-00000000000a) InitiatorDataExportReq : [Error 9134] qgremoteimport: 24582: remotedataimportreq : qgc import req exception:network 'ep_false_network' does not contain any viable address for node sdt14780.la Fix initiator network interface address in link
Incorrect target network interface setup in link. QGInitiatorExportContract: 24602: (4bb2afaf-e428-45f1-90e8-00000000000b) ExportMeta : Network 'ep_false_network' does not contain any viable address for node sdt14781 Fix the target network interface address in link.
Connection timed out when connecting to the target node during the data transfer phase. QGInitiatorExportContract: 24586: (3ba09cd6-8dc9-4a37-a80a-000000000001) ExportMeta : QGCMetaTask: connection from sdt14780.labs.teradata.com to next hop nodes failed. Connection attempt to 10.25.206.129:34835 hit timeout (0ms)

Restart the node service if the fabric status in Viewpoint shows offline.

Run the link diagnostic check to confirm network connectivity is available between the initiator and target nodes. If the check fails, increase the openConnectionTimeout fabric system property for the initiator fabric.
Increasing the fabric system property should be done with the help of a Teradata Customer Support Representative.
Connection timed out when connecting to initiator node during data transfer phase. QGInitiatorExport: 9134: (e7900c74-c423-4805-b6f0-000000000001) InitiatorDataExportReq : [Error 9134] QGRemoteImport: 24582: RemoteDataImportReq : QGC Import Req Exception:Connection from sdt14781 to initiator fabric nodes failed:([ 10.25.205.90 ]) Increase openConnectionTimeout fabric system property for target fabric.
Increasing the fabric system property should be done with the help of a Teradata Customer Support Representative.
Socket read timeout error.

QGInitiatorImportContract: 24583: (b1872402-b855-463a-b772-000000000001) ImportMeta : Couldn't establish connection to target fabric. (10.25.254.15;)Create AuthClient failed Socket read timed out after-300 ms, bytes read:0, total_bytes:56(0)

QGInitiatorImport: 24582: (62e4aabd-253d-4d54-92c2-000000000001) InitiatorDataImportReq : Socket read failed with state 4 when trying to read 532648 bytes

ExportMeta : QGLClient::DoMetaRequest Read timeout hit

Increase connectionTimeout fabric system property.
Increasing the fabric system property should be done with the help of a Teradata Customer Support Representative.

Spark Connector

Problem Error Message Solution
Spark Application Error

*** Error 9134 QGInitiatorImportContract: 70103: (041caf90-06a3-46b3-8a4f -00000000004e) Metadata failed. java.sql.SQLException: Error occurred while executing spark job. java.sql.SQLException: Error while running Spark Application on host: hadoop3.dummy.domain. Check QueryGrid User Guide for troubleshooting info

This message only appears when using a Spark target connector with Spark Execution Mechanism set to Spark Application.

Common causes:
  • Incorrect user mapping in the Viewpoint link configuration, causing the spark connector to attempt to connect to a user without Spark permissions.
  • Spark connector properties Username or Password are incorrectly set in the link config, connector config, or Teradata AUTHORIZATION objects.
  • Spark connector property, Queue Name, is incorrectly set in the link config or connector config objects.
  • Failing to enable user impersonation during initial installation/configuration as described in Configuring Users for the Spark SQL Target Connector.
  • Any type of error or failure that occurs when the Spark connector makes a request of the Spark database using the Spark application.

Determining the cause:

  • If you have a Spark Thrift server configured, changing the Spark Execution Mechanism to temporarily use the Thrift Server and retrying the query may yield a more helpful error message.
  • More detailed error messages can be found in the log located in /var/opt/teradata/tdqg/connector/tdqg-spark-connector/build version/log/spark_rc.log on the driver node that ran the query.
    • Look for an exception and stack trace listed before Error while running Spark Application appears in the log.