- Specifies the behavior of the target connector component
- Configures how data is transformed
- Configures the underlying link data transportation layer
Links are named configurations that include the target connector. If the same property is set for a link and a connector, the link setting overrides the connector setting.
- CLIENT. Teradata Fabric connects outbound to a remote Arrow Flight SQL server.
- SERVER. Teradata Fabric exposes the Teradata database as an Arrow Flight SQL server for remote clients.
General Tab
| Name | Defaullt | Description | Overridable? |
|---|---|---|---|
| Execution Type | CLIENT |
|
|
| Enable Logging | INFO | Use this setting to specify the logging level for the connector or link. Valid values are:
You can configure user-level log settings on the Add Link or Edit Link page in the Teradata Fabric portlet. |
|
| Enable Query Logging | True |
|
|
| Number of Transfer Threads | 5 | Use this setting to specify the number of threads the connector uses to transfer data for a single request on a node. Valid values are: 1–100 More threads can improve transfer performance but increase CPU usage. |
numberOfTransferThread |
| Link Buffer Count | 4 | Use this setting to specify the maximum number of write buffers available on a single channel at one time. Valid values are: 2–16 This setting overrides the default Fabric property shmDefaultNumMemoryBuffers. |
linkBufferCount |
| Link Buffer Size | 1048576 | Use this setting to specify the maximum size, in bytes, of the write buffers used for row processing and message exchange. Valid values are: 73,728–10,485,760 bytes. |
linkBufferSize |
| Query Response Timeout | 86400000 | Use this setting to specify how long the connector waits for a target query to complete before timing out. If a query exceeds the configured timeout, the fabric stops the query and releases its resources. Valid values are: 300000–172800000 milliseconds. |
responseTimeout |
FLIGHT CLIENT Tab — General Sub-tab
(Applies to Execution Type = CLIENT only)
| Name | Default | Description | Overridable? |
|---|---|---|---|
| Default Delimiter | Double quote | Use this setting to specify the delimiter the connector uses for the target database. The connector replaces Teradata double quotes in schema paths (for example, "catalog.schema") with the delimiter supported by the target database (for example, `catalog`.`schema`). This setting applies only to schema paths. The connector does not replace double quotes used elsewhere in SQL statements. |
|
| Default Table Location | Use this setting to specify the default location for tables in catalog.schema format. For Dremio, you can also specify nested folders using the format catalog.folder1.folder2.schema. Use this setting when you want the connector to use a default catalog and schema when creating or accessing tables. |
||
| Enable Table Delimiter | False | Enable this option to automatically enclose table names with the default delimiter. This helps the connector work with table names that contain special characters or use reserved words. Disable this option if your table names do not require delimiters. |
|
| Export Workers Count | 2 | Use this setting to specify the maximum number of worker threads each driver instance uses to transfer data. Valid values are: 1–5 |
exportWorkersCount |
| GRPC Timeout | 86400 | Use this setting to specify how long the connector waits for a gRPC call to complete before timing out. A longer timeout allows more time for long-running operations to complete, while a shorter timeout helps detect connection or service issues sooner. |
|
| Remote Flight Server | Use this setting to specify the IP address or DNS name of the remote Arrow Flight SQL server. Required for CLIENT execution type. Supports only a single entry. |
||
| Remote Flight Server Port | Use this setting to specify the port number of the remote Arrow Flight SQL server. Required for CLIENT execution type. |
FLIGHT CLIENT Tab — Security Sub-tab
(Applies to Execution Type = CLIENT only)
| Name | Default | Description |
|---|---|---|
| Authentication Mechanism | Username/Password | Use this setting to specify the authentication method the connector uses to connect to the remote Arrow Flight SQL server. Valid values:
Required for CLIENT execution type. |
| Username | Use this setting to specify the user or service account name for the remote Arrow Flight SQL server. Required when you set Username/Password as the Authentication Mechanism. | |
| Password | Use this setting to specify the paswword for the user or service account name for the remote Arrow Flight SQL server. Required when you set Username/Password as the Authentication Mechanism. | |
| Personal Access Token | Use this setting to specify the Personal Access Token (PAT) used to authenticate with the target Dremio system. Required when you set Personal Access Tokenas the Authentication Mechanism. Viewpoint and logs redact the token. Currently supported only for Dremio. | |
| Project UUID | Use this setting to specify the ID of the Dremio Sonar project. If you do not specify a value, the connector uses the default Sonar project. | |
| CA Certificate (PEM Format) | Use this setting to specify the root CA certificate in PEM format. Required when you enable TLS and the target system uses a private certificate. For systems that use publicly trusted certificates, this field is optional. |
|
| Use TLS | True | Use this setting to specify the use of TLS encryption to protect data transmitted between the Arrow Flight SQL connector and the target database. |
| IDP Client Secret | Use this setting to specify the client secret that confidential clients use to obtain OAuth 2.0 access tokens or perform token exchanges with the identity provider IdP. For Dremio, you can optionally provide a client secret for token exchange. | |
| IDP Token Request URL | Use this setting to specify the URL of the IdP OAuth 2.0 token endpoint. | |
| IDP Token Request Additional Payload Info | Use this setting to specify additional payload fields to include in the IdP OAuth 2.0 token request (for example, client_id, grant_type, or scope). Format: grant_type=password;client_id=<value>;scope=profile openid If grant_type is set to password, you need to specify a Username and Password. |
|
| IDP Token Exchange URL | Use this setting to specify the HTTPS endpoint at the identity provider (IdP) where the client submits a token exchange request to obtain a new access token with a different audience or scope. For Dremio, use the Dremio OAuth 2.0 token exchange endpoint instead of the identity provider (IdP) endpoint. Token exchange is optional when you use OAuth 2.0. |
|
| IDP Token Exchange Additional Payload Info | Use this setting to specify additional payload fields to include in the OAuth 2.0 token exchange request. |
FLIGHT CLIENT Tab — Advanced Sub-tab
(Applies to Execution Type = CLIENT only)
| Name | Default | Description | Overridable? |
|---|---|---|---|
| 16.20+ BLOB Support | True | On Teradata 16.20 and later, the connector maps BINARY columns from Arrow Flight SQL–compliant databases to BLOB columns. Disable this option when:
If any BINARY column can exceed 64,000 bytes, keep this option enabled. Enabling can reduce performance on large datasets.
|
blobSupport |
| Default Binary Size | 64000 bytes | Use this setting to specify the maximum size, in bytes, that the connector uses when mapping VARBINARY data. This setting applies only when the initiating Teradata system does not support BLOB with Teradata Fabric. If you enable 16.20+ BLOB Support, the connector ignores this setting. Valid values are: 1–2097088000 bytes. |
defaultBinarySize |
| 16.20+ CLOB Support | False | On Teradata 16.20 and later, the connector maps UTF8 columns from Arrow Flight SQL–compliant databases to VARCHAR by default. Enable this option if:
Any VARCHAR column can exceed 32,000 Unicode characters or 64,000 bytes. Enabling can reduce performance on large datasets.
|
clobSupport |
| Default String Size | 32000 characters | Use this setting to specify the maximum number of Unicode characters the connector imports into a VARCHAR column. VARCHAR truncation size. Valid values are: 1–1048544000 characters. If you enable 16.20+ CLOB Support, the connector ignores this setting. |
defaultStringSize |
| Dry Run Mode | False | Use this setting to test query against a remote Arrow Flight SQL–compliant database without loading the results into Teradata. In dry run mode, the connector runs the query and measures data fetch throughput and latency, helping you evaluate performance without importing data. This option is only for internal production support.
|
|
| Flight Call Retry Max Attempts | 3 | Use this setting to specify the maximum number of retry attempts for an Arrow Flight RPC call after a transient error. | |
| Flight Call Retry Back Off | 2 | Use this setting to specify the base delay, in seconds, between Arrow Flight RPC retry attempts. The connector uses this value to calculate exponential backoff after transient errors occur. Valid values are: 0–100 seconds. |
|
| Queue Size | 2000 | Use this setting to specify the size (records) of the in-memory queue buffering data pulled from a remote Arrow Flight SQL–compliant database before sending to Teradata. Valid range are 100–200000000 records. Higher values help light-concurrency workloads but can hurt performance under high concurrency. |
FLIGHT SERVER Tab — General Sub-tab
(Applies to Execution Type = SERVER only)
| Name | Default | Description |
|---|---|---|
| Flight Server Network Interface | Use this setting to specify the network interface the Arrow Flight server uses when advertising its endpoint to clients. If you leave this field blank, the server uses the node hostname in GetFlightInfo endpoint responses. | |
| Flight Server Load Balancer Address | Use this setting to specify the load balancer address used to connect to this Arrow Flight SQL Connector (SERVER Execution Type). If you set this option, it always uses this address in GetFlightInfo endpoint responses. | |
| Flight Server Load Balancer Port | Use this setting to specify the load balancer port used to connect to this Arrow Flight SQL Connector (SERVER Execution Type). | |
| Flight Server Active Port | 5501 | Use this setting to specify the port on which the active Arrow Flight SQL Connector (SERVER Execution Type) listens for production client connections. |
| Flight Server Pending Port | 5502 | Use this setting to specify the port on which the pending (test) Arrow Flight SQL Connector (SERVER Execution Type) listens. |
| Flight Server Active FS | arrow_fs | Use this setting to specify the Teradata foreign server name used by the active Arrow Flight SQL Connector (SERVER Execution Type) to trigger export queries. |
| Flight Server Pending FS | arrow_fs_pending | Use this setting to specify the Teradata foreign server name used by the pending Arrow Flight SQL Connector (SERVER Execution Type) for testing. |
| Auth Token Encryption Key | Use this setting to specify the encryption key used to encrypt and decrypt authentication tokens for secure storage. Use a random string of at least 12 characters including uppercase, lowercase, and numbers. Required for SERVER execution type. | |
| Flight Server TLS Cert Refresh (Days) | 7 | Use this setting to specify the number of days before certificate expiry at which the server attempts to refresh the certificate. Min: 5 Max: 60 |
| Diagnostic Username | Use this setting to specify the username for the Flight Server diagnostic connection check. | |
| Diagnostic Password | Use this setting to specify the password used for the Flight Server diagnostic connection check. | |
| Diagnostic JWT Token | Use this setting to specify the JWT bearer token used for the Flight Server diagnostic connection check. When set, takes precedence over Diagnostic Username and Password. The server receives this through gRPC Authorization header and opens JDBC with LOGMECH=JWT. |
FLIGHT SERVER Tab — Flight Server Workload Management Sub-tab
(Applies to Execution Type = SERVER only)
| Name | Default | Description |
|---|---|---|
| Concurrent Query Limit | 50 | Use this setting to control the maximum number of queries that can run concurrently on a node. The connector automatically terminates queries that exceed the configured limit. Valid values are:
|
| Query Time Limit (minutes) | 1500 | Use this setting to prevent long-running queries from consuming system resources indefinitely. Use this setting to control the maximum time (minutes) a query can run before the connector automatically terminates it. Valid values are: 1440–2880 minutes. |
| Query Expiration Check Interval (minutes) | 60 | Use this setting to control how often the connector scans for expired queries and removes them from memory. Valid values are:
|
| Arrow Batch Buffer Size | 8 | Use this setting to control how much Arrow data the connector buffers in memory before processing it. Valid values are:
|
| Arrow RecordBatch Size | 4000 | Use this setting to control how many rows the connector groups into each Arrow RecordBatch. Valid values are:
|
| Arrow Flight Streams per Driver | 1 | Use this setting to control the number of parallel Arrow Flight streams per driver node. Higher values increase throughput and resource usage. Valid values are:
|
| Arrow Stream Start Timeout (seconds) | 60 | Use this setting to control the timeout used to mark a stream as abandoned if no stream starts within the configured duration. Valid values are:
|
| Arrow Abandonment Reaper Interval (seconds) | 60 | Use this setting to control the interval at which the reaper checks for abandoned Arrow streams. Valid values are:
|
FLIGHT SERVER Tab — Teradata Advanced SQL Engine Sub-tab
(Applies to Execution Type = SERVER only)
| Name | Default | Description |
|---|---|---|
| Teradata Advanced SQL Engine | Use this setting to enter the IP/hostname of the Teradata Database that the Arrow Flight SQL Connector (SERVER Execution Type) uses to connect through JDBC. Required for SERVER execution type. | |
| Teradata Advanced SQL Engine Port | Use this setting to enter the port of the Teradata Database. Required for SERVER execution type. Valid values are:
|
|
| JDBC Communication over TLS | False | Use this setting to secure JDBC connections to the Teradata Database with TLS encryption. Supported with JDBC Driver 17.10.00.07 and later. |
| TLS Port | 443 | Use this setting to enter the port for HTTPS/TLS connections. Valid values are:
|
| JDBC Connection Pool Idle TTL (ms) | 300000 | Use this setting to enter the time-to-live for idle connections in the JDBC pool. Min: 1000, Max: 3600000. Valid values are:
|
| JDBC Connection Pool Max Lifetime (ms) | 86400000 | Use this setting to enter the maximum lifetime of a connection in the JDBC pool. Min: 60000, Max: 86400000. Valid values are:
|
| JDBC Connection Pool Reaper Interval (ms) | 30000 | Use this setting to enter the interval at which the connection pool reaper cleans up stale connections. Min: 1000, Max: 300000. Valid values are:
|