Target parameters include:
Parameter | Required/Optional | Description |
---|---|---|
source_id | Required | Unique source ID. |
system_id | Required | Unique system ID. |
batch_type | Optional | Records. |
batch_count | Optional | Number of records to batch. The batch_type parameter is required when using batch_count. |
use_dead_letter_queue | Optional | True/false. |
Teradata
A Teradata target requires additional parameters: schema and table in data_path, username and password in system_info.
{ "target_type": "teradata", "data_path": { "schema": "schema", "table": "table" }, "data_map": { "mapping": [ { "column": "db_column_name", "field": "data", "type": "json" } ] }, "system_info": { "username": "ip112233", "password": "password" } }
HDFS without Kerberos
A HDFS target requires additional parameters: path and extension in data_path, username and password in system_info. Only sequence files are supported and require the seq extension.
{ "target_type": "hdfs", "data_path": { "path": "/data/listener/", "extension": "seq" }, "properties": { "webhcat_table": "listener" }, "system_info": { "username": "ip112233", "password": "password" } }
HDFS with Kerberos
A HDFS with Kerberos target requires additional parameters: kdc, principal, and Base64 encoded keytab in properties.
"data_path": { "extension": "seq", "path": "/user/testuser/kerberos" }, "properties":{ "kdc":"ip-172-29-31-108.us-west-2.compute.internal:88", "principal":"testuser@CDH.US-WEST-2.COMPUTE.INTERNAL", "base64KeytabContent":"BQIAAABd..." }
HBase
A HBase target requires additional parameters: schema and table in data_path, username and password in system_info.
{ "target_type": "hbase", "data_path": { "schema": "column_family", "table": "table" }, "data_map": { "mapping": [ { "column": "db_column_name", "field": "data", "type": "json" } ] }, "system_info": { "username": "ip112233", "password": "password" } }