2.06 - Configuring the Spark Connector for Use with a Custom Hadoop Library Path - Teradata QueryGrid

Teradata® QueryGrid™ Installation and User Guide

Product
Teradata QueryGrid
Release Number
2.06
Published
September 2018
Language
English (United States)
Last Update
2018-11-26
dita:mapPath
blo1527621308305.ditamap
dita:ditavalPath
ft:empty
If you installed Hadoop with a custom library path or stored any Hadoop .jar files outside of the default Hadoop library, you must manually configure the Spark connector with the custom path for any files that do not reside in the default Hadoop library path.
This only affects the target Spark connector configuration and any files outside the default Hadoop path.
  1. Enable the Hadoop Library Path property as described in Spark SQL Connector and Link Properties.
  2. Enter the custom library path in the Hadoop Library Path NVP using comma-separated values for all .jar files not in the default Hadoop library, for example:
/usr/hdp/2.6.0.3-8/hive-hcatalog/share/hcatalog/,/usr/hdp/2.6.0.3-8/hadoop-hdfs/,/usr/hdp/2.6.0.3-8/hadoop-mapreduce