2.06 - Starting Scala REPL - Teradata QueryGrid

Teradata® QueryGrid™ Installation and User Guide

Product
Teradata QueryGrid
Release Number
2.06
Published
September 2018
Language
English (United States)
Last Update
2018-11-26
dita:mapPath
blo1527621308305.ditamap
dita:ditavalPath
ft:empty
The supported client for interacting with the Spark SQL initiator is the Scala Read-Eval-Print-Loop (REPL), referred to as the spark-shell. In order to use the Spark SQL initiator, spark-shell must be started using the following JAR files:
  • spark-loaderfactory
  • log4j-api
  • log4j-core
  1. Log on to the node you want to start spark-shell.
  2. Locate the connector path at /opt/teradata/tdqg/connector/tdqg-spark-connector/<version>/lib/)
  3. Add the JAR files.
  4. Start the spark-shell. The following is an example path for starting spark-shell:
    spark-shell --jars /opt/teradata/tdqg/connector/tdqg-spark-connector/version/lib/spark-loaderfactory-version.jar,/opt/teradata/tdqg/connector/tdqg-spark-connector/version/lib/log4j-api-2.7.jar,/opt/teradata/tdqg/connector/tdqg-spark-connector/version/lib/log4j-core-2.7.jar --master yarn
    On CDH clusters, only Spark 2.1 and later are supported. When using CDH clusters, use the spark2-shell command name instead of spark-shell.