ncli spark Example Session - Aster Analytics

Teradata AsterĀ® Spark Connector User Guide

Product
Aster Analytics
Release Number
7.00.00.01
Published
May 2017
Language
English (United States)
Last Update
2018-04-13
dita:mapPath
dbt1482959363906.ditamap
dita:ditavalPath
Generic_no_ie_no_tempfilter.ditaval
dita:id
dbt1482959363906
lifecycle
previous
Product Category
Software
# ncli spark setsparkparams --name=spark1-yarn-socket --app-resource=hdfs:///user/root/aster-spark-extension-spark1.4.1.jar --base-rest-url=http://1.1.1.1:8088/ws/v1/cluster/apps/ --client-spark-version=1.4.1 --app-resource=hdfs:///user/root/aster-spark-extension-spark1.4.1.jar --protocol-version=v1 --spark-master-url=yarn

Successfully set spark-params for spark1-yarn-socket.

# ncli spark setsparkproperties --name=spark1-yarn-socket --yarn-jar=hdfs:///user/root/spark-assembly-1.4.1.2.3.2.0-2950-hadoop2.7.1.2.3.2.0-2950.jar

Successfully set spark-properties for spark1-yarn-socket.

# ncli spark setrunonsparkparams --name=spark1-yarn-socket --persist-location=hdfs:///tmp/ --data-transfer=Socket --delimiter='\t' --identity-file='/home/beehive/config/IDENTITYFILE' --mailmanserver-block-timeout-sec=7200 --mem-limit-mb=32 --null-string=NULL --spark-
submit=/usr/bin/spark-submit --ssh-host=runonspark_user@1.1.1. --status-interval=0 --timeout-sec=666 --use-remote-ssh='true' --yarn=/usr/bin/yarn