Using the script configureAsterSpark, this procedure generates two scripts scripts for an additional Hadoop Spark instance, one to be executed on the Hadoop name node and one to be executed on the Teradata Aster queen node. Follow this procedure for each additional instance.
-
Display the script syntax and parameter descriptions, using this command:
configureAsterSpark --help
The script displays:Usage: configureAsterSpark[-h] [-t <tracelevel>] [-n <namenode>] [-s <sparkJobSubmitter>] [-p <persistDirectory>] [-u <y_or_n>] [-b <beehivepassword>] [-z <dbsuperuserpassword>] [-j <sparkJobUserKeyTab>] [-r <nTestsToRun>] Options: -h, --help show this help message and exit -t TRACELEVEL, --tracelevel=TRACELEVEL display various levels of trace information (default: 0) -n NAMENODE, --namenode=NAMENODE hostname of Hadoop Spark namenode -s SPARKJOBUSER, --sparkJobUser=SPARKJOBUSER user authorized to submit spark jobs -p PERSISTDIR, --persistDir=PERSISTDIR Spark-side path for Spark-side path for socket persist files -u UNINSTALLBEFOREINSTALL, --uninstallBeforeInstall=UNINSTALLBEFOREINSTALL y to uninstall and then install -b BEEHIVEPASSWORD, --beehivePassword=BEEHIVEPASSWORD password of act beehive user -z DBSUPERUSERPASSWORD, --dbSuperUserPassword=DBSUPERUSERPASSWORD password of act db_superuser -j SPARKJOBUSERKEYTAB, --sparkJobUserKeyTab=SPARKJOBUSERKEYTAB keytab file path for principal authorized to submit spark jobs -r NTESTSTORUN, --nTestsToRun=NTESTSTORUN number of verification tests to run -
Either invoke configureAsterSpark without parameters and supply the parameter values for which it prompts you (as in Generating Scripts for a Single Hadoop Spark Instance), or supply all the parameters in a single command line invocation; for example:
configureAsterSpark --namenode=spark-cdh55-1-namenode.asterdata.com --sparkJobUser=sparkJobSubmitter --dbSuperUserPassword=db_superuser
If you omit parameters, the script either prompts you for them or uses their defaults.
- Proceed to Executing the Teradata Aster Spark Hadoop Installation/Configuration Script.