Problem: RunOnSpark sanity check queries fail with:
SQL-MR function RUNONSPARK failed: Timeout exceeded.
On the HDP Hadoop Spark side, browsing Ambari (
) shows that RunOnSpark-initiated Spark jobs fail with:Application application_1479228852593_0001 failed 2 times due to AM Container for appattempt_1479228852593_0001_000002 exited with exitCode: -1000 For more detailed output, check application tracking page:http://hrh050m1.labs.teradata.com:8088/cluster/app/application_1479228852593_0001Then, click on links to logs of each attempt. Diagnostics: Application application_1479228852593_0001 initialization failed (exitCode=255) with output: main : command provided 0 main : run as user is sparkJobSubmittermain : requested yarn user is sparkJobSubmitter User sparkJobSubmitter not foundFailing this attempt. Failing the application.
Solution: Create sparkJobSubmitter as a cluster-wise userid.