Problem: During preparation for installation, RunOnSpark sanity check queries fail with this error message:
SQL-MR function RUNONSPARK failed: cannot instantiate FileAccess
The SQL-MapReduce log of each failing query has:
java.io.IOException: Login failure for sparkJobSubmitter@namenode from keytab /home/beehive/config/spark/namenode/sparkJobSubmitter.keytab: javax.security.auth.login.LoginException: Cannot locate KDC 7 at org.apache.hadoop.security.UserGroupInformation.loginUserFromKeytab(UserGroupInformation.java:976) 8 at com.asterdata.ncluster.sqlmr.RunOnSpark.FileAccess.init(FileAccess.java:82) ...
Reason: The /etc/krb5.conf file on the Aster queen node is incompatible with the /etc/krb5.conf file on the target Hadoop node.
Solution: As the root user:
- On the Aster queen node, change the /etc/krb5.conf so that its default_realm and realms entries include the default_realm and realms entries of the target Hadoop node.
- Clone the changed /etc/krb5.conf file to the Aster vworkers:
ncli node clonefile /etc/krb5.conf