HDFS enters safe mode while running AsterSpark*_hadoop.sh script - Aster Analytics

Problem: You see this message:

hadoop fs -mkdir -p /user/sparkJobSubmitter/tmp ... Cannot create directory ... Name node is in safe mode.

Solution:

1. Free more disk space.
2. Leave safe mode, using this command:

   hdfs dfsadmin -safemode leave

3. Ensure that Hadoop cleans up cache and log files before running out of disk space:

   yarn.nodemanager.localizer.cache.cleanup.interval-ms
   yarn.nodemanager.localizer.cache.target-size-mb