The supported configurations are: Hortonworks Hadoop (HDP) 2.4.2 with Spark 1.5 Cloudera Hadoop (CDH) 5.5.2 with Spark 1.5