Getting Started With Apache Spark 1.6

January 10, 2016. Estimated read time:
1 minutes

In this short blog, I will explain how to setup Apache Spark 1.6 with YARN. I assume Hadoop is already installed.

1. Download Apache Spark

Go to spark.apache.org/downloads.html and choose the Spark release you want to download(1.6.0 is the default currently). Then under the package type choose the Spark release corresponding to your Hadoop version. Mine is 2.6 hence I choose Pre-built for Hadoop 2.6 and later

If you want, you can download the Source Code, navigate to the base folder and build it based on your Hadoop version using below command.