It is very important to set up development environment addressing all the challenges so that we can spend time in development. Most of the above issues is road blocks for beginners.

Hence we created brief course covering all the important aspects of setting up development environment for Python and Spark.

Once you complete this course, you can proceed with other courses which will cover Spark with Python.

Who this course is for:

Any one who want to learn Python and then Spark

Show moreShow less

Curriculum

1 section • 13 lectures • 46m total length

Introduction

13 lectures • 47min

Introduction - Setup Python, PyCharm and Spark on Windows

Understanding Pre-requisites

Setup Python on Windows 10

Configure Environment Variables for Python

Setup Pycharm on Windows 10

Develop Python application using PyCharm with Run time Parameters

Download Spark - Compressed tar ball

Install 7z to uncompress and untar compressed tar balls

Setup Spark using downloaded compressed tar ball

Install JDK and JRE on Windows 10

Configure environment variables for Spark

Setup Winutils for integration of HDFS APIs and Windows file system

Develop simple Pyspark application using PyCharm

Featured review

Dibyajyoti Sarkar

52 courses

6 reviews

Rating: 5.0 out of 15.0a year ago

I found this course to be very helpful. It does a great job of explaining how to set up Python and Spark on windows.
Even though the videos demonstrate the installation of Python 2.7 and Spark 1.6.; using the same procedures I could easily set up Python 3.x and Spark 2.x on my system.
Thank you again for this helpful course!

13+ years of experience in executing complex projects using vast array of technologies including Big Data and Cloud.

I found itversity, llc - a US based startup to provide quality training for IT professionals and staffing as well as consulting solutions for enterprise clients. I have trained thousands of IT professionals in vast array of technologies including Big Data and Cloud.

Building IT career for people and provide quality services to the clients will be paramount to our organization.

As an entry strategy itversity will be providing quality training in the areas of ABCD