We’ll be using Apache Spark 2.2.0 here, but the code in this tutorial should also work on Spark 2.1.0 and above. How to run Apache Spark Before we begin, we’ll need an Apache Spark installation.

Fast, flexible, and developer-friendly, Apache Spark is the leading platform for large-scale SQL, batch processing, stream processing, and machine learning.

This is a comprehensive Apache Hadoop and Spark comparison, covering their differences, features, benefits, and use cases.