Apache Spark Tutorial

Spark Installation In this section, we will perform the installation of Spark. So, follow the below steps. Download the Apache Spark tar…

Spark Char Count Example In Spark char count example, we find out the frequency of each character exists in a particular file.…

Spark Intersection Function In Spark, Intersection function returns a new dataset that contains the intersection of elements present in the different datasets.…

What is Spark? Apache Spark is an open-source cluster computing framework. Its primary purpose is to handle the real-time generated data. Spark…

Spark Map function In Spark, the Map passes each element of the source through a function and forms a new distributed dataset.…

RDD Operations The RDD provides the two types of operations: Transformation Action Transformation In Spark, the role of transformation is to create…

RDD Persistence Spark provides a convenient way to work on the dataset by persisting it in memory across operations. While persisting an…

Spark Architecture The Spark follows the master-slave architecture. Its cluster consists of a single master and multiple slaves. The Spark architecture depends…

RDD Shared Variables In Spark, when any function passed to a transformation operation, then it is executed on a remote cluster node.…

Spark Cartesian Function In Spark, the Cartesian function generates a Cartesian product of two datasets and returns all the possible combination of…