Spark Architecture

Spark Architecture

A.Grishchenko

Pivotal Confidential?Internal Use Only

1

About me

Enterprise Architect @ Pivotal

7 years in data processing 5 years with MPP 4 years with Hadoop Spark contributor

Outline

Spark Motivation Spark Pillars Spark Architecture Spark Shuffle Spark DataFrame

Outline

Spark Motivation Spark Pillars Spark Architecture Spark Shuffle Spark DataFrame

Spark Motivation

Difficultly of programming directly in Hadoop MapReduce

................
................

In order to avoid copyright disputes, this page is only a partial summary.

Google Online Preview   Download