CS535 BIG DATA PART A. BIG DATA TECHNOLOGY 3. …

DataFrames can incorporate SQL using Spark SQL DataFrames also can be constructed from a wide array of sources DataFrame(and Spark SQL) has some built in query optimiza-tion (optimized using the catalyst engine) which means using DataFrames to process data will be faster than using RDDs and I will talk about that in next section (Comparison between ................
................