Spark Programming Spark SQL - Big Data

• Spark SQL infers the schema of a dataset. • The toDF method is not defined in the RDD class, but it is available through an implicit conversion. • To convert an RDD to a DataFrame using toDF, you need to import the implicit methods defined in the implicits object. createDataFrame The createDataFrame method takes two arguments, an RDD of Rows and a schema, and returns a DataFrame ... ................
................