Spark SQL .edu

CS 398 ACC Spark SQL

Prof. Robert J. Brunner

Ben Congdon Tyler Kim

MP4

How's it going?

Final Office Hours: After this lecture // Tomorrow 4-6pm - Please avoid Low-Effort/Private Piazza post

Final Autograder run: - Tonight ~9pm - Tomorrow ~3pm

Due tomorrow at 11:59 pm. Latest Commit to the repo at the time will be graded. Last Office Hours today after the lecture until 7pm.

What's going on with the cluster?

People running "local" jobs on Master consumes disproportionate amount of CPU

- If master is unresponsive, it makes the entire cluster useless - Please be curteous of other students during "peak" hours

- We will be more aggressive in kicking out jobs if the problem continues

Course Cluster

Back-up / secondary cluster will be available. Check the Cluster page on the website

- Same SSH key

Outline

Traditional Databases SQL

Optimizations Spark SQL

 ................
................

In order to avoid copyright disputes, this page is only a partial summary.

Google Online Preview   Download