Building Deep Learning Applications for Big Data
[Pages:95]Building Deep Learning Applications for Big Data
An Introduction to Analytics Zoo: Distributed TensorFlow, Keras and BigDL on Apache Spark
Jason Dai
AAAI 2019
Agenda
? Motivation (15 minutes)
? Trends, real-world scenarios
? DL frameworks on Apache Spark (30 minutes)
? BigDL, TensorFlowOnSpark, DL Pipelines, Project Hydrogen, SparkNet
? Analytics Zoo (30 minutes)
? Distributed TensorFlow, Keras and BigDL on Apache Spark
? Analytics Zoo Examples (30 minutes)
? Dogs vs. cats, object detection, OpenVINO model inference, distributed TensorFlow
? Break (30 minutes)
AAAI 2019
Agenda
? Distributed training in BigDL (30 minutes)
? Data parallel training, parameter synchronization, scaling & convergence, etc.
? Advanced applications (20 minutes)
? Text classification, movie recommendation
? Real-world applications (45 minutes)
? Object detection and image feature extraction at ? Produce defect detection using distributed TF on Spark in Midea ? NLP based customer service chatbot for Microsoft Azure ? Image similarity based house recommendation for MLSlisting ? Transfer learning based image classifications for World Bank ? LSTM-Based time series anomaly detection for Baosight ? Fraud detection for payment transactions for UnionPay
? Conclusion and Q&A (10 minutes)
AAAI 2019
Motivations
Technology and Industry Trends Real World Scenarios
AAAI 2019
Trend #1: Data Scale Driving Deep Learning Process
"Machine Learning Yearning", Andrew Ng, 2016
AAAI 2019
Trend #2: Hadoop Becoming the Center of Data Gravity
Phillip Radley, BT Group Strata + Hadoop World 2016 San Jose
Matthew Glickman, Goldman Sachs Spark Summit East 2015
AAAI 2019
Trend #3: Real-World ML/DL Systems Are Complex Big Data Analytics Pipelines
"Hidden Technical Debt in Machine Learning Systems", Sculley et al., Google, NIPS 2015 Paper
AAAI 2019
Trend #4: Unified Big Data Platform Driving Analytics & Data Science
Ion Stoica, UC Berkeley, Spark Summit 2013 Keynote
AAAI 2019
................
................
In order to avoid copyright disputes, this page is only a partial summary.
To fulfill the demand for quickly locating and searching documents.
It is intelligent file search solution for home and business.
Related download
- the hill chart calculation for pelton runner models using
- getting started with
- unittest framework rxjs ggplot2 python data
- code runner solution for recognition and execution of
- stats 507 data analysis in python
- ddt documentation
- the hill chart calculation for francis runner models using
- building deep learning applications for big data
Related searches
- deep learning conference 2018
- deep learning trend
- deep learning vs machine learning
- deep learning future
- deep learning pdf
- deep learning neural network
- deep learning versus machine learning
- types of deep learning networks
- deep learning neural network tutorial
- deep learning regression
- deep learning types
- deep learning layer types