Deep Learning for Web Search and Natural Language Processing

[Pages:120]Deep Learning for Web Search and Natural Language Processing

Jianfeng Gao Deep Learning Technology Center (DLTC)

Microsoft Research, Redmond, USA WSDM 2015, Shanghai, China

*Thank Li Deng and Xiaodong He, with whom we participated in the previous ICASSP2014 and CIKM2014 versions of this tutorial

Mission of Machine (Deep) Learning

Data (collected/labeled) Model (architecture) Training (algorithm)

2

Outline

? The basics

? Background of deep learning ? A query classification problem ? A single neuron model ? A deep neural network (DNN) model ? Potentials and problems of DNN ? The breakthrough after 2006

? Deep Semantic Similarity Models (DSSM) for text processing ? Recurrent Neural Networks

3

4

Geoff Hinton

Scientists See Promise in Deep-Learning Programs

John Markoff November 23, 2012

Rick Rashid in Tianjin, China, October, 25, 2012

The universal translator on

A voice recognition program translated a speech given by Richard F.

"Star Trek" comes true...

Rashid, Microsoft's top scientist, into Chinese.

5

6

Impact of deep learning in speech technology

Cortana

7

8

 ................
................

In order to avoid copyright disputes, this page is only a partial summary.

Google Online Preview   Download