Lecture 2 Architecture of Virtual Assistants and WWvW

[Pages:56]Stanford CS224v Course: Conversational Virtual Assistants with Deep Learning

Lecture 2

Architecture of Virtual Assistants and WWvW

? What Does an Assistant Do? ? How Alexa builds its 3rd party platform? ? How to build a platform that supports

the full expressiveness of natural language? (Everything but NLP and speech) ? Decentralized WWvW

By Monica Lam and Giovanni Campagna

2

p ving

Growth of Virtual Assistants

$3B US in 2019 -> $44B US in 2027 (CAGR 38%)1

? 50 millions in 2 years ? Internet: 50 millions in 4 years

? 90M adults in the US have smart speakers



LAM

STANFORD

p ving

Intelligent Virtual Assistant Market

$3B US in 2019 -> $44B US in 2027 (CAGR 38%)1 1. Smart Speakers: Alexa, Google Assistant 2. Chatbots / Robotic Process Automation

? BFIS (banks, financial institutes, insurance), Government, Hospitality, Travel, Retail, Automotive, Media & Entertainment, Education, Healthcare

1Valuates Reports

LAM

STANFORD

Alexa Commands

Party 1st

Category Personification Interactive Clock Radio IoTs

Web 3rd

Examples Chit chat, FAQ Music, news, weather, clock, TVs, security camera, lights, ... Amazon services Questions: Search, Wikipedia, ... General websites

5

Genie Commands

Party 1st

Category Personification Interactive Clock Radio IoTs

Web 3rd

Examples Chit chat, FAQ Music, news, weather, clock, TVs, security camera, lights, ... Amazon services Questions: Search, Wikipedia, ... General websites

6

Techniques

Category

Examples

Personification Chit chat, FAQ

Clock Radio Music, news, weather, clock,

IoTs

TVs, security camera, lights,

Web

Questions: Search, Wikipedia, General websites

Technology

Chit chat, FAQ

Tasks

Tasks

Alexa: Searcn Genie: Search

+ Tasks

Alexa: Task intents Genie: Tasks

7

p ving

High-Level Architecture

Speech-to-text

Text-to-speech

Dialogue Runtime

Task Intents

Tasks

Chitchat

FAQ

Web Search

Amazon specific

LAM

STANFORD

p ving

Key Concepts

1. Assistant: Tasks, Chit-chat, FAQ, Open-domain questions 2. Alexa: 3rd-Party Dispatch Model 3. Genie: a Function Execution Model 4. Monitors and Function Composition 5. Abstract APIs 6. Decentralized WWvW

LAM

STANFORD

 ................
................

In order to avoid copyright disputes, this page is only a partial summary.

Google Online Preview   Download