Operationalizing PyTorch Models Using ONNX and ONNX Runtime

Operationalizing PyTorch Models Using ONNX and ONNX Runtime

Spandan Tiwari (Microsoft)

Emma Ning (Microsoft)

Agenda

ONNX overview Model operationalization with ONNX

Pytorch ? ONNX exporter ONNX Runtime OLive

ONNX Overview

Problem - Training frameworks x Deployment targets

Training framework

Deployment target

CPU

GPU

FPGA

NPU

ONNX: an open and interoperable format for ML models

Training framework

Deployment target

CPU

Freedom to use tool(s) of choice compatible with ONNX

ONNX

an open and interoperable

format for ML models

Focus hardware innovatioGPnU on NN optimizations for a single

format instead of many FPGA

NPU

................
................

In order to avoid copyright disputes, this page is only a partial summary.

Google Online Preview   Download