Triton Inference Server in Azure ML Speeds Up Model Serving

What will you learn from the session?

How you can deploy a deep learning model using Triton server using Azure Machine Learning Managed Endpoints.

Agenda

• Quick Overview of Inferences and Challenges

• Overview of NVidia Triton Inference Server

• REALTIME Usecase - Microsoft Translate

• Demo: Azure ML with Triton - Densnet