NVIDIA is offering a four-hour, self-paced course on MLOps

NVIDIA Triton helps data scientists and system administrators turn models into a web server for model prediction using the same training machine

NVIDIA Deep Learning Institute (DLI) is offering a four-hour, self-paced course titled “Deploying a Model for Inference at Production Scale” that introduces MLOps coupled with hands-on practice with a live NVIDIA Triton Inference Server. 

The course’s learning objectives include: 

  • Deploying neural networks from a variety of frameworks onto a live NVIDIA TritonServer.
  • Measuring GPU usage and other metrics with Prometheus.
  • Sending asynchronous requests to maximise throughput.

Upon completion, developers will deploy their models on an NVIDIA Triton Server.

What is Triton Server?

NVIDIA Triton Inference Server helps data scientists and system administrators turn the same machines you use to train your models into a web server for model prediction. Though GPU is not required, the server can take advantage of multiple installed GPUs to quickly process large batches of requests.

NVIDIA Triton was created with Machine Learning Operations (MLOps). This is a relatively new field evolved from Developer Operations, or DevOps, to focus on scaling and maintaining ML models in a production environment. 

NVIDIA Triton is equipped with features such as model versioning for easy rollbacks. Triton is also compatible with Prometheus to track and manage server metrics such as latency and request count.

Register for this free course on Data & Analytics.

More Great AIM Stories

Poornima Nataraj
Poornima Nataraj has worked in the mainstream media as a journalist for 12 years, she is always eager to learn anything new and evolving. Witnessing a revolution in the world of Analytics, she thinks she is in the right place at the right time.

More Stories

OUR UPCOMING EVENTS

8th April | In-person Conference | Hotel Radisson Blue, Bangalore

Organized by Analytics India Magazine

View Event >>

30th Apr | Virtual conference

Organized by Analytics India Magazine

View Event >>

MORE FROM AIM

3 Ways to Join our Community

Discord Server

Stay Connected with a larger ecosystem of data science and ML Professionals

Telegram Channel

Discover special offers, top stories, upcoming events, and more.

Subscribe to our newsletter

Get the latest updates from AIM