How to Deploy ML Models in Production with BentoML @ValerioVelardoTheSoundofAI
How to Deploy ML Models in Production with BentoML  @ValerioVelardoTheSoundofAI
Uploaded July 2022 | Updated November 2026, 5 days ago
In this video, you can learn how to deploy Machine Learning models into production using BentoML. I explain how to install BentoML, how to save ML models into BentoML's local store, how to create a BentoML service, how to build a bento, and how to containerise a bento with Docker. I also send requests to the BentoML service to receive back inferences.

Check code:
github.com/musikalkemist/mldeployment

=================

Join The Sound Of AI Slack community:
valeriovelardo.com/the-sound-of-ai-community

Interested in hiring me as a consultant/freelancer?
valeriovelardo.com

Connect with Valerio on Linkedin:
linkedin.com/in/valeriovelardo

Follow Valerio on Facebook:
facebook.com/TheSoundOfAI

Follow Valerio on Twitter:
twitter.com/musikalkemist​

=================

Content

0:00 Intro
0:19 BentoML deployment steps
1:03 Installing BentoML and other requirements
2:11 Training a simple ConvNet model on MNIST
5:52 Saving Keras model to BentoML local store
10:26 Creating BentoML service
15:28 Sending requests to BentoML service
22:06 Creating a bento
25:46 Serving a model through a bento
28:25 Dockerise a bento
30:46 Run BentoML service via Docker
32:41 Deployment options: Kubernetes + Cloud
33:43 Outro
How to Deploy ML Models in Production with BentoMLImplementing a Speech Recognition System in TensorFlow 220.  Audio generation with RAVE - Generative Music AIAnnouncing OpenSource Research: A Community-Driven Research ProjectHow to Set Milestones and Budget Resources for an AI ProjectIntensity, Loudness, and TimbreI Created An A.I. To ROAST Pop SongsDefining the Fourier Transform with Complex NumbersMusic Theory Concepts for Melody GenerationThe Personalised Music Discovery Wizard || PandoraTraining a Sound Classifier with PyTorchDont Waste Time on Deep Learning Models
Valerio Velardo - The Sound of AI |

How to Deploy ML Models in Production with BentoML

SHARE TO X SHARE TO REDDIT SHARE TO FACEBOOK WALLPAPER