Skip to content

Latest commit

 

History

History

examples

BentoML Examples 🎨

The directory contains a collection of example projects demonstrating BentoML usage and best practices.

Index

Example Model Functionality
quickstart Transformers Summarization
inference-graph Text Generation, Text Classification Distributed Services, Model Composition, Inference Graph
io-descriptors Pydantic Custom IO Types
model-loading-saving Stable Diffusion Model Store
monitoring/task_classification Classification Model Monitoring, Classification Tasks
sk-learn Classification Classification
mlflow Classification Classification
xgboost Classification Classification

More examples

You can also try the following example projects.

  • BentoVLLM - Accelerate your model inference and improve serving throughput by using vLLM as your LLM backend.
  • BentoDiffusion - Self-host diffusion models with BentoML to generate custom images and video clips.
  • BentoXTTS - Convert text to speech based on your custom audio data.
  • BentoWhisperX - Convert spoken words into text for AI scenarios like virtual assistants, voice-controlled devices, and automated transcription services.
  • Sentence Transformer - Transform text into numerical vectors for a variety of natural language processing (NLP) tasks.
  • BentoCLIP - Build a CLIP (Contrastive Language-Image Pre-training) application for tasks like zero-shot learning, image classification, and image-text matching.
  • BentoBLIP - Leverage BLIP (Bootstrapping Language Image Pre-training) to improve the way AI models understand and process the relationship between images and textual descriptions.
  • BentoBark - Generate highly realistic audio like music, background noise and simple sound effects with Bark.
  • BentoYolo - Build an object detection inference API server with YOLO.
  • RAG - Self-host a private RAG app using custom embedding and language models.
  • BentoChatTTS - Deploy a text-to-speech model ChatTTS for dialogue scenarios like chatbots and virtual assistants.
  • BentoMoirai - Create a forecasting inference API for time-series data.
  • BentoResnet - Build an image classification inference API server with ResNet.
  • BentoFunctionCalling - Build LLM function calling capabilities with BentoML.
  • BentoShield - Build an AI assistant using BentoML and ShieldGemma to evaluate the safety of prompts and filter out harmful content.
  • BentoLangGraph - Deploy a LangGraph AI agent application with BentoML.
  • BentoCrewAI - Deploy a CrewAI multi-agent application with BentoML.