Overview
Plain English
Unified model serving framework supporting any model with optimized inference, batching, and auto-scaling for production.
Technical
Unified model serving framework supporting any model with optimized inference, batching, and auto-scaling for production.
Technical scorecard
Data & Privacy
Does it send data online?
After setup, this listing is marked as usable offline. Confirm network behavior against the upstream project before regulated deployment.
Does it store history?
Not verified in this directory yet. Review the upstream docs for persistence, logs, and workspace storage.
License checks?
Commercial use is marked as allowed or likely allowed by the listed license.
Telemetry?
None
Last verified: May 15, 2026. Maintainer verification should be treated as directory guidance, not legal advice.
Setup & Installation
A developer can usually get this running with standard docs.
Prerequisites
Python, Docker, Kubernetes, Bare Metal
# Start with the official project documentation
# https://github.com/bentoml/BentoMLHardware Requirements
Works Well With