Overview
Plain English
Scalable model serving built on Ray with dynamic batching, GPU sharing, and multi-model composition for AI pipelines.
Technical
Scalable model serving built on Ray with dynamic batching, GPU sharing, and multi-model composition for AI pipelines.
Technical scorecard
Data & Privacy
Does it send data online?
After setup, this listing is marked as usable offline. Confirm network behavior against the upstream project before regulated deployment.
Does it store history?
Not verified in this directory yet. Review the upstream docs for persistence, logs, and workspace storage.
License checks?
Commercial use is marked as allowed or likely allowed by the listed license.
Telemetry?
None
Last verified: May 16, 2026. Maintainer verification should be treated as directory guidance, not legal advice.
Setup & Installation
A developer can usually get this running with standard docs.
Prerequisites
Python, Docker, Kubernetes, Bare Metal
# Start with the official project documentation
# https://docs.ray.io/en/latest/serve/index.htmlHardware Requirements
Works Well With