Skip to main content
⌘K

KServe

Kubernetes-native model serving platform with canary rollouts, auto-scaling, and multi-framework support for production AI.

View on GitHub Official site
Deployment Apache 2.0 High setup 5,200 stars

Overview

Plain English

Kubernetes-native model serving platform with canary rollouts, auto-scaling, and multi-framework support for production AI.

Technical

Kubernetes-native model serving platform with canary rollouts, auto-scaling, and multi-framework support for production AI.

Technical scorecard

License Apache 2.0
Commercial use Yes
OpenAI-compatible API No
REST API No
Fine-tuning support No
Quantization support No
Docker available No
GUI / no-code available No
Telemetry None
Offline after setup Yes

Data & Privacy

Does it send data online?

After setup, this listing is marked as usable offline. Confirm network behavior against the upstream project before regulated deployment.

Does it store history?

Not verified in this directory yet. Review the upstream docs for persistence, logs, and workspace storage.

License checks?

Commercial use is marked as allowed or likely allowed by the listed license.

Telemetry?

None

Last verified: May 15, 2026. Maintainer verification should be treated as directory guidance, not legal advice.

Setup & Installation

High

Expect GPU, framework, or production deployment work.

Prerequisites

Go, Python, Kubernetes

# Start with the official project documentation
# https://github.com/kserve/kserve

Hardware Requirements

RAM16 GB minimum / 32 GB recommended
Hardware tagsNVIDIA GPU (CUDA)
Model formatsNot specified
Primary languageGo, Python

Works Well With