Skip to main content
⌘K
All Categories
All ToolsLLM Inference EnginesLLM ModelsVector DatabasesAgent FrameworksChat InterfacesRAG & Document ProcessingSpeech to TextText to SpeechImage GenerationFine-tuning & TrainingMonitoring & ObservabilityPrivacy & SecurityEmbedding ModelsDeploymentAgent & Workflow AutomationVideo GenerationVision & MultimodalCode AssistantsData Utilities

Text Generation WebUI (Oobabooga)

Open-source desktop app for local LLMs. Text, vision, tool-calling, OpenAI/Anthropic-compatible API. 100% private.

View on GitHub Official site
Chat Interfaces AGPL 3.0 Low setup 47,148 stars

Overview

Plain English

Open-source desktop app for local LLMs. Text, vision, tool-calling, OpenAI/Anthropic-compatible API. 100% private.

Technical

Open-source desktop app for local LLMs. Text, vision, tool-calling, OpenAI/Anthropic-compatible API. 100% private.

Technical scorecard

License AGPL 3.0
Commercial use No
OpenAI-compatible API No
REST API No
Fine-tuning support No
Quantization support No
Docker available No
GUI / no-code available No
Telemetry None
Offline after setup Yes

Data & Privacy

Does it send data online?

After setup, this listing is marked as usable offline. Confirm network behavior against the upstream project before regulated deployment.

Does it store history?

Not verified in this directory yet. Review the upstream docs for persistence, logs, and workspace storage.

License checks?

The listed license needs review before commercial use.

Telemetry?

None

Last verified: May 17, 2026. Maintainer verification should be treated as directory guidance, not legal advice.

Setup & Installation

Low

GUI, low-resource, or simple install path likely available.

Prerequisites

Python, Docker, Bare Metal 

# Start with the official project documentation
# https://github.com/oobabooga/textgen

Hardware Requirements

RAM8 GB minimum / 16 GB recommended
Hardware tagsCPU Only, NVIDIA GPU (CUDA), Apple Silicon (Metal)
Model formatsNot specified
Primary languagePython

Works Well With

RAGFlow RAGFlow is a leading open-source Retrieval-Augmented Generation (RAG) engine that fuses cutting-edge RAG with Agent capabilities to create a superior context layer for LLMs. PrivateGPT Secure document Q&A system designed for sensitive data with no internet connection required for full operation. Marker Fast document converter transforming PDFs, EPUBs, and MOBI files into accurate markdown for LLM ingestion. Haystack (Deepset) Production-ready framework for building RAG and search systems with pipeline architecture and built-in evaluation tools.
Open suggested stack
Share on X Share on LinkedIn