Bisheng

Bisheng is an open-source LLM DevOps platform built for next-generation enterprise AI applications. It provides a comprehensive suite of tools including GenAI workflow orchestration, Retrieval-Augmented Generation (RAG), AI Agents, unified model management across multiple LLM providers, model evaluation and fine-tuning (SFT), and dataset management. With over 11,000 GitHub stars and 200K+ Docker pulls, Bisheng enables organizations to build, deploy, and monitor production-grade AI applications. The platform features a visual workflow builder for creating complex AI pipelines without coding, support for local and cloud-based LLMs (including OpenAI, Llama, Qwen, and more), built-in document parsing with OCR capabilities, and enterprise-grade security features. Bisheng is built with Python and TypeScript, offering both REST API and Web UI interfaces. Its modular architecture allows teams to start with simple RAG chatbots and scale up to sophisticated multi-agent systems with human-in-the-loop approval workflows.