ZenMLZenML is an open-source AI control plane for orchestrating ML pipelines and LLM agent workflows with automated versioning, infrastructure abstraction, and governance from local to Kubernetes.(0)0
R Ray ServeRay Serve is an open-source, scalable model serving framework built on Ray for deploying ML models, LLMs, and multi-model pipelines in production.(0)0
Windmill AI WorkflowWindmill is an open-source, self-hostable workflow orchestration platform for developers. Build internal tools, data pipelines, and automation workflows in 20+ languages with AI assistance, Git collaboration, and enterprise-grade security.(0)0
QdrantQdrant is a high-performance, open-source vector search engine and database written in Rust. Build production-ready RAG pipelines, recommendation systems, and semantic search at scale.(0)0
FastChatFastChat is an open-source platform for training, serving, and evaluating large language models. Powers Chatbot Arena with OpenAI-compatible APIs and a distributed multi-model serving system.(0)0
lakeFS Data PlatformlakeFS is an open-source data version control platform that adds Git-like branching, committing, and rollback to your object storage. Manage AI-ready data at scale.(0)0
vLLMvLLM is an open-source high-throughput LLM inference library supporting GPU, CPU, and TPU backends with an OpenAI-compatible API, PagedAttention, and production deployment tools.(0)0
Neum AI RAG PipelineNeum AI is an open-source RAG framework to build, scale, and maintain real-time data pipelines for Retrieval Augmented Generation and semantic search applications.(0)0
Open WebUI AI ChatRun AI on your own terms with Open WebUI. Connect to Ollama, OpenAI, Anthropic, or any model. Self-host locally or in the cloud with full data privacy, Python extensibility, and enterprise-grade controls.(0)0
Jamba by AI21 LabsJamba is AI21 Labs' family of open, hyper-efficient LLMs with a 256K context window and hybrid Mamba-Transformer architecture, designed for secure enterprise deployment.(0)0
