SigNozSigNoz is an open-source, OpenTelemetry-native platform for APM, logs, traces, metrics, and LLM monitoring. Self-host or use the managed cloud — no vendor lock-in.(0)0
R Ray ServeRay Serve is an open-source, scalable model serving framework built on Ray for deploying ML models, LLMs, and multi-model pipelines in production.(0)0
Windmill AI WorkflowWindmill is an open-source, self-hostable workflow orchestration platform for developers. Build internal tools, data pipelines, and automation workflows in 20+ languages with AI assistance, Git collaboration, and enterprise-grade security.(0)0
QdrantQdrant is a high-performance, open-source vector search engine and database written in Rust. Build production-ready RAG pipelines, recommendation systems, and semantic search at scale.(0)0
FastChatFastChat is an open-source platform for training, serving, and evaluating large language models. Powers Chatbot Arena with OpenAI-compatible APIs and a distributed multi-model serving system.(0)0
Jamba by AI21 LabsJamba is AI21 Labs' family of open, hyper-efficient LLMs with a 256K context window and hybrid Mamba-Transformer architecture, designed for secure enterprise deployment.(0)0
lakeFS Data PlatformlakeFS is an open-source data version control platform that adds Git-like branching, committing, and rollback to your object storage. Manage AI-ready data at scale.(0)0
vLLMvLLM is an open-source high-throughput LLM inference library supporting GPU, CPU, and TPU backends with an OpenAI-compatible API, PagedAttention, and production deployment tools.(0)0
Open WebUI AI ChatRun AI on your own terms with Open WebUI. Connect to Ollama, OpenAI, Anthropic, or any model. Self-host locally or in the cloud with full data privacy, Python extensibility, and enterprise-grade controls.(0)0
Weaviate AI VectorWeaviate is an open-source AI vector database for building search, RAG, and agentic AI applications with billion-scale performance and enterprise-grade security.(0)0
