P PromptMagePromptMage is a self-hosted Python framework for building multi-step LLM applications with prompt version control, a playground, auto-generated APIs, and evaluation tools.(0)0
Vocode AI Voice AgentVocode is an open-source platform to build, deploy, and scale hyperrealistic AI voice agents using any LLM stack. Offers Vocode Core (MIT) and an enterprise-grade API with Python and Node.js SDKs.(0)0
MLflowMLflow is the largest open source AI engineering platform. Debug, evaluate, monitor, and deploy AI agents, LLMs, and ML models with 30M+ monthly downloads.(0)0
FastChatFastChat is an open-source platform for training, serving, and evaluating large language models. Powers Chatbot Arena with OpenAI-compatible APIs and a distributed multi-model serving system.(0)0
Guardrails HubGuardrails Hub by Guardrails AI offers 70+ open-source validators for LLM safety, covering PII detection, jailbreak prevention, bias checking, NSFW filtering, and factuality validation.(0)0
OpenAI EvalsOpenAI Evals is an open-source framework for evaluating large language models and LLM systems, featuring a community registry of benchmarks and support for custom private evals.(0)0
Semantic KernelSemantic Kernel is an open-source, model-agnostic SDK by Microsoft for building, orchestrating, and deploying AI agents and multi-agent systems in .NET, Python, and Java.(0)0
UpTrain AIEnterprise-grade, open-source tooling to evaluate, experiment, monitor, and test LLM applications. Self-host on your secure cloud or use the managed version.(0)0
Arize Phoenix AIArize Phoenix is an open-source LLM observability platform built on OpenTelemetry. Instrument, trace, evaluate, and optimize AI applications in real time—framework-agnostic and vendor-lock-in free.(0)0
Weaviate AI VectorWeaviate is an open-source AI vector database for building search, RAG, and agentic AI applications with billion-scale performance and enterprise-grade security.(0)0
