Langtrace AILangtrace AI is an open-source observability and evaluations platform for AI agents and LLM applications. Track token usage, cost, latency, and accuracy with minimal setup.(0)0
SigNozSigNoz is an open-source, OpenTelemetry-native platform for APM, logs, traces, metrics, and LLM monitoring. Self-host or use the managed cloud — no vendor lock-in.(0)0
HumanEvalHumanEval is OpenAI's open-source benchmark of 164 hand-written Python problems for evaluating large language models on code generation using functional correctness.(0)0
LiteLLMLiteLLM is an open-source AI Gateway that provides a unified OpenAI-compatible proxy to 100+ LLMs, with spend tracking, rate limiting, fallbacks, and virtual key management.(0)0
MetaflowBuild and manage real-life ML, AI, and data science projects with Metaflow. Open-source framework with versioning, orchestration, and cloud-scale compute originally built at Netflix.(0)0
Unleash AI Feature FlagUnleash is a private, secure, open-source feature management platform with feature flags, kill switches, and auditability built for enterprise scale.(0)0
FastChatFastChat is an open-source platform for training, serving, and evaluating large language models. Powers Chatbot Arena with OpenAI-compatible APIs and a distributed multi-model serving system.(0)0
QdrantQdrant is a high-performance, open-source vector search engine and database written in Rust. Build production-ready RAG pipelines, recommendation systems, and semantic search at scale.(0)0
Windmill AI WorkflowWindmill is an open-source, self-hostable workflow orchestration platform for developers. Build internal tools, data pipelines, and automation workflows in 20+ languages with AI assistance, Git collaboration, and enterprise-grade security.(0)0
NVIDIA GarakGarak is NVIDIA's open-source LLM vulnerability scanner for red-teaming AI models. Detect hallucinations, prompt injections, jailbreaks, toxicity, and data leakage.(0)0
