ToolLLM AI Tool AgentToolBench by OpenBMB is an ICLR'24 spotlight open-source platform for training, serving, and evaluating LLMs with real-world API tool-use capabilities.(0)0
Argilla Data PlatformArgilla is an open-source platform where AI engineers and domain experts collaborate to build high-quality datasets for LLM fine-tuning, RLHF, and NLP model evaluation.(0)0
Potpie AIBuild custom AI agents that understand your codebase, automate engineering tasks, and boost development velocity. Open source and enterprise-ready.(0)0
Dify AI App PlatformBuild, deploy, and manage AI agents, RAG pipelines, and agentic workflows with Dify's open-source platform. Drag-and-drop interface, multi-LLM support, and Backend-as-a-Service included.(0)0
Arize Phoenix AIArize Phoenix is an open-source LLM observability platform built on OpenTelemetry. Instrument, trace, evaluate, and optimize AI applications in real time—framework-agnostic and vendor-lock-in free.(0)0
SafeRAGSafeRAG is an open-source framework for benchmarking security in Retrieval-Augmented Generation systems, simulating Noise, Conflict, Toxicity, and DoS attacks across the RAG pipeline.(0)0
DeepEvalDeepEval is an open-source LLM evaluation framework with 50+ research-backed metrics, Pytest integration, and support for single/multi-turn and multi-modal AI testing.(0)0
Guardrails HubGuardrails Hub by Guardrails AI offers 70+ open-source validators for LLM safety, covering PII detection, jailbreak prevention, bias checking, NSFW filtering, and factuality validation.(0)0
MLflowMLflow is the largest open source AI engineering platform. Debug, evaluate, monitor, and deploy AI agents, LLMs, and ML models with 30M+ monthly downloads.(0)0
Milvus AI Vector DBMilvus is an open-source vector database built for GenAI applications. Perform high-speed similarity searches and scale to tens of billions of vectors with minimal performance loss.(0)0
