UpTrain AIEnterprise-grade, open-source tooling to evaluate, experiment, monitor, and test LLM applications. Self-host on your secure cloud or use the managed version.(0)0
Argilla Data PlatformArgilla is an open-source platform where AI engineers and domain experts collaborate to build high-quality datasets for LLM fine-tuning, RLHF, and NLP model evaluation.(0)0
Vocode AIVocode is an open source platform to build, deploy, and scale hyperrealistic voice AI agents using LLMs. Supports Python and Node.js SDKs with an enterprise-grade phone call API.(0)0
Arize AIArize AI provides unified LLM observability, agent tracing, and evaluation for AI teams — from development to production. Includes open-source Phoenix and enterprise AX.(0)0
Arize Phoenix AIArize Phoenix is an open-source LLM observability platform built on OpenTelemetry. Instrument, trace, evaluate, and optimize AI applications in real time—framework-agnostic and vendor-lock-in free.(0)0
W WhyLabsWhyLabs is an open-source AI observability platform for monitoring ML models and LLMs in production. Includes whylogs for data logging and langkit for LLM security.(0)0
P Petals AIPetals is an open-source framework for distributed LLM inference. Run Llama 3.1 (405B), Mixtral, Falcon, and BLOOM collaboratively across a peer-to-peer GPU network using a consumer GPU or Google Colab.(0)0
MLflowMLflow is the largest open source AI engineering platform. Debug, evaluate, monitor, and deploy AI agents, LLMs, and ML models with 30M+ monthly downloads.(0)0
OmniParserOmniParser by Microsoft is an open-source tool that parses UI screenshots into structured elements, enabling accurate vision-based GUI automation agents powered by GPT-4V and other VLMs.(0)0
Milvus AI Vector DBMilvus is an open-source vector database built for GenAI applications. Perform high-speed similarity searches and scale to tens of billions of vectors with minimal performance loss.(0)0
