OpenAI EvalsOpenAI Evals is an open-source framework for evaluating large language models and LLM systems, featuring a community registry of benchmarks and support for custom private evals.(0)0
TaskWeaverTaskWeaver is Microsoft's open-source, code-first agent framework for planning and executing complex data analytics tasks using LLM-powered agents.(0)0
Milvus AI Vector DBMilvus is an open-source vector database built for GenAI applications. Perform high-speed similarity searches and scale to tens of billions of vectors with minimal performance loss.(0)0
Ray AI FrameworkRay is an open source Python-native framework for scaling and orchestrating distributed AI, ML, and GenAI workloads across CPUs and GPUs at any scale.(0)0
R Ray ServeRay Serve is an open-source, scalable model serving framework built on Ray for deploying ML models, LLMs, and multi-model pipelines in production.(0)0
Argilla Data PlatformArgilla is an open-source platform where AI engineers and domain experts collaborate to build high-quality datasets for LLM fine-tuning, RLHF, and NLP model evaluation.(0)0
MLflowMLflow is the largest open source AI engineering platform. Debug, evaluate, monitor, and deploy AI agents, LLMs, and ML models with 30M+ monthly downloads.(0)0
NeMo GuardrailsNVIDIA's open-source toolkit for adding programmable topical, safety, and dialog guardrails to LLM-based conversational AI systems using the Colang DSL.(0)0
ONNX RuntimeONNX Runtime is Microsoft's open-source AI engine for accelerated machine learning inference and training across cloud, edge, mobile, and web platforms.(0)0
FastChatFastChat is an open-source platform for training, serving, and evaluating large language models. Powers Chatbot Arena with OpenAI-compatible APIs and a distributed multi-model serving system.(0)0
