V Vocode AI Voice AgentVocode is an open-source platform to build, deploy, and scale hyperrealistic AI voice agents using any LLM stack. Offers Vocode Core (MIT) and an enterprise-grade API with Python and Node.js SDKs.(0)0
T ToolLLM AI Tool AgentToolBench by OpenBMB is an ICLR'24 spotlight open-source platform for training, serving, and evaluating LLMs with real-world API tool-use capabilities.(0)0
v vLLMvLLM is an open-source high-throughput LLM inference library supporting GPU, CPU, and TPU backends with an OpenAI-compatible API, PagedAttention, and production deployment tools.(0)0
M MLflowMLflow is the largest open source AI engineering platform. Debug, evaluate, monitor, and deploy AI agents, LLMs, and ML models with 30M+ monthly downloads.(0)0
F FastChatFastChat is an open-source platform for training, serving, and evaluating large language models. Powers Chatbot Arena with OpenAI-compatible APIs and a distributed multi-model serving system.(0)0
R Ray ServeRay Serve is an open-source, scalable model serving framework built on Ray for deploying ML models, LLMs, and multi-model pipelines in production.(0)0
A AutoChainAutoChain is an open-source Python framework for building lightweight, extensible, and testable LLM-powered generative agents. Created by Forethought Technologies.(0)0
M MiniGPT-4MiniGPT-4 aligns a visual encoder with the Vicuna LLM to deliver GPT-4-like multimodal capabilities including image description, website generation from sketches, and more.(0)0
N Neum AI RAG PipelineNeum AI is an open-source RAG framework to build, scale, and maintain real-time data pipelines for Retrieval Augmented Generation and semantic search applications.(0)0
H HaystackBuild production-ready AI agents and RAG pipelines with Haystack, the open-source AI orchestration framework by deepset. Integrate with OpenAI, Anthropic, Hugging Face, and more.(0)0