R Ray ServeRay Serve is an open-source, scalable model serving framework built on Ray for deploying ML models, LLMs, and multi-model pipelines in production.(0)0
NeMo GuardrailsNVIDIA's open-source toolkit for adding programmable topical, safety, and dialog guardrails to LLM-based conversational AI systems using the Colang DSL.(0)0
Ray AI FrameworkRay is an open source Python-native framework for scaling and orchestrating distributed AI, ML, and GenAI workloads across CPUs and GPUs at any scale.(0)0
vLLMvLLM is an open-source high-throughput LLM inference library supporting GPU, CPU, and TPU backends with an OpenAI-compatible API, PagedAttention, and production deployment tools.(0)0
Flowise AI BuilderFlowise is an open-source platform for building AI agents, multi-agent workflows, and LLM-powered chatbots with a visual drag-and-drop interface. Supports RAG, HITL, and enterprise deployment.(0)0
Gorilla LLMGorilla is an open-source LLM from UC Berkeley that connects with massive APIs, enabling state-of-the-art function calling across Python, Java, JavaScript, and REST APIs. Includes BFCL benchmarking, RAFT fine-tuning, and the GoEX execution engine.(0)0
TaskWeaverTaskWeaver is Microsoft's open-source, code-first agent framework for planning and executing complex data analytics tasks using LLM-powered agents.(0)0
HaystackBuild production-ready AI agents and RAG pipelines with Haystack, the open-source AI orchestration framework by deepset. Integrate with OpenAI, Anthropic, Hugging Face, and more.(0)0
MLRunMLRun is an open-source AI orchestration framework for managing ML and generative AI pipelines from development to production, with auto-scaling, monitoring, and multi-cloud support.(0)0
Adala AI LabelingAdala is an open-source autonomous data labeling agent framework by HumanSignal. Build LLM-powered agents that learn and apply data processing skills iteratively.(0)0
