P PromptMagePromptMage is a self-hosted Python framework for building multi-step LLM applications with prompt version control, a playground, auto-generated APIs, and evaluation tools.(0)0
R Ray ServeRay Serve is an open-source, scalable model serving framework built on Ray for deploying ML models, LLMs, and multi-model pipelines in production.(0)0
MLflowMLflow is the largest open source AI engineering platform. Debug, evaluate, monitor, and deploy AI agents, LLMs, and ML models with 30M+ monthly downloads.(0)0
lakeFS Data PlatformlakeFS is an open-source data version control platform that adds Git-like branching, committing, and rollback to your object storage. Manage AI-ready data at scale.(0)0
FastChatFastChat is an open-source platform for training, serving, and evaluating large language models. Powers Chatbot Arena with OpenAI-compatible APIs and a distributed multi-model serving system.(0)0
MLRunMLRun is an open-source AI orchestration framework for managing ML and generative AI pipelines from development to production, with auto-scaling, monitoring, and multi-cloud support.(0)0
MetaflowBuild and manage real-life ML, AI, and data science projects with Metaflow. Open-source framework with versioning, orchestration, and cloud-scale compute originally built at Netflix.(0)0
LocalAILocalAI is a free, open-source alternative to OpenAI and Anthropic. Run LLMs, image generation, audio, and autonomous agents locally on your own hardware with complete privacy.(0)0
LiteLLMLiteLLM is an open-source AI Gateway that provides a unified OpenAI-compatible proxy to 100+ LLMs, with spend tracking, rate limiting, fallbacks, and virtual key management.(0)0
ZenMLZenML is an open-source AI control plane for orchestrating ML pipelines and LLM agent workflows with automated versioning, infrastructure abstraction, and governance from local to Kubernetes.(0)0
