LiteLLM ProxyLiteLLM Proxy is an open-source LLM gateway that provides a single OpenAI-compatible API to manage authentication, load balancing, and spend tracking across 100+ LLM providers.(0)0
FastChatFastChat is an open-source platform for training, serving, and evaluating large language models. Powers Chatbot Arena with OpenAI-compatible APIs and a distributed multi-model serving system.(0)0
vLLMvLLM is an open-source high-throughput LLM inference library supporting GPU, CPU, and TPU backends with an OpenAI-compatible API, PagedAttention, and production deployment tools.(0)0
PySyftPySyft is an open-source Python framework that lets you perform data science and machine learning on private datasets without ever accessing the raw data.(0)0
StarCoder AIStarCoder AI provides open-source large language models for code generation, trained on 600+ programming languages and trillions of tokens from The Stack v2.(0)0
NVIDIA Modulus AI PhysicsNVIDIA PhysicsNeMo is an open-source Python framework for building, training, and fine-tuning physics AI models. Accelerate engineering simulations and digital twins with PINNs, neural operators, GNNs, and more.(0)0
ZenMLZenML is an open-source AI control plane for orchestrating ML pipelines and LLM agent workflows with automated versioning, infrastructure abstraction, and governance from local to Kubernetes.(0)0
VictoriaMetricsVictoriaMetrics is a high-performance, open-source time series database and monitoring solution. Prometheus-compatible, cost-efficient, and built for scale.(0)0
MLC LLMMLC LLM is an open-source ML compiler and high-performance LLM inference engine. Deploy large language models natively on web, iOS, Android, and via REST API.(0)0
Phi AI (Microsoft)Explore Microsoft Phi, a family of efficient open small language models (SLMs) for generative AI. Available on Azure AI Foundry for developers, enterprises, and researchers.(0)0
