T TensorFlow LiteLiteRT (formerly TensorFlow Lite) is Google's open-source framework for deploying ML and GenAI models on Android, iOS, web, desktop, and IoT devices with GPU/NPU acceleration.(0)0
T Text Generation WebUIRun large language models locally with Text Generation WebUI — supports text, vision, tool-calling, and fine-tuning. 100% offline, open source, and private.(0)0
M MetaflowBuild and manage real-life ML, AI, and data science projects with Metaflow. Open-source framework with versioning, orchestration, and cloud-scale compute originally built at Netflix.(0)0
M Milvus AI Vector DBMilvus is an open-source vector database built for GenAI applications. Perform high-speed similarity searches and scale to tens of billions of vectors with minimal performance loss.(0)0
R Ray AI FrameworkRay is an open source Python-native framework for scaling and orchestrating distributed AI, ML, and GenAI workloads across CPUs and GPUs at any scale.(0)0
T TaskMatrixTaskMatrix is an open-source Microsoft Research project that connects ChatGPT with Visual Foundation Models like Stable Diffusion, GroundingDINO, and Segment Anything for multimodal AI chat and image editing.(0)0
R Ray ServeRay Serve is an open-source, scalable model serving framework built on Ray for deploying ML models, LLMs, and multi-model pipelines in production.(0)0
F FastChatFastChat is an open-source platform for training, serving, and evaluating large language models. Powers Chatbot Arena with OpenAI-compatible APIs and a distributed multi-model serving system.(0)0
T TaskWeaverTaskWeaver is Microsoft's open-source, code-first agent framework for planning and executing complex data analytics tasks using LLM-powered agents.(0)0
Q QdrantQdrant is a high-performance, open-source vector search engine and database written in Rust. Build production-ready RAG pipelines, recommendation systems, and semantic search at scale.(0)0