TensorFlow LiteLiteRT (formerly TensorFlow Lite) is Google's open-source framework for deploying ML and GenAI models on Android, iOS, web, desktop, and IoT devices with GPU/NPU acceleration.(0)0
Text Generation WebUIRun large language models locally with Text Generation WebUI — supports text, vision, tool-calling, and fine-tuning. 100% offline, open source, and private.(0)0
MetaflowBuild and manage real-life ML, AI, and data science projects with Metaflow. Open-source framework with versioning, orchestration, and cloud-scale compute originally built at Netflix.(0)0
Milvus AI Vector DBMilvus is an open-source vector database built for GenAI applications. Perform high-speed similarity searches and scale to tens of billions of vectors with minimal performance loss.(0)0
Ray AI FrameworkRay is an open source Python-native framework for scaling and orchestrating distributed AI, ML, and GenAI workloads across CPUs and GPUs at any scale.(0)0
R Ray ServeRay Serve is an open-source, scalable model serving framework built on Ray for deploying ML models, LLMs, and multi-model pipelines in production.(0)0
TaskMatrixTaskMatrix is an open-source Microsoft Research project that connects ChatGPT with Visual Foundation Models like Stable Diffusion, GroundingDINO, and Segment Anything for multimodal AI chat and image editing.(0)0
ONNX RuntimeONNX Runtime is Microsoft's open-source AI engine for accelerated machine learning inference and training across cloud, edge, mobile, and web platforms.(0)0
OpenFHEOpenFHE is an open-source FHE library supporting BGV, BFV, CKKS, FHEW, and TFHE post-quantum encryption schemes for privacy-preserving computation.(0)0
LocalAILocalAI is a free, open-source alternative to OpenAI and Anthropic. Run LLMs, image generation, audio, and autonomous agents locally on your own hardware with complete privacy.(0)0
