TensorFlow LiteLiteRT (formerly TensorFlow Lite) is Google's open-source framework for deploying ML and GenAI models on Android, iOS, web, desktop, and IoT devices with GPU/NPU acceleration.(0)0
OpenVINOOpenVINO is Intel's open-source toolkit for converting, optimizing, and deploying AI models across CPUs, GPUs, and NPUs with production-ready model serving.(0)0
BabyAGIBabyAGI is a pioneering open-source framework for self-building autonomous AI agents that plan, prioritize, and execute tasks using large language models.(0)0
TaskMatrixTaskMatrix is an open-source Microsoft Research project that connects ChatGPT with Visual Foundation Models like Stable Diffusion, GroundingDINO, and Segment Anything for multimodal AI chat and image editing.(0)0
Milvus AI Vector DBMilvus is an open-source vector database built for GenAI applications. Perform high-speed similarity searches and scale to tens of billions of vectors with minimal performance loss.(0)0
Microsoft SEALMicrosoft SEAL is an open-source homomorphic encryption library that enables secure computations directly on encrypted data. Build end-to-end encrypted cloud services with ease.(0)0
Text Generation WebUIRun large language models locally with Text Generation WebUI — supports text, vision, tool-calling, and fine-tuning. 100% offline, open source, and private.(0)0
G Garakgarak is an open-source LLM vulnerability scanner with dozens of plugins and thousands of prompts that test large language model security, backed by NVIDIA.(0)0
lakeFS Data PlatformlakeFS is an open-source data version control platform that adds Git-like branching, committing, and rollback to your object storage. Manage AI-ready data at scale.(0)0
P Petals AIPetals is an open-source framework for distributed LLM inference. Run Llama 3.1 (405B), Mixtral, Falcon, and BLOOM collaboratively across a peer-to-peer GPU network using a consumer GPU or Google Colab.(0)0
