TensorFlow LiteLiteRT (formerly TensorFlow Lite) is Google's open-source framework for deploying ML and GenAI models on Android, iOS, web, desktop, and IoT devices with GPU/NPU acceleration.(0)0
Crawl4AICrawl4AI is an open-source web crawler and scraper built for LLMs, AI agents, and data pipelines. Generate clean markdown, extract structured data, and crawl at scale.(0)0
Milvus AI Vector DBMilvus is an open-source vector database built for GenAI applications. Perform high-speed similarity searches and scale to tens of billions of vectors with minimal performance loss.(0)0
LocalAILocalAI is a free, open-source alternative to OpenAI and Anthropic. Run LLMs, image generation, audio, and autonomous agents locally on your own hardware with complete privacy.(0)0
Text Generation WebUIRun large language models locally with Text Generation WebUI — supports text, vision, tool-calling, and fine-tuning. 100% offline, open source, and private.(0)0
Jan.aiJan.ai is a free, open-source AI assistant that runs LLMs locally on your device for complete privacy, or connects to cloud models like GPT-4, Claude, and Gemini.(0)0
ONNX RuntimeONNX Runtime is Microsoft's open-source AI engine for accelerated machine learning inference and training across cloud, edge, mobile, and web platforms.(0)0
CandleCandle is an open-source, minimalist ML framework for Rust with GPU support, built by Hugging Face. Run LLMs, Whisper, YOLO, and more with high performance.(0)0
ChromaChroma is an open-source, serverless vector database supporting semantic search, full-text, regex, and metadata filtering. Built for AI apps, RAG pipelines, and LLM-powered products.(0)0
OpenVINOOpenVINO is Intel's open-source toolkit for converting, optimizing, and deploying AI models across CPUs, GPUs, and NPUs with production-ready model serving.(0)0
