Text Generation WebUIRun large language models locally with Text Generation WebUI — supports text, vision, tool-calling, and fine-tuning. 100% offline, open source, and private.(0)0
Jan.aiJan.ai is a free, open-source AI assistant that runs LLMs locally on your device for complete privacy, or connects to cloud models like GPT-4, Claude, and Gemini.(0)0
Milvus AI Vector DBMilvus is an open-source vector database built for GenAI applications. Perform high-speed similarity searches and scale to tens of billions of vectors with minimal performance loss.(0)0
GemmaGemma is a family of lightweight, open-weight AI models from Google DeepMind built on Gemini technology. Free to use, fine-tune, and deploy for responsible AI development.(0)0
PolyCoderPolyCoder is an open-source LLM trained on source code, available in 160M, 0.4B, and 2.7B parameter sizes on HuggingFace. MIT licensed and free for research and commercial use.(0)0
NeMo GuardrailsNVIDIA's open-source toolkit for adding programmable topical, safety, and dialog guardrails to LLM-based conversational AI systems using the Colang DSL.(0)0
TensorFlow LiteLiteRT (formerly TensorFlow Lite) is Google's open-source framework for deploying ML and GenAI models on Android, iOS, web, desktop, and IoT devices with GPU/NPU acceleration.(0)0
P Petals AIPetals is an open-source framework for distributed LLM inference. Run Llama 3.1 (405B), Mixtral, Falcon, and BLOOM collaboratively across a peer-to-peer GPU network using a consumer GPU or Google Colab.(0)0
LocalAILocalAI is a free, open-source alternative to OpenAI and Anthropic. Run LLMs, image generation, audio, and autonomous agents locally on your own hardware with complete privacy.(0)0
MLflowMLflow is the largest open source AI engineering platform. Debug, evaluate, monitor, and deploy AI agents, LLMs, and ML models with 30M+ monthly downloads.(0)0
