LlamafileLlamafile by Mozilla lets you distribute and run large language models as a single portable executable on macOS, Linux, and Windows — no setup required.(0)0
Text Generation WebUIRun large language models locally with Text Generation WebUI — supports text, vision, tool-calling, and fine-tuning. 100% offline, open source, and private.(0)0
MT BenchMT Bench is an open-source multi-turn benchmark for evaluating large language models using GPT-4 as an automated judge. Part of the FastChat ecosystem by lm-sys.(0)0
TensorFlow LiteLiteRT (formerly TensorFlow Lite) is Google's open-source framework for deploying ML and GenAI models on Android, iOS, web, desktop, and IoT devices with GPU/NPU acceleration.(0)0
ONNX RuntimeONNX Runtime is Microsoft's open-source AI engine for accelerated machine learning inference and training across cloud, edge, mobile, and web platforms.(0)0
CandleCandle is an open-source, minimalist ML framework for Rust with GPU support, built by Hugging Face. Run LLMs, Whisper, YOLO, and more with high performance.(0)0
Meta ESMOpen-source pretrained language models for protein sequences. Enables protein structure prediction, mutational effect analysis, and generative protein design using transformer-based architectures.(0)0
Ray AI FrameworkRay is an open source Python-native framework for scaling and orchestrating distributed AI, ML, and GenAI workloads across CPUs and GPUs at any scale.(0)0
Axolotl AI Fine TuneAxolotl is a popular open-source framework for fine-tuning large language models using LoRA, QLoRA, and full fine-tuning. Supports LLaMA, Mistral, Falcon, and more with simple YAML configs.(0)0
Milvus AI Vector DBMilvus is an open-source vector database built for GenAI applications. Perform high-speed similarity searches and scale to tens of billions of vectors with minimal performance loss.(0)0
