Danswer AIDanswer AI (Onyx) is an open-source AI chat platform with RAG, AI agents, deep research, and 40+ knowledge connectors. Works with any LLM. Fully self-hostable and air-gap friendly.(0)0
llama.cppRun large language models locally with llama.cpp — a high-performance, open-source C/C++ inference engine supporting CUDA, Metal, Vulkan, and GGUF quantization for 50+ model architectures.(0)0
MT BenchMT Bench is an open-source multi-turn benchmark for evaluating large language models using GPT-4 as an automated judge. Part of the FastChat ecosystem by lm-sys.(0)0
ONNX RuntimeONNX Runtime is Microsoft's open-source AI engine for accelerated machine learning inference and training across cloud, edge, mobile, and web platforms.(0)0
FastChatFastChat is an open-source platform for training, serving, and evaluating large language models. Powers Chatbot Arena with OpenAI-compatible APIs and a distributed multi-model serving system.(0)0
MemGPT AgentLetta (MemGPT) is an open-source platform for building stateful AI agents with advanced memory that learns and self-improves over time.(0)0
CandleCandle is an open-source, minimalist ML framework for Rust with GPU support, built by Hugging Face. Run LLMs, Whisper, YOLO, and more with high performance.(0)0
Text Generation WebUIRun large language models locally with Text Generation WebUI — supports text, vision, tool-calling, and fine-tuning. 100% offline, open source, and private.(0)0
LocalAILocalAI is a free, open-source alternative to OpenAI and Anthropic. Run LLMs, image generation, audio, and autonomous agents locally on your own hardware with complete privacy.(0)0
ONT DoradoDorado is ONT's high-performance, open-source basecaller for nanopore sequencing reads, featuring GPU acceleration, modified basecalling, duplex mode, and barcode classification.(0)0
