Danswer AIDanswer AI (Onyx) is an open-source AI chat platform with RAG, AI agents, deep research, and 40+ knowledge connectors. Works with any LLM. Fully self-hostable and air-gap friendly.(0)0
llama.cppRun large language models locally with llama.cpp — a high-performance, open-source C/C++ inference engine supporting CUDA, Metal, Vulkan, and GGUF quantization for 50+ model architectures.(0)0
Danswer AI Search (Onyx)Onyx is the open-source AI enterprise search platform that connects to all your company data, apps, and people to deliver accurate, knowledge-grounded answers.(0)0
Jan.aiJan.ai is a free, open-source AI assistant that runs LLMs locally on your device for complete privacy, or connects to cloud models like GPT-4, Claude, and Gemini.(0)0
MT BenchMT Bench is an open-source multi-turn benchmark for evaluating large language models using GPT-4 as an automated judge. Part of the FastChat ecosystem by lm-sys.(0)0
ONNX RuntimeONNX Runtime is Microsoft's open-source AI engine for accelerated machine learning inference and training across cloud, edge, mobile, and web platforms.(0)0
FastChatFastChat is an open-source platform for training, serving, and evaluating large language models. Powers Chatbot Arena with OpenAI-compatible APIs and a distributed multi-model serving system.(0)0
MemGPT AgentLetta (MemGPT) is an open-source platform for building stateful AI agents with advanced memory that learns and self-improves over time.(0)0
TensorFlow LiteLiteRT (formerly TensorFlow Lite) is Google's open-source framework for deploying ML and GenAI models on Android, iOS, web, desktop, and IoT devices with GPU/NPU acceleration.(0)0
CandleCandle is an open-source, minimalist ML framework for Rust with GPU support, built by Hugging Face. Run LLMs, Whisper, YOLO, and more with high performance.(0)0
