MLC LLMMLC LLM is an open-source ML compiler and high-performance LLM inference engine. Deploy large language models natively on web, iOS, Android, and via REST API.(0)AI Models & Infrastructure·LLM Developer Tools·AI Frameworks0
Ray AI FrameworkRay is an open source Python-native framework for scaling and orchestrating distributed AI, ML, and GenAI workloads across CPUs and GPUs at any scale.(0)AI Models & Infrastructure·AI Infrastructure Tools·AI Frameworks0
QuivrQuivr is an opinionated open-source RAG framework supporting any LLM (GPT-4, Groq, Llama) and vectorstore (PGVector, Faiss). Build AI-powered apps faster without reinventing retrieval pipelines.(0)Knowledge Base Bots·LLM Developer Tools·AI Frameworks0
Grid AIGrid AI, from the creators of PyTorch Lightning, lets you train hundreds of ML models on the cloud from your laptop — no infrastructure management required.(0)AI Models & Infrastructure·LLM Developer Tools·AI Frameworks0
Fal AI InferenceAccess 1,000+ generative image, video, audio, and 3D AI models via a single API. Run inference up to 10x faster with fal's serverless GPU infrastructure. SOC 2 compliant and enterprise-ready.(0)AI Models & Infrastructure·LLM Developer Tools·AI Frameworks0
CopilotKitBuild AI copilots and agents that feel native to your app. CopilotKit provides React/Next.js/Vue SDKs, generative UI, human-in-the-loop, and the open AG-UI protocol.(0)AI Agents·LLM Developer Tools·AI Frameworks0
AutoChainAutoChain is an open-source Python framework for building lightweight, extensible, and testable LLM-powered generative agents. Created by Forethought Technologies.(0)AI Agents·LLM Developer Tools·AI Frameworks0
Anthropic WorkbenchExperiment with Claude AI models in Anthropic's browser-based Workbench. Test prompts, tune parameters, and prototype API integrations—no code required.(0)AI Models & Infrastructure·LLM Developer Tools·Prompt Engineering Tools0
AgentVerseAgentVerse is an open-source framework for deploying multiple LLM-based agents in task-solving and simulation applications. Build collaborative AI agent systems with ease.(0)Automation & Agents·AI Agents·AI Frameworks0
RivetRivet is a free, open-source visual programming environment for building, debugging, and deploying complex LLM-powered AI agents using a node-based graph editor.(0)AI Agents·LLM Developer Tools·AI Frameworks0
