W WhyLabsWhyLabs is an open-source AI observability platform for monitoring ML models and LLMs in production. Includes whylogs for data logging and langkit for LLM security.(0)Data & Analytics·AI Models & Infrastructure·AI Infrastructure Tools0
SerpApiSerpApi provides a real-time API to access Google and other search engine results. Handles proxies, CAPTCHAs, and returns fully structured JSON data — perfect for AI pipelines, SEO tools, and data apps.(0)Data & Analytics·LLM Developer Tools·AI Infrastructure Tools0
SambaNova AI CloudSambaNova delivers the fastest AI inference using custom RDU chips, OpenAI-compatible APIs, and scalable infrastructure for enterprise and agentic AI workloads.(0)AI Models & Infrastructure·Foundation Models·LLM Developer Tools·AI Infrastructure Tools0
RunPod GPU CloudRunPod provides on-demand GPUs, serverless compute, and multi-node clusters across 31 global regions. Train, fine-tune, and serve AI models at any scale.(0)AI Models & Infrastructure·LLM Developer Tools·AI Infrastructure Tools0
R Ray ServeRay Serve is an open-source, scalable model serving framework built on Ray for deploying ML models, LLMs, and multi-model pipelines in production.(0)AI Models & Infrastructure·LLM Developer Tools·AI Frameworks0
Ray AI FrameworkRay is an open source Python-native framework for scaling and orchestrating distributed AI, ML, and GenAI workloads across CPUs and GPUs at any scale.(0)AI Models & Infrastructure·AI Infrastructure Tools·AI Frameworks0
QuivrQuivr is an opinionated open-source RAG framework supporting any LLM (GPT-4, Groq, Llama) and vectorstore (PGVector, Faiss). Build AI-powered apps faster without reinventing retrieval pipelines.(0)Knowledge Base Bots·LLM Developer Tools·AI Frameworks0
PromptLayer CloudPromptLayer helps AI teams version, test, and monitor prompts and agents with powerful evaluations, tracing, and collaboration tools. Start for free.(0)LLM Developer Tools·AI Infrastructure Tools·Prompt Engineering Tools0
Portkey AI GatewayPortkey is the open-source production stack for Gen AI teams — access 1,600+ LLMs via one API with built-in observability, guardrails, prompt management, and governance.(0)AI Models & Infrastructure·LLM Developer Tools·AI Infrastructure Tools0
AutoChainAutoChain is an open-source Python framework for building lightweight, extensible, and testable LLM-powered generative agents. Created by Forethought Technologies.(0)AI Agents·LLM Developer Tools·AI Frameworks0
