P Petals AIPetals is an open-source framework for distributed LLM inference. Run Llama 3.1 (405B), Mixtral, Falcon, and BLOOM collaboratively across a peer-to-peer GPU network using a consumer GPU or Google Colab.(0)0
O OmniParserOmniParser by Microsoft is an open-source tool that parses UI screenshots into structured elements, enabling accurate vision-based GUI automation agents powered by GPT-4V and other VLMs.(0)0
R Ray ServeRay Serve is an open-source, scalable model serving framework built on Ray for deploying ML models, LLMs, and multi-model pipelines in production.(0)0
R Ray AI FrameworkRay is an open source Python-native framework for scaling and orchestrating distributed AI, ML, and GenAI workloads across CPUs and GPUs at any scale.(0)0
Q QdrantQdrant is a high-performance, open-source vector search engine and database written in Rust. Build production-ready RAG pipelines, recommendation systems, and semantic search at scale.(0)0
Z ZenMLZenML is an open-source AI control plane for orchestrating ML pipelines and LLM agent workflows with automated versioning, infrastructure abstraction, and governance from local to Kubernetes.(0)0
A AutoGPTAutoGPT is an open-source platform with 180k+ stars for building, deploying, and running autonomous AI agents that automate complex multi-step workflows.(0)0
T TrulensTruLens is an open-source framework for evaluating and tracing AI agents and LLM apps. Measure groundedness, context relevance, and more to ship production-ready AI faster.(0)0
A Arize Phoenix AIArize Phoenix is an open-source LLM observability platform built on OpenTelemetry. Instrument, trace, evaluate, and optimize AI applications in real time—framework-agnostic and vendor-lock-in free.(0)0
A AgentVerseAgentVerse is an open-source framework for deploying multiple LLM-based agents in task-solving and simulation applications. Build collaborative AI agent systems with ease.(0)0