RagasRagas is an open-source framework for evaluating, testing, and monitoring LLM and RAG applications with automated metrics and synthetic data generation.(0)0
RivetRivet is a free, open-source visual programming environment for building, debugging, and deploying complex LLM-powered AI agents using a node-based graph editor.(0)0
P Petals AIPetals is an open-source framework for distributed LLM inference. Run Llama 3.1 (405B), Mixtral, Falcon, and BLOOM collaboratively across a peer-to-peer GPU network using a consumer GPU or Google Colab.(0)0
AgentVerseAgentVerse is an open-source framework for deploying multiple LLM-based agents in task-solving and simulation applications. Build collaborative AI agent systems with ease.(0)0
PromptSourcePromptSource is an open-source toolkit by BigScience Workshop for creating, sharing, and using natural language prompts for large language models and zero-shot NLP research.(0)0
P PromptMagePromptMage is a self-hosted Python framework for building multi-step LLM applications with prompt version control, a playground, auto-generated APIs, and evaluation tools.(0)0
PolyCoderPolyCoder is an open-source LLM trained on source code, available in 160M, 0.4B, and 2.7B parameter sizes on HuggingFace. MIT licensed and free for research and commercial use.(0)0
KaskadaKaskada is an open-source streaming engine that connects AI models to real-time and historical data. Build real-time AI features with Python, no infrastructure required.(0)0
Ray AI FrameworkRay is an open source Python-native framework for scaling and orchestrating distributed AI, ML, and GenAI workloads across CPUs and GPUs at any scale.(0)0
Jan.aiJan.ai is a free, open-source AI assistant that runs LLMs locally on your device for complete privacy, or connects to cloud models like GPT-4, Claude, and Gemini.(0)0
