Ray AI FrameworkRay is an open source Python-native framework for scaling and orchestrating distributed AI, ML, and GenAI workloads across CPUs and GPUs at any scale.(0)0
ZenMLZenML is an open-source AI control plane for orchestrating ML pipelines and LLM agent workflows with automated versioning, infrastructure abstraction, and governance from local to Kubernetes.(0)0
Semantic KernelSemantic Kernel is an open-source, model-agnostic SDK by Microsoft for building, orchestrating, and deploying AI agents and multi-agent systems in .NET, Python, and Java.(0)0
FastChatFastChat is an open-source platform for training, serving, and evaluating large language models. Powers Chatbot Arena with OpenAI-compatible APIs and a distributed multi-model serving system.(0)0
vLLMvLLM is an open-source high-throughput LLM inference library supporting GPU, CPU, and TPU backends with an OpenAI-compatible API, PagedAttention, and production deployment tools.(0)0
Neum AI RAG PipelineNeum AI is an open-source RAG framework to build, scale, and maintain real-time data pipelines for Retrieval Augmented Generation and semantic search applications.(0)0
Essential AI EnterpriseEssential AI builds open-source frontier large language models and research tools to democratize access to cutting-edge AI. Explore Rnj-1 and their STEM-focused LLM platform.(0)0
KaskadaKaskada is an open-source streaming engine that connects AI models to real-time and historical data. Build real-time AI features with Python, no infrastructure required.(0)0
HaystackBuild production-ready AI agents and RAG pipelines with Haystack, the open-source AI orchestration framework by deepset. Integrate with OpenAI, Anthropic, Hugging Face, and more.(0)0
Jamba by AI21 LabsJamba is AI21 Labs' family of open, hyper-efficient LLMs with a 256K context window and hybrid Mamba-Transformer architecture, designed for secure enterprise deployment.(0)0