Graph orchestrator
Explicit agent graph: state, checkpoints, human-in-the-loop.
Open sourceOpen core
AI stack chooser
117 tools, 16 layers, 7 builds. Pick one or several: what they need collects at the top, the layers they leave uncovered are named, and anything two builds share is marked. 70 of these run on your own infrastructure at no licence cost.
Budget
Removes
Your stack
Demotes only
117 of 117 tools shown
Agent orchestration
Role crews
Crew and process orchestration with a manager agent.
Open sourceOpen core
Group chat
Multi-agent dialogues. Maintenance mode; new work moves to Agent Framework.
Open source
Enterprise agents
Successor to AutoGen and Semantic Kernel, GA since April 2026. Production path for Azure and .NET.
Open source
Handoff orchestration
Handoffs, tools, guardrails and tracing in OpenAI-style loops.
Open source
Graph workflows
Code-first agents on a graph workflow runtime since 2.0; Python, Go, TS and Java.
Open source
LangChain
Chain toolkit
The wider toolkit LangGraph sits inside.
Open sourceOpen core
Pydantic AI
Typed agents
Type-checked agent framework from the Pydantic team.
Open source
Mastra
TypeScript agents
Workflows, memory and evals for TS teams.
Open sourceOpen core
Agno
Lightweight agents
Small runtime with memory and tools, low overhead.
Open source
AWS-native SDK
Model-driven agent SDK and harness, Python and TS, open sourced by AWS.
Open source
Agent SDK and RAG
Data agents and RAG
Ingestion, indexes, retrieval and document agents.
Open sourceOpen core
Plugins and processes
Maintenance mode, superseded by Microsoft Agent Framework.
Open source
Haystack
Pipeline RAG
Composable retrieval pipelines from deepset.
Open sourceOpen core
Retrieval and vector stores
pgvector
Postgres vectors
Vector search inside the database you already run.
Open source
Qdrant
Vector database
Rust vector store with filtering and hybrid search.
Open sourceOpen core
Weaviate
Vector database
Hybrid search with built-in vectorisation modules.
Open sourceOpen core
Chroma
Embedded vectors
Local-first store, the shortest path to a prototype.
Open sourceOpen core
LanceDB
Columnar vectors
Vector store on a columnar format, runs embedded.
Open sourceOpen core
Elasticsearch
Search engine
Lexical and vector retrieval in one index.
Open sourceOpen coreHigh maturity
Pinecone
Managed vectors
Hosted vector database, no infrastructure to run.
Vendor $
Turbopuffer
Object-store vectors
Vector search priced on object storage rather than RAM.
Vendor $High maturity
Inference and serving
vLLM
Inference server
High-throughput serving for open-weight models.
Open sourceHigh maturity
SGLang
Inference server
Structured generation and fast serving runtime.
Open sourceHigh maturity
Ollama
Local models
Local model runner for laptops and single boxes, with optional hosted cloud models.
Open sourceOpen core
Groq
Fast inference
Low-latency hosted inference on custom silicon; core technology licensed to Nvidia in 2025.
Vendor $
Together
Model cloud
Hosted open-weight models and fine-tuning.
Vendor $
Fireworks
Model cloud
Hosted inference tuned for latency and cost.
Vendor $
Modal
GPU compute
Serverless GPU jobs and endpoints.
Vendor $
Baseten
Model serving
Production model endpoints with autoscaling.
Vendor $High maturity
UI and low-code
Low-code platform
Visual workflows, agent node, RAG, MCP both ways. Modified Apache licence, no multi-tenant resale.
Open sourceOpen core
Multi-provider chat UI
Unified chat UI with agents and MCP. Not orchestration itself. Owned by ClickHouse since 2025.
Open source
Open WebUI
Self-host chat UI
Chat front end for local and hosted models. Custom licence with a branding clause.
Open source
Visual builder
Drag-and-build agent flows, exportable as MCP servers.
Open sourceOpen core
n8n
Workflow automation
General automation with AI nodes. Fair-code licence.
Open sourceOpen core
Autonomous runtimes
Reference runtime
CLI, gateway, memory, skills, cron and MCP in one.
Open source
Personal agent gateway
Local agent with a multi-channel gateway, run by the OpenClaw Foundation since 2026.
Open source
Local coding agent
On-machine agent with an extension system, a Linux Foundation (AAIF) project.
Open source
Stateful agents
Memory-first agent harness and app server, formerly MemGPT.
Open sourceOpen core
Durable execution
Durable workflows
Event history, replay, timers and signals for long runs.
Open sourceOpen coreHigh maturity
Postgres workflows
Background tasks and queues on PostgreSQL.
Open sourceOpen core
Event-driven steps
Step functions for TypeScript agent jobs with retries. Server is SSPL, Apache after three years.
Open sourceOpen core
TS background jobs
Long-running tasks with a realtime run UI.
Open sourceOpen core
Restate
Durable handlers
Durable execution as plain functions. Server BSL 1.1, SDKs MIT.
Open sourceOpen coreHigh maturity
DBOS
Postgres durability
Durable workflows as a library on Postgres. Library MIT; the Conductor console is paid.
Open sourceOpen core
LLM gateways
Model proxy
OpenAI-compatible API to many models, with budgets and keys. Pin versions: two PyPI releases were compromised in March 2026.
Open sourceOpen core
OpenRouter
Model router
One key and one bill across many providers. Being acquired by Stripe.
Vendor $
Portkey
AI gateway
Routing, caching, guardrails and spend controls. Part of Palo Alto Networks since 2026.
Vendor $Open core
Kong AI Gateway
API gateway
LLM traffic on the API gateway you may already run. Free only if built from source since 3.10.
Vendor $$Open core
Cloudflare AI Gateway
Edge gateway
Caching, rate limits and analytics at the edge.
Vendor $
MCP and sandboxes
Tool protocol
Open standard for tools, resources and prompts, governed by the Linux Foundation (AAIF).
Open source
Agent-to-agent
Cross-vendor agent communication protocol, Linux Foundation, v1.0.
Open sourceHigh maturity
Code sandbox
Isolated cloud VMs for agent-written code.
Open sourceOpen core
MCP gateway
Private MCP registry, guardrails and cost monitoring. AGPL; paid enterprise edition.
Open sourceOpen coreHigh maturity
Composio
Tool catalogue
Managed connectors and auth for agent tool calls.
Vendor $
Smithery
MCP registry
Directory and hosting for MCP servers.
Vendor $
Containerised MCP
MCP servers as containers with a local catalogue.
Open source
Daytona
Dev sandboxes
Hosted sandboxes for agent-run code; open repo frozen since June 2026.
Vendor $
Agent memory
Memory API
Long-term memory with hybrid search. Graph memory is on the paid platform only.
Open sourceOpen core
Temporal knowledge graph
Temporal knowledge graph: Graphiti is open source, Zep itself is cloud-only.
Open sourceOpen core
Cognee
Memory pipelines
Builds a queryable graph from documents and events.
Open sourceOpen core
Observability and evals
Traces and prompts
Self-host traces, evals, prompt management and datasets. Owned by ClickHouse since 2026.
Open sourceOpen core
RAG evals
Faithfulness and recall metrics for retrieval pipelines.
Open source
CI evals
Regression evals and red-teaming in CI. Owned by OpenAI since 2026.
Open sourceOpen core
Arize Phoenix
Open tracing
Self-host tracing and evaluation for LLM apps. Elastic License 2.0, not OSI.
Open sourceOpen core
Opik
Traces and evals
Open-source tracing and evaluation from Comet.
Open sourceOpen core
DeepEval
Test-style evals
Evals written as unit tests.
Open sourceOpen core
LangSmith
Hosted tracing
Tracing, datasets and evals for LangChain stacks.
Vendor $
W&B Weave
Experiment tracking
Tracing and evaluation inside Weights & Biases, now part of CoreWeave.
Vendor $
Braintrust
Eval platform
Eval workflows, datasets and scoring for teams.
Vendor $High maturity
Governance and secrets
Agent runtime control
Sandbox per agent, MCP sidecars, RBAC, budgets and audit. AGPL.
Open sourceHigh maturity
Secrets
Linux Foundation fork of Vault: dynamic credentials, encryption as a service.
Open sourceHigh maturity
Secrets
The original, under BSL since 2023 and owned by IBM.
Vendor $$High maturity
Policy engine
Policy-as-code for tool-call authorisation.
Open sourceHigh maturity
Infisical
Secrets platform
Secret management with a self-host path.
Open sourceOpen coreHigh maturity
Cerbos
Authorisation
Decoupled authorisation decisions as a service.
Open sourceOpen coreHigh maturity
Agent identity
Agent IAM
Agents as first-class identities with short-lived credentials.
Vendor $$High maturity
Agent auth
Token vaults and user consent for agent tool access.
Vendor $
WorkOS
Enterprise auth
SSO, directory sync and agent credentials.
Vendor $High maturity
Descope
Agentic identity
Identity flows built for agents acting for users.
Vendor $High maturity
AI security
AI runtime security
Runtime protection, agent security, model scanning, red teaming.
Vendor $$High maturity
AI firewall
Runtime AI defence and model risk.
Vendor $$High maturity
Prompt injection filter
Jailbreak and injection detection API.
Vendor $$High maturity
Programmable rails
Self-host guardrails over dialog flows.
Open source
Guardrails AI
Output validation
Validators on model output, self-hostable. Hosted Hub retired; owned by Harvey since 2026.
Open sourceOpen core
Llama Guard
Safety classifier
Open-weight classifier for input and output screening. Llama community licence, not OSI.
Open source
HiddenLayer
Model security
Model scanning and detection of adversarial use.
Vendor $$High maturity
Zenity
Agent posture
Discovery and control for agents built across SaaS.
Vendor $$High maturity
Managed platforms
AWS managed agents
Runtime, memory, gateway, identity, policy and evals for agent systems.
Vendor $$High maturity
GCP agent platform
Formerly Vertex AI: agent runtime, memory bank, registry and model garden.
Vendor $$High maturity
Microsoft agent service
Managed agents, model catalogue, evals, content safety.
Vendor $$High maturity
Lakehouse agents
Agents on Unity Catalog with MLflow and model serving, formerly Mosaic AI.
Vendor $$High maturity
Governed data
Central governance for agent data access.
Vendor $$High maturity
ML lifecycle
Experiment tracking and model registry.
Open source
Managed RAG
AWS-native knowledge retrieval for Bedrock agents.
Vendor $$
Action runtime
Serverless actions and tool backends in AWS agent stacks.
Vendor $
Cloud IAM
Identity and access for AWS-first agent deployments.
Vendor $
AWS observability
Metrics and logs for agent operations on AWS.
Vendor $
Knowledge base
GCP warehouse as a knowledge source for ADK agents.
Vendor $$
Enterprise search
Retrieval layer for Azure and .NET agent stacks; powers Foundry IQ.
Vendor $$
Inference
Hosted model endpoints for Agent Bricks agents.
Vendor $$High maturity
Warehouse agents
Agents over governed Snowflake data.
Vendor $$
Salesforce Agentforce
CRM agents
Agents inside the CRM, metered per action.
Vendor $$
MCP servers
OLAP analytics
Official server for real-time OLAP queries; remote MCP in ClickHouse Cloud.
Open sourceOpen core
DevSecOps
Built-in server for repos, CI/CD and merge requests. Still experimental.
Open sourceOpen core
Team messaging
Official remote server with OAuth: channels, threads and search.
Vendor $
Self-hosted files
Files on your own infrastructure. Community MCP server only; no official one.
Open sourceOpen core
Transformation
Official server: models, tests and lineage as the semantic source an agent reads.
Open sourceOpen core
Warehouse
Snowflake-managed server over the governed warehouse, GA since 2025.
Vendor $$
PostgreSQL
Relational DB
No official server: the reference one was archived in 2025 after a SQL injection flaw. Use a maintained community server, read-only.
Open source
Secrets MCP
Official HashiCorp server for scoped credentials. Local use only.
Open sourceOpen core
Code and issues
Official server, local or remote: repositories, pull requests, actions and issues.
Vendor $
Error tracking
Official remote server: exceptions and traces as agent context.
Open sourceOpen core
Issue tracking
Official remote server: issues and projects for planning agents.
Vendor $
Browser control
Official Microsoft server for driving a real browser from an agent.
Open source
Docs and databases
Notion-hosted server: pages and databases as a knowledge source.
Vendor $
Payments
Official remote server: billing data and operations for commerce agents.
Vendor $
Open core means the project is free to run yourself and metered in the vendor’s cloud — the label is there so the open-source filter does not overclaim. Tiers are our reading of each vendor’s model rather than a quote: vendor $ publishes self-serve pricing, vendor $$ sells through a salesperson. A build highlights rather than hides, because the layers it leaves empty are the part worth looking at.