Skip to content

Stop Token :: stack map

117 tools across 16 layers and 7 builds. Tiers are our reading of each vendor’s model, not a quote. Open core means free to run yourself and metered in the vendor’s cloud.

Human view: /stack

Code-first self-host orchestration

BaseLangGraph
Toolslanggraph, llamaindex, temporal, hatchet, litellm, mcp, e2b, mem0, zep, langfuse, ragas, mcp-clickhouse, mcp-gitlab, mcp-postgresql, mcp-vault

Fast role-based prototype

BaseCrewAI
Toolscrewai, dify, librechat, litellm, langfuse

Research and discussion agents

BaseMicrosoft Agent Framework
Toolsms-agent-framework, llamaindex, langfuse, arize-phoenix

Governance on self-host agents

BaseLangGraph with Agyn
Toolslanggraph, crewai, openclaw, mcp, archestra, langfuse, agyn, openbao, opa, lakera, nemo-guardrails, mcp-slack, mcp-vault

Regulated enterprise

BaseLangGraph with Okta and Prisma
Toolslanggraph, archestra, langfuse, agyn, openbao, okta-ai-agents, prisma-airs, cisco-ai-defense, mcp-vault

Self-host manager with cloud sub-agents

BaseLangGraph over A2A
Toolslanggraph, litellm, mcp, a2a, langfuse, bedrock-agents, gemini-enterprise

Single agent with memory and channels

BaseHermes Agent
Toolshermes-agent, openclaw, mcp, e2b, mem0, mcp-slack, mcp-nextcloud

## Agent orchestration (11)

LangGraph — first choice

RoleGraph orchestrator
DoesExplicit agent graph: state, checkpoints, human-in-the-loop.
TierOpen source, open core

CrewAI

RoleRole crews
DoesCrew and process orchestration with a manager agent.
TierOpen source, open core

Microsoft AutoGen

RoleGroup chat
DoesMulti-agent dialogues. Maintenance mode; new work moves to Agent Framework.
TierOpen source

Microsoft Agent Framework

RoleEnterprise agents
DoesSuccessor to AutoGen and Semantic Kernel, GA since April 2026. Production path for Azure and .NET.
TierOpen source
Native tomicrosoft

OpenAI Agents SDK

RoleHandoff orchestration
DoesHandoffs, tools, guardrails and tracing in OpenAI-style loops.
TierOpen source
Native toopenai

Google ADK

RoleGraph workflows
DoesCode-first agents on a graph workflow runtime since 2.0; Python, Go, TS and Java.
TierOpen source
Native togcp

LangChain

RoleChain toolkit
DoesThe wider toolkit LangGraph sits inside.
TierOpen source, open core

Pydantic AI

RoleTyped agents
DoesType-checked agent framework from the Pydantic team.
TierOpen source

Mastra

RoleTypeScript agents
DoesWorkflows, memory and evals for TS teams.
TierOpen source, open core

Agno

RoleLightweight agents
DoesSmall runtime with memory and tools, low overhead.
TierOpen source

Strands Agents

RoleAWS-native SDK
DoesModel-driven agent SDK and harness, Python and TS, open sourced by AWS.
TierOpen source
Native toaws

## Agent SDK and RAG (3)

LlamaIndex — first choice

RoleData agents and RAG
DoesIngestion, indexes, retrieval and document agents.
TierOpen source, open core

Semantic Kernel

RolePlugins and processes
DoesMaintenance mode, superseded by Microsoft Agent Framework.
TierOpen source
Native tomicrosoft

Haystack

RolePipeline RAG
DoesComposable retrieval pipelines from deepset.
TierOpen source, open core

## Retrieval and vector stores (8)

pgvector — first choice

RolePostgres vectors
DoesVector search inside the database you already run.
TierOpen source
Native topostgres

Qdrant

RoleVector database
DoesRust vector store with filtering and hybrid search.
TierOpen source, open core

Weaviate

RoleVector database
DoesHybrid search with built-in vectorisation modules.
TierOpen source, open core

Chroma

RoleEmbedded vectors
DoesLocal-first store, the shortest path to a prototype.
TierOpen source, open core

LanceDB

RoleColumnar vectors
DoesVector store on a columnar format, runs embedded.
TierOpen source, open core

Elasticsearch

RoleSearch engine
DoesLexical and vector retrieval in one index.
TierOpen source, open core

Pinecone

RoleManaged vectors
DoesHosted vector database, no infrastructure to run.
TierVendor $

Turbopuffer

RoleObject-store vectors
DoesVector search priced on object storage rather than RAM.
TierVendor $

## Inference and serving (8)

vLLM — first choice

RoleInference server
DoesHigh-throughput serving for open-weight models.
TierOpen source

SGLang

RoleInference server
DoesStructured generation and fast serving runtime.
TierOpen source

Ollama

RoleLocal models
DoesLocal model runner for laptops and single boxes, with optional hosted cloud models.
TierOpen source, open core

Groq

RoleFast inference
DoesLow-latency hosted inference on custom silicon; core technology licensed to Nvidia in 2025.
TierVendor $

Together

RoleModel cloud
DoesHosted open-weight models and fine-tuning.
TierVendor $

Fireworks

RoleModel cloud
DoesHosted inference tuned for latency and cost.
TierVendor $

Modal

RoleGPU compute
DoesServerless GPU jobs and endpoints.
TierVendor $

Baseten

RoleModel serving
DoesProduction model endpoints with autoscaling.
TierVendor $

## UI and low-code (5)

Dify

RoleLow-code platform
DoesVisual workflows, agent node, RAG, MCP both ways. Modified Apache licence, no multi-tenant resale.
TierOpen source, open core

LibreChat — first choice

RoleMulti-provider chat UI
DoesUnified chat UI with agents and MCP. Not orchestration itself. Owned by ClickHouse since 2025.
TierOpen source

Open WebUI

RoleSelf-host chat UI
DoesChat front end for local and hosted models. Custom licence with a branding clause.
TierOpen source

Langflow

RoleVisual builder
DoesDrag-and-build agent flows, exportable as MCP servers.
TierOpen source, open core

n8n

RoleWorkflow automation
DoesGeneral automation with AI nodes. Fair-code licence.
TierOpen source, open core

## Autonomous runtimes (4)

Hermes Agent — first choice

RoleReference runtime
DoesCLI, gateway, memory, skills, cron and MCP in one.
TierOpen source

OpenClaw

RolePersonal agent gateway
DoesLocal agent with a multi-channel gateway, run by the OpenClaw Foundation since 2026.
TierOpen source

Goose

RoleLocal coding agent
DoesOn-machine agent with an extension system, a Linux Foundation (AAIF) project.
TierOpen source

Letta Code

RoleStateful agents
DoesMemory-first agent harness and app server, formerly MemGPT.
TierOpen source, open core

## Durable execution (6)

Temporal — first choice

RoleDurable workflows
DoesEvent history, replay, timers and signals for long runs.
TierOpen source, open core

Hatchet

RolePostgres workflows
DoesBackground tasks and queues on PostgreSQL.
TierOpen source, open core
Native topostgres

Inngest

RoleEvent-driven steps
DoesStep functions for TypeScript agent jobs with retries. Server is SSPL, Apache after three years.
TierOpen source, open core

Trigger.dev

RoleTS background jobs
DoesLong-running tasks with a realtime run UI.
TierOpen source, open core

Restate

RoleDurable handlers
DoesDurable execution as plain functions. Server BSL 1.1, SDKs MIT.
TierOpen source, open core

DBOS

RolePostgres durability
DoesDurable workflows as a library on Postgres. Library MIT; the Conductor console is paid.
TierOpen source, open core
Native topostgres

## LLM gateways (5)

LiteLLM — first choice

RoleModel proxy
DoesOpenAI-compatible API to many models, with budgets and keys. Pin versions: two PyPI releases were compromised in March 2026.
TierOpen source, open core

OpenRouter

RoleModel router
DoesOne key and one bill across many providers. Being acquired by Stripe.
TierVendor $

Portkey

RoleAI gateway
DoesRouting, caching, guardrails and spend controls. Part of Palo Alto Networks since 2026.
TierVendor $, open core

Kong AI Gateway

RoleAPI gateway
DoesLLM traffic on the API gateway you may already run. Free only if built from source since 3.10.
TierVendor $$, open core

Cloudflare AI Gateway

RoleEdge gateway
DoesCaching, rate limits and analytics at the edge.
TierVendor $

## MCP and sandboxes (8)

MCP — first choice

RoleTool protocol
DoesOpen standard for tools, resources and prompts, governed by the Linux Foundation (AAIF).
TierOpen source

A2A

RoleAgent-to-agent
DoesCross-vendor agent communication protocol, Linux Foundation, v1.0.
TierOpen source

E2B

RoleCode sandbox
DoesIsolated cloud VMs for agent-written code.
TierOpen source, open core

Archestra.ai

RoleMCP gateway
DoesPrivate MCP registry, guardrails and cost monitoring. AGPL; paid enterprise edition.
TierOpen source, open core

Composio

RoleTool catalogue
DoesManaged connectors and auth for agent tool calls.
TierVendor $

Smithery

RoleMCP registry
DoesDirectory and hosting for MCP servers.
TierVendor $

Docker MCP Toolkit

RoleContainerised MCP
DoesMCP servers as containers with a local catalogue.
TierOpen source

Daytona

RoleDev sandboxes
DoesHosted sandboxes for agent-run code; open repo frozen since June 2026.
TierVendor $

## Agent memory (3)

Mem0 — first choice

RoleMemory API
DoesLong-term memory with hybrid search. Graph memory is on the paid platform only.
TierOpen source, open core

Zep / Graphiti

RoleTemporal knowledge graph
DoesTemporal knowledge graph: Graphiti is open source, Zep itself is cloud-only.
TierOpen source, open core

Cognee

RoleMemory pipelines
DoesBuilds a queryable graph from documents and events.
TierOpen source, open core

## Observability and evals (9)

Langfuse — first choice

RoleTraces and prompts
DoesSelf-host traces, evals, prompt management and datasets. Owned by ClickHouse since 2026.
TierOpen source, open core

Ragas

RoleRAG evals
DoesFaithfulness and recall metrics for retrieval pipelines.
TierOpen source

Promptfoo

RoleCI evals
DoesRegression evals and red-teaming in CI. Owned by OpenAI since 2026.
TierOpen source, open core

Arize Phoenix

RoleOpen tracing
DoesSelf-host tracing and evaluation for LLM apps. Elastic License 2.0, not OSI.
TierOpen source, open core

Opik

RoleTraces and evals
DoesOpen-source tracing and evaluation from Comet.
TierOpen source, open core

DeepEval

RoleTest-style evals
DoesEvals written as unit tests.
TierOpen source, open core

LangSmith

RoleHosted tracing
DoesTracing, datasets and evals for LangChain stacks.
TierVendor $

W&B Weave

RoleExperiment tracking
DoesTracing and evaluation inside Weights & Biases, now part of CoreWeave.
TierVendor $

Braintrust

RoleEval platform
DoesEval workflows, datasets and scoring for teams.
TierVendor $

## Governance and secrets (6)

Agyn

RoleAgent runtime control
DoesSandbox per agent, MCP sidecars, RBAC, budgets and audit. AGPL.
TierOpen source

OpenBao — first choice

RoleSecrets
DoesLinux Foundation fork of Vault: dynamic credentials, encryption as a service.
TierOpen source

HashiCorp Vault

RoleSecrets
DoesThe original, under BSL since 2023 and owned by IBM.
TierVendor $$

OPA

RolePolicy engine
DoesPolicy-as-code for tool-call authorisation.
TierOpen source

Infisical

RoleSecrets platform
DoesSecret management with a self-host path.
TierOpen source, open core

Cerbos

RoleAuthorisation
DoesDecoupled authorisation decisions as a service.
TierOpen source, open core

## Agent identity (4)

Okta for AI Agents

RoleAgent IAM
DoesAgents as first-class identities with short-lived credentials.
TierVendor $$

Auth0 for AI Agents — first choice

RoleAgent auth
DoesToken vaults and user consent for agent tool access.
TierVendor $

WorkOS

RoleEnterprise auth
DoesSSO, directory sync and agent credentials.
TierVendor $

Descope

RoleAgentic identity
DoesIdentity flows built for agents acting for users.
TierVendor $

## AI security (8)

Palo Alto Prisma AIRS

RoleAI runtime security
DoesRuntime protection, agent security, model scanning, red teaming.
TierVendor $$

Cisco AI Defense

RoleAI firewall
DoesRuntime AI defence and model risk.
TierVendor $$

Lakera (Check Point)

RolePrompt injection filter
DoesJailbreak and injection detection API.
TierVendor $$

NeMo Guardrails — first choice

RoleProgrammable rails
DoesSelf-host guardrails over dialog flows.
TierOpen source

Guardrails AI

RoleOutput validation
DoesValidators on model output, self-hostable. Hosted Hub retired; owned by Harvey since 2026.
TierOpen source, open core

Llama Guard

RoleSafety classifier
DoesOpen-weight classifier for input and output screening. Llama community licence, not OSI.
TierOpen source

HiddenLayer

RoleModel security
DoesModel scanning and detection of adversarial use.
TierVendor $$

Zenity

RoleAgent posture
DoesDiscovery and control for agents built across SaaS.
TierVendor $$

## Managed platforms (15)

Amazon Bedrock AgentCore

RoleAWS managed agents
DoesRuntime, memory, gateway, identity, policy and evals for agent systems.
TierVendor $$
Native toaws

Gemini Enterprise Agent Platform

RoleGCP agent platform
DoesFormerly Vertex AI: agent runtime, memory bank, registry and model garden.
TierVendor $$
Native togcp

Microsoft Foundry — first choice

RoleMicrosoft agent service
DoesManaged agents, model catalogue, evals, content safety.
TierVendor $$
Native tomicrosoft

Databricks Agent Bricks

RoleLakehouse agents
DoesAgents on Unity Catalog with MLflow and model serving, formerly Mosaic AI.
TierVendor $$
Native todatabricks

Unity Catalog

RoleGoverned data
DoesCentral governance for agent data access.
TierVendor $$
Native todatabricks

MLflow

RoleML lifecycle
DoesExperiment tracking and model registry.
TierOpen source
Native todatabricks

Bedrock Knowledge Bases

RoleManaged RAG
DoesAWS-native knowledge retrieval for Bedrock agents.
TierVendor $$
Native toaws

AWS Lambda

RoleAction runtime
DoesServerless actions and tool backends in AWS agent stacks.
TierVendor $
Native toaws

AWS IAM

RoleCloud IAM
DoesIdentity and access for AWS-first agent deployments.
TierVendor $
Native toaws

CloudWatch

RoleAWS observability
DoesMetrics and logs for agent operations on AWS.
TierVendor $
Native toaws

BigQuery

RoleKnowledge base
DoesGCP warehouse as a knowledge source for ADK agents.
TierVendor $$
Native togcp

Azure AI Search

RoleEnterprise search
DoesRetrieval layer for Azure and .NET agent stacks; powers Foundry IQ.
TierVendor $$
Native tomicrosoft

Databricks Model Serving

RoleInference
DoesHosted model endpoints for Agent Bricks agents.
TierVendor $$
Native todatabricks

Snowflake Cortex Agents

RoleWarehouse agents
DoesAgents over governed Snowflake data.
TierVendor $$
Native tosnowflake

Salesforce Agentforce

RoleCRM agents
DoesAgents inside the CRM, metered per action.
TierVendor $$
Native tosalesforce

## MCP servers (14)

ClickHouse

RoleOLAP analytics
DoesOfficial server for real-time OLAP queries; remote MCP in ClickHouse Cloud.
TierOpen source, open core

GitLab

RoleDevSecOps
DoesBuilt-in server for repos, CI/CD and merge requests. Still experimental.
TierOpen source, open core

Slack

RoleTeam messaging
DoesOfficial remote server with OAuth: channels, threads and search.
TierVendor $

Nextcloud

RoleSelf-hosted files
DoesFiles on your own infrastructure. Community MCP server only; no official one.
TierOpen source, open core

dbt

RoleTransformation
DoesOfficial server: models, tests and lineage as the semantic source an agent reads.
TierOpen source, open core
Native todbt

Snowflake

RoleWarehouse
DoesSnowflake-managed server over the governed warehouse, GA since 2025.
TierVendor $$
Native tosnowflake

PostgreSQL

RoleRelational DB
DoesNo official server: the reference one was archived in 2025 after a SQL injection flaw. Use a maintained community server, read-only.
TierOpen source
Native topostgres

Vault

RoleSecrets MCP
DoesOfficial HashiCorp server for scoped credentials. Local use only.
TierOpen source, open core

GitHub — first choice

RoleCode and issues
DoesOfficial server, local or remote: repositories, pull requests, actions and issues.
TierVendor $

Sentry

RoleError tracking
DoesOfficial remote server: exceptions and traces as agent context.
TierOpen source, open core

Linear

RoleIssue tracking
DoesOfficial remote server: issues and projects for planning agents.
TierVendor $

Playwright

RoleBrowser control
DoesOfficial Microsoft server for driving a real browser from an agent.
TierOpen source

Notion

RoleDocs and databases
DoesNotion-hosted server: pages and databases as a knowledge source.
TierVendor $

Stripe

RolePayments
DoesOfficial remote server: billing data and operations for commerce agents.
TierVendor $