Skip to content

Stop Token :: stack map

217 tools across 15 layers in 6 blocks; 109 of them open source. The layers are the fifteen of the article, numbered and ordered the same way. Tiers are our reading of each vendor’s model, not a quote. Open core means free to run yourself and metered in the vendor’s cloud. Price bands are the tool’s own price per month in dollars, for a first deployment of 5–50 users, not the cost of building the layer; the chooser reports a range of 0.6 to 1.5 times the band’s middle.

Human view: /stack

Who runs itnobody — hosted only · one to three people · four to fifteen people · a platform team
Data may livecloud anywhere · cloud, EU only · no cloud, our own servers
ProblemsAnswer questions from our documents · Answer questions from our numbers · Run a process end to end without a person · An agent that acts in our systems — CRM, tickets, code · A copilot for a team's daily work · Pull structured data out of documents · AI inside the product our customers use
Stagenothing in production yet · something in production
Leanno preference · open source · vendor
PlatformAzure · AWS · Google Cloud · Databricks · Snowflake · other or none
Model01 Model
Context02 System prompt, 03 Knowledge base, 04 Semantic layer, 05 Data quality
Agent06 Harness, 07 Memory, 08 MCP & skills hub, 09 Channel + handoff
Access10 Identity + access, 11 Filter
Run & Cost12 Gateway
Control13 Traces, 14 Evals, 15 Feedback

## 01 Model (28)

Writes the answer: a hosted API, or open weights on an inference server you run.

Stage 1 of 3 in the article’s order.

Anthropic API — first choice

Categoryhosted API
RoleHosted frontier models
DoesClaude models through the API and the three clouds; EU regions on Bedrock and Vertex. Long context, agents, MCP-native.
Tiervendor, price list
Price$500–3,000 / month
Hostingcloud
EU datayes
Takesnobody — hosted only, about 0.05 FTE to run
Maturityestablished

OpenAI API — first choice

Categoryhosted API
RoleHosted frontier models
DoesGPT models through the API; EU data residency per project.
Tiervendor, price list
Price$500–3,000 / month
Hostingcloud
EU datayes
Takesnobody — hosted only, about 0.05 FTE to run
Maturityestablished

Amazon Bedrock models

Categoryhosted API
RoleModels in AWS
DoesAnthropic, Mistral, Meta and Amazon models behind one AWS API, EU regions.
Tiervendor, price list
Price$500–3,000 / month
Hostingcloud
EU datayes
Takesnobody — hosted only, about 0.1 FTE to run
Maturityestablished
Native toaws

Azure OpenAI

Categoryhosted API
RoleOpenAI models in Azure
DoesOpenAI models inside the Microsoft tenant, with EU regions and enterprise controls.
Tiervendor, price list
Price$500–3,000 / month
Hostingcloud
EU datayes
Takesnobody — hosted only, about 0.1 FTE to run
Maturityestablished
Native toazure

Cortex AI models

Categoryhosted API
RoleModels in Snowflake
DoesHosted models called from SQL, inside the Snowflake boundary.
Tiervendor, sales call
Price$500–3,000 / month
Hostingcloud
EU datayes
Takesnobody — hosted only, about 0.05 FTE to run
Maturityestablished
Native tosnowflake

Gemini API

Categoryhosted API
RoleHosted frontier models
DoesGoogle's models through AI Studio and Vertex; EU regions on Vertex.
Tiervendor, price list
Price$500–3,000 / month
Hostingcloud
EU datayes
Takesnobody — hosted only, about 0.05 FTE to run
Maturityestablished
Native togcp

Alibaba Cloud Model Studio

Categoryhosted API
RoleHosted Qwen
DoesQwen through Alibaba Cloud, Singapore and China regions.
Tiervendor, price list
Priceunder $500 / month
Hostingcloud
EU datano
Takesnobody — hosted only, about 0.05 FTE to run
Maturityestablished

Cohere

Categoryhosted API
RoleEnterprise models and rerank
DoesEmbeddings and rerankers that lift retrieval quality; private deployments.
Tiervendor, price list
Priceunder $500 / month
Hostingboth
EU datapartial
Takesnobody — hosted only, about 0.05 FTE to run
Maturityestablished

Databricks Model Serving

Categoryhosted API
RoleInference
DoesHosted model endpoints for Agent Bricks agents.
Tiervendor, sales call
Price$3,000–10,000 / month
Hostingcloud
EU datapartial
Takesa platform team, about 0.05 FTE to run
Maturityestablished
Native todatabricks

DeepSeek API

Categoryhosted API
RoleHosted DeepSeek
DoesThe provider's own API, hosted in China; the cheapest frontier-class tokens, and data leaves your jurisdiction.
Tiervendor, price list
Priceunder $500 / month
Hostingcloud
EU datano
Takesnobody — hosted only, about 0.05 FTE to run
Maturityestablished

Fireworks

Categoryhosted API
RoleModel cloud
DoesHosted inference tuned for latency and cost.
Tiervendor, price list
Price$500–3,000 / month
Hostingcloud
EU datano
Takesnobody — hosted only, about 0.05 FTE to run
Maturityestablished

Groq

Categoryhosted API
RoleFast inference
DoesLow-latency hosted inference on custom silicon; core technology licensed to Nvidia in 2025.
Tiervendor, price list
Price$500–3,000 / month
Hostingcloud
EU datano
Takesnobody — hosted only, about 0.05 FTE to run
Maturityestablished

Mistral

Categoryhosted API
RoleEU hosted models
DoesEU company, EU hosting, open weights. A tier below the frontier on quality; the pick when sovereignty outranks capability.
Tiervendor, price list, open core
Priceunder $500 / month
Hostingcloud
EU datayes
Takesnobody — hosted only, about 0.05 FTE to run
Maturityestablished

Modal

Categoryhosted API
RoleGPU compute
DoesServerless GPU jobs and endpoints.
Tiervendor, price list
Price$500–3,000 / month
Hostingcloud
EU datapartial
Takesone to three people, about 0.05 FTE to run
Maturityestablished

Together

Categoryhosted API
RoleModel cloud
DoesHosted open-weight models and fine-tuning.
Tiervendor, price list
Price$500–3,000 / month
Hostingcloud
EU datano
Takesnobody — hosted only, about 0.05 FTE to run
Maturityestablished

Baseten

Categoryhosted API
RoleModel serving
DoesProduction model endpoints with autoscaling.
Tiervendor, price list
Price$500–3,000 / month
Hostingcloud
EU datano
Takesa platform team, about 0.05 FTE to run
Maturityestablished

vLLM — first choice

Categoryinference server
RoleInference server
DoesHigh-throughput serving for open-weight models.
Tieropen source
Price$3,000–10,000 / month
Hostingself
EU datayes
Takesfour to fifteen people, about 1 FTE to run
Maturityestablished

Ollama

Categoryinference server
RoleLocal models
DoesLocal model runner for laptops and single boxes, with optional hosted cloud models.
Tieropen source, open core
Priceunder $500 / month
Hostingself
EU datayes
Takesone to three people, about 0.25 FTE to run
Maturityestablished

SGLang

Categoryinference server
RoleInference server
DoesStructured generation and fast serving runtime.
Tieropen source
Priceunder $500 / month
Hostingself
EU datayes
Takesfour to fifteen people, about 1 FTE to run
Maturitygrowing

Qwen (Alibaba) — first choice

Categoryopen weights
RoleOpen weights, frontier-class
DoesThe strongest open-weight family of 2026 across sizes; Apache-2.0. Self-hosted, the weights never leave your racks; provenance is a question for your policy, not your architecture.
Tieropen source
Pricefree
Hostingself
EU datayes
Takesone to three people
Maturityestablished

DeepSeek

Categoryopen weights
RoleOpen weights, reasoning
DoesFrontier-class reasoning and coding at open weights; MIT. Self-hosted, nothing goes to the provider. Needs the big machines.
Tieropen source
Pricefree
Hostingself
EU datayes
Takesfour to fifteen people
Maturityestablished

GLM (Zhipu / Z.ai)

Categoryopen weights
RoleOpen weights, agents and coding
DoesStrong agentic and coding models at open weights; MIT.
Tieropen source
Pricefree
Hostingself
EU datayes
Takesfour to fifteen people
Maturityestablished

Kimi K2 (Moonshot)

Categoryopen weights
RoleOpen weights, long context
DoesLarge open-weight MoE built for agents and long context; modified MIT.
Tieropen source
Pricefree
Hostingself
EU datayes
Takesfour to fifteen people
Maturityestablished

gpt-oss (OpenAI)

Categoryopen weights
RoleOpen weights from OpenAI
DoesOpenAI's open-weight reasoning models; Apache-2.0. Smaller than the frontier, familiar behaviour.
Tieropen source
Pricefree
Hostingself
EU datayes
Takesfour to fifteen people
Maturityestablished

Gemma (Google)

Categoryopen weights
RoleOpen weights, small
DoesSmall open models from Google for on-device and cheap serving.
Tieropen source
Pricefree
Hostingself
EU datayes
Takesone to three people
Maturityestablished

Llama (Meta)

Categoryopen weights
RoleOpen weights, the ecosystem default
DoesThe widest tooling support; no longer the strongest weights. Meta's own licence.
Tieropen source
Pricefree
Hostingself
EU datayes
Takesfour to fifteen people
Maturityestablished

MiniMax M-series

Categoryopen weights
RoleOpen weights, efficient
DoesOpen-weight models tuned for agentic workloads at low serving cost.
Tieropen source
Pricefree
Hostingself
EU datayes
Takesfour to fifteen people
Maturitygrowing

Mistral open weights

Categoryopen weights
RoleOpen weights, EU
DoesThe EU open-weight option; Apache-2.0 on most sizes. Behind the Chinese families on capability.
Tieropen source
Pricefree
Hostingself
EU datayes
Takesfour to fifteen people
Maturityestablished

## 02 System prompt (2)

The role and the limits, versioned and tested like code.

Stage 1 of 3 in the article’s order.

Prompts in git

Categoryprompt management
RolePrompts as code
DoesThe prompt lives next to the code, is reviewed in pull requests and is tested by the evals on every change. Nothing to buy.
Tieropen source
Pricefree
Hostingboth
EU datayes
Takesnobody — hosted only
Maturityestablished

PromptLayer

Categoryprompt management
RolePrompt management
DoesVersioned prompts with a UI for the people who write them.
Tiervendor, price list
Priceunder $500 / month
Hostingcloud
EU datano
Takesnobody — hosted only, about 0.05 FTE to run
Maturityestablished

## 03 Knowledge base (32)

Documents, the data catalogue and the links between them, searched within the user's rights.

Stage 1 of 3 in the article’s order.

DataHub

Categorydata catalogue
RoleOpen data catalogue
DoesOpen-source metadata platform: tables, owners, lineage and glossary in one place the agent can search; Apache-2.0, with a managed cloud.
Tieropen source, open core
Priceunder $500 / month
Hostingboth
EU datapartial
Takesfour to fifteen people, about 0.5 FTE to run
Maturityestablished

Atlan

Categorydata catalogue
RoleHosted data catalogue
DoesCatalogue, lineage and glossary as a service, with connectors to the usual warehouses and BI tools.
Tiervendor, sales call
Priceover $10,000 / month
Hostingcloud
EU datapartial
Takesnobody — hosted only, about 0.05 FTE to run
Maturityestablished

Dataplex

Categorydata catalogue
RoleData governance in GCP
DoesCatalogue, lineage and data quality scans over BigQuery.
Tiervendor, price list
Price$500–3,000 / month
Hostingcloud
EU datayes
Takesnobody — hosted only, about 0.1 FTE to run
Maturityestablished
Native togcp

Microsoft Purview

Categorydata catalogue
RoleData governance in Azure
DoesCatalogue, lineage, data quality and policy across the Microsoft estate.
Tiervendor, sales call
Price$3,000–10,000 / month
Hostingcloud
EU datayes
Takesnobody — hosted only, about 0.1 FTE to run
Maturityestablished
Native toazure

Unity Catalog

Categorydata catalogue
RoleGoverned data
DoesCentral governance for agent data access.
Tiervendor, sales call
Price$3,000–10,000 / month
Hostingcloud
EU datapartial
Takesa platform team, about 0.05 FTE to run
Maturityestablished
Native todatabricks

LlamaIndex — first choice

Categoryretrieval framework
RoleData agents and RAG
DoesIngestion, indexes, retrieval and document agents.
Tieropen source, open core
Priceunder $500 / month
Hostingboth
EU datapartial
Takesnobody — hosted only, about 0.25 FTE to run
Maturityestablished

Haystack

Categoryretrieval framework
RolePipeline RAG
DoesComposable retrieval pipelines from deepset.
Tieropen source, open core
Priceunder $500 / month
Hostingboth
EU datapartial
Takesnobody — hosted only, about 0.25 FTE to run
Maturityestablished

Neo4j — first choice

Categoryknowledge graph
RoleGraph database
DoesThe property graph most GraphRAG stacks sit on; open core with a cloud.
Tieropen source, open core
Pricefree
Hostingboth
EU datayes
Takesfour to fifteen people, about 0.5 FTE to run
Maturityestablished

Cognee

Categoryknowledge graph
RoleMemory pipelines
DoesBuilds a queryable graph from documents and events.
Tieropen source, open core
Priceunder $500 / month
Hostingboth
EU datapartial
Takesnobody — hosted only, about 0.25 FTE to run
Maturitygrowing

LightRAG

Categoryknowledge graph
RoleGraph-augmented retrieval
DoesBuilds a graph from documents and retrieves over both; research-grade.
Tieropen source
Pricefree
Hostingself
EU datayes
Takesfour to fifteen people, about 0.25 FTE to run
Maturityexperimental

Microsoft GraphRAG

Categoryknowledge graph
RoleGraphRAG pipeline
DoesMicrosoft's reference pipeline for graph-based retrieval; batch-heavy.
Tieropen source
Pricefree
Hostingself
EU datayes
Takesfour to fifteen people, about 0.25 FTE to run
Maturitygrowing
Native toazure

Docling — first choice

Categorydocument parsing
RoleDocument parsing
DoesIBM's open parser: PDF, DOCX, tables and layout into clean chunks.
Tieropen source
Pricefree
Hostingself
EU datayes
Takesone to three people, about 0.1 FTE to run
Maturityestablished

Azure Document Intelligence

Categorydocument parsing
RoleParsing in Azure
DoesLayout, tables and forms from documents as a service.
Tiervendor, price list
Priceunder $500 / month
Hostingcloud
EU datayes
Takesnobody — hosted only, about 0.05 FTE to run
Maturityestablished
Native toazure

Unstructured

Categorydocument parsing
RoleDocument ETL
DoesOpen library plus a hosted API for turning files into retrieval-ready pieces.
Tieropen source, open core
Priceunder $500 / month
Hostingboth
EU datapartial
Takesnobody — hosted only, about 0.1 FTE to run
Maturityestablished

Amazon Textract

Categorydocument parsing
RoleParsing in AWS
DoesText, tables and forms from documents as a service.
Tiervendor, price list
Priceunder $500 / month
Hostingcloud
EU datayes
Takesnobody — hosted only, about 0.05 FTE to run
Maturityestablished
Native toaws

Document AI

Categorydocument parsing
RoleParsing in GCP
DoesDocument parsing and extraction as a service.
Tiervendor, price list
Priceunder $500 / month
Hostingcloud
EU datayes
Takesnobody — hosted only, about 0.05 FTE to run
Maturityestablished
Native togcp

LlamaParse

Categorydocument parsing
RoleHosted parsing
DoesLlamaIndex's parsing service for tables and complex layouts.
Tiervendor, price list
Priceunder $500 / month
Hostingcloud
EU datano
Takesnobody — hosted only, about 0.05 FTE to run
Maturityestablished

pgvector — first choice

Categoryretrieval
RolePostgres vectors
DoesVector search inside the database you already run.
Tieropen source
Priceunder $500 / month
Hostingself
EU datayes
Takesone to three people, about 0.1 FTE to run
Maturityestablished

Cortex Search

Categoryretrieval
RoleRetrieval in Snowflake
DoesHybrid search over documents inside Snowflake.
Tiervendor, sales call
Price$500–3,000 / month
Hostingcloud
EU datayes
Takesnobody — hosted only, about 0.1 FTE to run
Maturityestablished
Native tosnowflake

Databricks Vector Search

Categoryretrieval
RoleRetrieval in Databricks
DoesVector index on Delta tables under Unity Catalog.
Tiervendor, price list
Price$500–3,000 / month
Hostingcloud
EU datayes
Takesnobody — hosted only, about 0.1 FTE to run
Maturityestablished
Native todatabricks

Qdrant

Categoryretrieval
RoleVector database
DoesRust vector store with filtering and hybrid search.
Tieropen source, open core
Priceunder $500 / month
Hostingboth
EU datayes
Takesnobody — hosted only, about 0.25 FTE to run
Maturityestablished

Vertex AI Search

Categoryretrieval
RoleRetrieval in GCP
DoesManaged search and RAG over documents and data in Google Cloud.
Tiervendor, price list
Price$500–3,000 / month
Hostingcloud
EU datayes
Takesnobody — hosted only, about 0.1 FTE to run
Maturityestablished
Native togcp

Azure AI Search

Categoryretrieval
RoleEnterprise search
DoesRetrieval layer for Azure and .NET agent stacks; powers Foundry IQ.
Tiervendor, sales call
Price$3,000–10,000 / month
Hostingcloud
EU datapartial
Takesnobody — hosted only, about 0.05 FTE to run
Maturityestablished
Native toazure

Bedrock Knowledge Bases

Categoryretrieval
RoleManaged RAG
DoesAWS-native knowledge retrieval for Bedrock agents.
Tiervendor, sales call
Price$3,000–10,000 / month
Hostingcloud
EU datapartial
Takesnobody — hosted only, about 0.05 FTE to run
Maturityestablished
Native toaws

BigQuery

Categoryretrieval
RoleKnowledge base
DoesGCP warehouse as a knowledge source for ADK agents.
Tiervendor, sales call
Price$3,000–10,000 / month
Hostingcloud
EU datapartial
Takesnobody — hosted only, about 0.05 FTE to run
Maturityestablished
Native togcp

Chroma

Categoryretrieval
RoleEmbedded vectors
DoesLocal-first store, the shortest path to a prototype.
Tieropen source, open core
Priceunder $500 / month
Hostingboth
EU datapartial
Takesnobody — hosted only, about 0.25 FTE to run
Maturitygrowing

Elasticsearch

Categoryretrieval
RoleSearch engine
DoesLexical and vector retrieval in one index.
Tieropen source, open core
Priceunder $500 / month
Hostingboth
EU datayes
Takesfour to fifteen people, about 0.5 FTE to run
Maturityestablished

LanceDB

Categoryretrieval
RoleColumnar vectors
DoesVector store on a columnar format, runs embedded.
Tieropen source, open core
Priceunder $500 / month
Hostingboth
EU datapartial
Takesnobody — hosted only, about 0.25 FTE to run
Maturitygrowing

OpenSearch

Categoryretrieval
RoleSearch engine
DoesFull-text and vector search under Apache-2.0, run by the OpenSearch Software Foundation; managed as Amazon OpenSearch Service.
Tieropen source
Priceunder $500 / month
Hostingboth
EU datayes
Takesfour to fifteen people, about 0.5 FTE to run
Maturityestablished

Pinecone

Categoryretrieval
RoleManaged vectors
DoesHosted vector database, no infrastructure to run.
Tiervendor, price list
Price$500–3,000 / month
Hostingcloud
EU datapartial
Takesnobody — hosted only, about 0.05 FTE to run
Maturityestablished

Weaviate

Categoryretrieval
RoleVector database
DoesHybrid search with built-in vectorisation modules.
Tieropen source, open core
Priceunder $500 / month
Hostingboth
EU datayes
Takesnobody — hosted only, about 0.25 FTE to run
Maturityestablished

Turbopuffer

Categoryretrieval
RoleObject-store vectors
DoesVector search priced on object storage rather than RAM.
Tiervendor, price list
Price$500–3,000 / month
Hostingcloud
EU datano
Takesa platform team, about 0.05 FTE to run
Maturitygrowing

## 04 Semantic layer (14)

One definition of each metric and entity, and questions answered over it rather than over raw tables.

Stage 3 of 3 in the article’s order.

Cube — first choice

Categorymetric layer
RoleSemantic layer
DoesMetrics defined once, served to BI and to agents through SQL, REST and MCP.
Tieropen source, open core
Pricefree
Hostingboth
EU datayes
Takesone to three people, about 0.5 FTE to run
Maturityestablished

Fabric and Power BI semantic models

Categorymetric layer
RoleMetrics in Microsoft
DoesThe semantic model behind Power BI and Copilot; the definition the Microsoft estate already has.
Tiervendor, price list
Price$500–3,000 / month
Hostingcloud
EU datayes
Takesnobody — hosted only, about 0.1 FTE to run
Maturityestablished
Native toazure

Snowflake Semantic Views

Categorymetric layer
RoleMetrics in the warehouse
DoesSemantic definitions inside Snowflake, used by Cortex Analyst for text-to-SQL.
Tiervendor, sales call
Price$3,000–10,000 / month
Hostingcloud
EU datayes
Takesnobody — hosted only, about 0.1 FTE to run
Maturitygrowing
Native tosnowflake

Unity Catalog metric views

Categorymetric layer
RoleMetrics in Databricks
DoesMetric definitions in Unity Catalog, used by Genie and BI.
Tiervendor, price list
Priceunder $500 / month
Hostingcloud
EU datayes
Takesnobody — hosted only, about 0.1 FTE to run
Maturitygrowing
Native todatabricks

dbt Semantic Layer

Categorymetric layer
RoleMetrics on dbt
DoesMetricFlow definitions next to the models; served through dbt Cloud.
Tiervendor, price list
Price$500–3,000 / month
Hostingcloud
EU datayes
Takesone to three people, about 0.1 FTE to run
Maturityestablished

Looker (LookML)

Categorymetric layer
RoleMetrics in GCP
DoesLookML as the governed definition; Gemini in Looker answers over it.
Tiervendor, sales call
Priceover $10,000 / month
Hostingcloud
EU datayes
Takesnobody — hosted only, about 0.1 FTE to run
Maturityestablished
Native togcp

Power BI semantic model

Categorymetric layer
RoleMetrics in Microsoft
DoesThe semantic model behind Power BI and Copilot; the definition the Microsoft stack already has.
Tiervendor, price list
Priceunder $500 / month
Hostingcloud
EU datayes
Takesnobody — hosted only, about 0.1 FTE to run
Maturityestablished
Native toazure

AI/BI Genie

Categoryquestions over the model
RoleQuestions over the lakehouse
DoesNatural-language questions over governed tables.
Tiervendor, price list
Priceunder $500 / month
Hostingcloud
EU datayes
Takesnobody — hosted only, about 0.05 FTE to run
Maturityestablished
Native todatabricks

Cortex Analyst

Categoryquestions over the model
RoleQuestions over semantic views
DoesText-to-SQL over Snowflake semantic views.
Tiervendor, sales call
Price$500–3,000 / month
Hostingcloud
EU datayes
Takesnobody — hosted only, about 0.05 FTE to run
Maturityestablished
Native tosnowflake

Wren AI

Categoryquestions over the model
RoleText-to-SQL on a semantic model
DoesAgents answer over a modelling layer rather than raw tables; open core.
Tieropen source, open core
Pricefree
Hostingboth
EU datayes
Takesone to three people, about 0.25 FTE to run
Maturitygrowing

Amazon Q in QuickSight

Categoryquestions over the model
RoleQuestions over QuickSight
DoesNatural-language questions over QuickSight topics.
Tiervendor, price list
Price$500–3,000 / month
Hostingcloud
EU datayes
Takesnobody — hosted only, about 0.05 FTE to run
Maturityestablished
Native toaws

Copilot in Power BI

Categoryquestions over the model
RoleQuestions over Power BI
DoesNatural-language questions answered over the semantic model.
Tiervendor, price list
Price$500–3,000 / month
Hostingcloud
EU datayes
Takesnobody — hosted only, about 0.05 FTE to run
Maturitygrowing
Native toazure

Gemini in Looker

Categoryquestions over the model
RoleQuestions over LookML
DoesNatural-language questions over the governed Looker model.
Tiervendor, sales call
Price$3,000–10,000 / month
Hostingcloud
EU datayes
Takesnobody — hosted only, about 0.05 FTE to run
Maturitygrowing
Native togcp

Vanna

Categoryquestions over the model
RoleText-to-SQL
DoesRAG-trained text-to-SQL over your schema; open core.
Tieropen source, open core
Pricefree
Hostingboth
EU datayes
Takesone to three people, about 0.25 FTE to run
Maturitygrowing

## 05 Data quality (7)

Says whether the tables behind an answer can be trusted today.

Stage 3 of 3 in the article’s order.

Soda

Categorychecks as code
RoleData quality checks
DoesChecks as code on the tables the answers come from; open core.
Tieropen source, open core
Pricefree
Hostingboth
EU datayes
Takesone to three people, about 0.1 FTE to run
Maturityestablished

AWS Glue Data Quality

Categorychecks as code
RoleData quality in AWS
DoesRules on tables in the Glue catalogue.
Tiervendor, price list
Priceunder $500 / month
Hostingcloud
EU datayes
Takesnobody — hosted only, about 0.1 FTE to run
Maturityestablished
Native toaws

Elementary

Categorychecks as code
Roledbt observability
DoesTests, freshness and lineage for dbt projects; open core.
Tieropen source, open core
Pricefree
Hostingboth
EU datayes
Takesone to three people, about 0.1 FTE to run
Maturitygrowing

Great Expectations

Categorychecks as code
RoleData contracts
DoesExpectations on data as tests; the open library, plus a cloud.
Tieropen source, open core
Pricefree
Hostingboth
EU datapartial
Takesone to three people, about 0.25 FTE to run
Maturityestablished

Horizon data metric functions

Categorychecks as code
RoleData quality in Snowflake
DoesData metric functions and Horizon governance on tables.
Tiervendor, sales call
Priceunder $500 / month
Hostingcloud
EU datayes
Takesnobody — hosted only, about 0.1 FTE to run
Maturityestablished
Native tosnowflake

Monte Carlo

Categorydata observability
RoleData observability
DoesMonitors freshness, volume and schema on warehouse tables and alerts when they break, without writing each check by hand.
Tiervendor, sales call
Price$3,000–10,000 / month
Hostingcloud
EU datapartial
Takesnobody — hosted only, about 0.05 FTE to run
Maturityestablished

Lakehouse Monitoring

Categorydata observability
RoleData quality in Databricks
DoesQuality and drift monitors on Unity Catalog tables.
Tiervendor, price list
Price$500–3,000 / month
Hostingcloud
EU datayes
Takesnobody — hosted only, about 0.1 FTE to run
Maturityestablished
Native todatabricks

## 06 Harness (32)

Runs the loop: the plan, the calls, the limits, the point where a person signs off.

Stage 1 of 3 in the article’s order.

LangGraph — first choice

Categoryagent framework
RoleGraph orchestrator
DoesExplicit agent graph: state, checkpoints, human-in-the-loop.
Tieropen source, open core
Priceunder $500 / month
Hostingboth
EU datayes
Takesone to three people, about 0.25 FTE to run
Maturityestablished

Microsoft Agent Framework

Categoryagent framework
RoleEnterprise agents
DoesSuccessor to AutoGen and Semantic Kernel, GA since April 2026. Production path for Azure and .NET.
Tieropen source
Priceunder $500 / month
Hostingboth
EU datayes
Takesone to three people, about 0.25 FTE to run
Maturitygrowing
Native toazure

OpenAI Agents SDK

Categoryagent framework
RoleHandoff orchestration
DoesHandoffs, tools, guardrails and tracing in OpenAI-style loops.
Tieropen source
Priceunder $500 / month
Hostingboth
EU datapartial
Takesone to three people, about 0.25 FTE to run
Maturityestablished

Pydantic AI

Categoryagent framework
RoleTyped agents
DoesType-checked agent framework from the Pydantic team.
Tieropen source
Priceunder $500 / month
Hostingself
EU datayes
Takesone to three people, about 0.25 FTE to run
Maturitygrowing

CrewAI

Categoryagent framework
RoleRole crews
DoesCrew and process orchestration with a manager agent.
Tieropen source, open core
Priceunder $500 / month
Hostingboth
EU datapartial
Takesnobody — hosted only, about 0.25 FTE to run
Maturityestablished

Google ADK

Categoryagent framework
RoleGraph workflows
DoesCode-first agents on a graph workflow runtime since 2.0; Python, Go, TS and Java.
Tieropen source
Priceunder $500 / month
Hostingboth
EU datapartial
Takesnobody — hosted only, about 0.25 FTE to run
Maturitygrowing
Native togcp

Goose

Categoryagent framework
RoleLocal coding agent
DoesOn-machine agent with an extension system, a Linux Foundation (AAIF) project.
Tieropen source
Priceunder $500 / month
Hostingself
EU datayes
Takesone to three people, about 0.25 FTE to run
Maturitygrowing

Mastra

Categoryagent framework
RoleTypeScript agents
DoesWorkflows, memory and evals for TS teams.
Tieropen source, open core
Priceunder $500 / month
Hostingboth
EU datapartial
Takesnobody — hosted only, about 0.25 FTE to run
Maturitygrowing

Strands Agents

Categoryagent framework
RoleAWS-native SDK
DoesModel-driven agent SDK and harness, Python and TS, open sourced by AWS.
Tieropen source
Priceunder $500 / month
Hostingself
EU datayes
Takesone to three people, about 0.25 FTE to run
Maturitygrowing
Native toaws

Agno

Categoryagent framework
RoleLightweight agents
DoesSmall runtime with memory and tools, low overhead.
Tieropen source
Priceunder $500 / month
Hostingself
EU datayes
Takesone to three people, about 0.25 FTE to run
Maturitygrowing

Hermes Agent

Categoryagent framework
RoleReference runtime
DoesCLI, gateway, memory, skills, cron and MCP in one.
Tieropen source
Priceunder $500 / month
Hostingself
EU datayes
Takesone to three people, about 0.25 FTE to run
Maturityexperimental

LangChain

Categoryagent framework
RoleChain toolkit
DoesThe wider toolkit LangGraph sits inside.
Tieropen source, open core
Priceunder $500 / month
Hostingboth
EU datapartial
Takesnobody — hosted only, about 0.25 FTE to run
Maturityestablished

OpenClaw

Categoryagent framework
RolePersonal agent gateway
DoesLocal agent with a multi-channel gateway, run by the OpenClaw Foundation since 2026.
Tieropen source
Priceunder $500 / month
Hostingself
EU datayes
Takesone to three people, about 0.25 FTE to run
Maturityexperimental

Microsoft AutoGen

Categoryagent framework
RoleGroup chat
DoesMulti-agent dialogues. Maintenance mode; new work moves to Agent Framework.
Tieropen source
Priceunder $500 / month
Hostingself
EU datayes
Takesone to three people, about 0.25 FTE to run
Maturitymaintenance
Native toazure

Semantic Kernel

Categoryagent framework
RolePlugins and processes
DoesMaintenance mode, superseded by Microsoft Agent Framework.
Tieropen source
Priceunder $500 / month
Hostingself
EU datayes
Takesone to three people, about 0.25 FTE to run
Maturitymaintenance
Native toazure

Microsoft Foundry — first choice

Categorymanaged agent platform
RoleMicrosoft agent service
DoesManaged agents, model catalogue, evals, content safety.
Tiervendor, sales call
Price$500–3,000 / month
Hostingcloud
EU datayes
Takesnobody — hosted only, about 0.1 FTE to run
Maturityestablished
Native toazure

Amazon Bedrock AgentCore

Categorymanaged agent platform
RoleAWS managed agents
DoesRuntime, memory, gateway, identity, policy and evals for agent systems.
Tiervendor, sales call
Price$500–3,000 / month
Hostingcloud
EU datayes
Takesnobody — hosted only, about 0.1 FTE to run
Maturitygrowing
Native toaws

Databricks Agent Bricks

Categorymanaged agent platform
RoleLakehouse agents
DoesAgents on Unity Catalog with MLflow and model serving, formerly Mosaic AI.
Tiervendor, sales call
Price$3,000–10,000 / month
Hostingcloud
EU datayes
Takesone to three people, about 0.1 FTE to run
Maturitygrowing
Native todatabricks

Gemini Enterprise Agent Platform

Categorymanaged agent platform
RoleGCP agent platform
DoesFormerly Vertex AI: agent runtime, memory bank, registry and model garden.
Tiervendor, sales call
Price$500–3,000 / month
Hostingcloud
EU datayes
Takesnobody — hosted only, about 0.1 FTE to run
Maturitygrowing
Native togcp

Snowflake Cortex Agents

Categorymanaged agent platform
RoleWarehouse agents
DoesAgents over governed Snowflake data.
Tiervendor, sales call
Price$3,000–10,000 / month
Hostingcloud
EU datayes
Takesnobody — hosted only, about 0.1 FTE to run
Maturitygrowing
Native tosnowflake

Salesforce Agentforce

Categorymanaged agent platform
RoleCRM agents
DoesAgents inside the CRM, metered per action.
Tiervendor, sales call
Priceover $10,000 / month
Hostingcloud
EU datayes
Takesnobody — hosted only, about 0.05 FTE to run
Maturityestablished
Native tosalesforce

Agyn

Categorymanaged agent platform
RoleAgent runtime control
DoesSandbox per agent, MCP sidecars, RBAC, budgets and audit. AGPL.
Tieropen source
Priceunder $500 / month
Hostingself
EU datayes
Takesa platform team, about 0.25 FTE to run
Maturityexperimental

Temporal — first choice

Categorydurable workflows
RoleDurable workflows
DoesEvent history, replay, timers and signals for long runs.
Tieropen source, open core
Priceunder $500 / month
Hostingboth
EU datapartial
Takesfour to fifteen people, about 0.5 FTE to run
Maturityestablished

Hatchet

Categorydurable workflows
RolePostgres workflows
DoesBackground tasks and queues on PostgreSQL.
Tieropen source, open core
Priceunder $500 / month
Hostingboth
EU datapartial
Takesnobody — hosted only, about 0.25 FTE to run
Maturitygrowing

Inngest

Categorydurable workflows
RoleEvent-driven steps
DoesStep functions for TypeScript agent jobs with retries. Server is SSPL, Apache after three years.
Tieropen source, open core
Priceunder $500 / month
Hostingboth
EU datapartial
Takesnobody — hosted only, about 0.25 FTE to run
Maturityestablished

Restate

Categorydurable workflows
RoleDurable handlers
DoesDurable execution as plain functions. Server BSL 1.1, SDKs MIT.
Tieropen source, open core
Priceunder $500 / month
Hostingboth
EU datapartial
Takesa platform team, about 0.25 FTE to run
Maturitygrowing

Trigger.dev

Categorydurable workflows
RoleTS background jobs
DoesLong-running tasks with a realtime run UI.
Tieropen source, open core
Priceunder $500 / month
Hostingboth
EU datapartial
Takesnobody — hosted only, about 0.25 FTE to run
Maturitygrowing

AWS Lambda

Categorydurable workflows
RoleAction runtime
DoesServerless actions and tool backends in AWS agent stacks.
Tiervendor, price list
Price$500–3,000 / month
Hostingcloud
EU datapartial
Takesnobody — hosted only, about 0.05 FTE to run
Maturityestablished
Native toaws

DBOS

Categorydurable workflows
RolePostgres durability
DoesDurable workflows as a library on Postgres. Library MIT; the Conductor console is paid.
Tieropen source, open core
Priceunder $500 / month
Hostingboth
EU datapartial
Takesnobody — hosted only, about 0.25 FTE to run
Maturitygrowing

Dify

Categorylow-code builder
RoleLow-code platform
DoesVisual workflows, agent node, RAG, MCP both ways. Modified Apache licence, no multi-tenant resale.
Tieropen source, open core
Priceunder $500 / month
Hostingboth
EU datapartial
Takesnobody — hosted only, about 0.25 FTE to run
Maturityestablished

n8n

Categorylow-code builder
RoleWorkflow automation
DoesGeneral automation with AI nodes. Fair-code licence.
Tieropen source, open core
Priceunder $500 / month
Hostingboth
EU datayes
Takesnobody — hosted only, about 0.25 FTE to run
Maturityestablished

Langflow

Categorylow-code builder
RoleVisual builder
DoesDrag-and-build agent flows, exportable as MCP servers.
Tieropen source, open core
Priceunder $500 / month
Hostingboth
EU datapartial
Takesnobody — hosted only, about 0.25 FTE to run
Maturitygrowing

## 07 Memory (3)

Remembers the conversation and the customer between sessions.

Stage 2 of 3 in the article’s order.

Mem0

Categorymemory API
RoleMemory API
DoesLong-term memory with hybrid search. Graph memory is on the paid platform only.
Tieropen source, open core
Priceunder $500 / month
Hostingboth
EU datapartial
Takesnobody — hosted only, about 0.25 FTE to run
Maturitygrowing

Letta Code

Categorymemory API
RoleStateful agents
DoesMemory-first agent harness and app server, formerly MemGPT.
Tieropen source, open core
Priceunder $500 / month
Hostingboth
EU datapartial
Takesnobody — hosted only, about 0.25 FTE to run
Maturitygrowing

Zep / Graphiti

Categorytemporal memory graph
RoleTemporal knowledge graph
DoesTemporal knowledge graph: Graphiti is open source, Zep itself is cloud-only.
Tieropen source, open core
Priceunder $500 / month
Hostingboth
EU datapartial
Takesnobody — hosted only, about 0.25 FTE to run
Maturitygrowing

## 08 MCP & skills hub (31)

Tools, skills and sandboxes from one catalogue: what the agent can do, and where its code runs.

Stage 1 of 3 in the article’s order.

Databricks managed MCP servers

Categoryservers over your data
RoleMCP over the lakehouse
DoesManaged servers over Unity Catalog functions, Genie and vector search.
Tiervendor, price list
Priceunder $500 / month
Hostingcloud
EU datayes
Takesnobody — hosted only, about 0.05 FTE to run
Maturitygrowing
Native todatabricks

MCP Toolbox for Databases

Categoryservers over your data
RoleMCP over GCP data
DoesGoogle's open MCP server over BigQuery, AlloyDB, Spanner and more.
Tieropen source
Pricefree
Hostingboth
EU datayes
Takesnobody — hosted only, about 0.1 FTE to run
Maturitygrowing
Native togcp

Snowflake

Categoryservers over your data
RoleWarehouse
DoesSnowflake-managed server over the governed warehouse, GA since 2025.
Tiervendor, sales call
Price$3,000–10,000 / month
Hostingcloud
EU datapartial
Takesnobody — hosted only, about 0.05 FTE to run
Maturitygrowing
Native tosnowflake

dbt

Categoryservers over your data
RoleTransformation
DoesOfficial server: models, tests and lineage as the semantic source an agent reads.
Tieropen source, open core
Priceunder $500 / month
Hostingboth
EU datapartial
Takesnobody — hosted only, about 0.25 FTE to run
Maturitygrowing

ClickHouse

Categoryservers over your data
RoleOLAP analytics
DoesOfficial server for real-time OLAP queries; remote MCP in ClickHouse Cloud.
Tieropen source, open core
Priceunder $500 / month
Hostingboth
EU datapartial
Takesnobody — hosted only, about 0.25 FTE to run
Maturitygrowing

PostgreSQL

Categoryservers over your data
RoleRelational DB
DoesNo official server: the reference one was archived in 2025 after a SQL injection flaw. Use a maintained community server, read-only.
Tieropen source
Priceunder $500 / month
Hostingself
EU datayes
Takesone to three people, about 0.25 FTE to run
Maturityexperimental

MCP — first choice

Categorytool protocol
RoleTool protocol
DoesOpen standard for tools, resources and prompts, governed by the Linux Foundation (AAIF).
Tieropen source
Pricefree
Hostingboth
EU datapartial
Takesone to three people
Maturityestablished

A2A

Categorytool protocol
RoleAgent-to-agent
DoesCross-vendor agent communication protocol, Linux Foundation, v1.0.
Tieropen source
Pricefree
Hostingself
EU datayes
Takesa platform team
Maturityexperimental

MCP Registry

CategoryMCP gateway and registry
RoleServer registry
DoesThe official registry of MCP servers; the index a private skill hub extends.
Tieropen source
Pricefree
Hostingboth
EU datayes
Takesone to three people
Maturitygrowing

Archestra.ai

CategoryMCP gateway and registry
RoleMCP gateway
DoesPrivate MCP registry, guardrails and cost monitoring. AGPL; paid enterprise edition.
Tieropen source, open core
Priceunder $500 / month
Hostingboth
EU datapartial
Takesfour to fifteen people, about 0.25 FTE to run
Maturityexperimental

Docker MCP Toolkit

CategoryMCP gateway and registry
RoleContainerised MCP
DoesMCP servers as containers with a local catalogue.
Tieropen source
Priceunder $500 / month
Hostingself
EU datayes
Takesone to three people, about 0.25 FTE to run
Maturitygrowing

MetaMCP

CategoryMCP gateway and registry
RoleMCP aggregator
DoesPuts many MCP servers behind one endpoint, with namespaces, access and middleware; MIT, runs in Docker.
Tieropen source
Priceunder $500 / month
Hostingself
EU datayes
Takesone to three people, about 0.25 FTE to run
Maturitygrowing

Smithery

CategoryMCP gateway and registry
RoleMCP registry
DoesDirectory and hosting for MCP servers.
Tiervendor, price list
Price$500–3,000 / month
Hostingcloud
EU datano
Takesnobody — hosted only, about 0.05 FTE to run
Maturitygrowing

AgentCore Code Interpreter

Categorycode sandbox
RoleSandbox in AWS
DoesIsolated code execution for Bedrock agents.
Tiervendor, price list
Priceunder $500 / month
Hostingcloud
EU datayes
Takesnobody — hosted only, about 0.05 FTE to run
Maturitygrowing
Native toaws

Azure Container Apps dynamic sessions

Categorycode sandbox
RoleSandbox in Azure
DoesIsolated code sessions for agent-written code, per second.
Tiervendor, price list
Priceunder $500 / month
Hostingcloud
EU datayes
Takesnobody — hosted only, about 0.05 FTE to run
Maturityestablished
Native toazure

E2B

Categorycode sandbox
RoleCode sandbox
DoesIsolated cloud VMs for agent-written code.
Tieropen source, open core
Priceunder $500 / month
Hostingcloud
EU datano
Takesnobody — hosted only, about 0.05 FTE to run
Maturityestablished

Daytona

Categorycode sandbox
RoleDev sandboxes
DoesHosted sandboxes for agent-run code; open repo frozen since June 2026.
Tieropen source, open core
Priceunder $500 / month
Hostingboth
EU datapartial
Takesnobody — hosted only, about 0.25 FTE to run
Maturitygrowing

AWS MCP servers

Categoryservers over your systems
RoleMCP over AWS
DoesOfficial servers over AWS services and documentation.
Tieropen source
Pricefree
Hostingboth
EU datayes
Takesnobody — hosted only, about 0.1 FTE to run
Maturitygrowing
Native toaws

Azure MCP Server

Categoryservers over your systems
RoleMCP over Azure
DoesMicrosoft's official MCP server over Azure resources; Functions host custom servers.
Tieropen source
Pricefree
Hostingboth
EU datayes
Takesnobody — hosted only, about 0.1 FTE to run
Maturitygrowing
Native toazure

GitHub

Categoryservers over your systems
RoleCode and issues
DoesOfficial server, local or remote: repositories, pull requests, actions and issues.
Tieropen source
Priceunder $500 / month
Hostingself
EU datayes
Takesone to three people, about 0.25 FTE to run
Maturityestablished

Playwright

Categoryservers over your systems
RoleBrowser control
DoesOfficial Microsoft server for driving a real browser from an agent.
Tieropen source
Priceunder $500 / month
Hostingself
EU datayes
Takesone to three people, about 0.25 FTE to run
Maturityestablished

Composio

Categoryservers over your systems
RoleTool catalogue
DoesManaged connectors and auth for agent tool calls.
Tiervendor, price list
Price$500–3,000 / month
Hostingcloud
EU datano
Takesnobody — hosted only, about 0.05 FTE to run
Maturitygrowing

GitLab

Categoryservers over your systems
RoleDevSecOps
DoesBuilt-in server for repos, CI/CD and merge requests. Still experimental.
Tieropen source, open core
Priceunder $500 / month
Hostingboth
EU datapartial
Takesnobody — hosted only, about 0.25 FTE to run
Maturityexperimental

Linear

Categoryservers over your systems
RoleIssue tracking
DoesOfficial remote server: issues and projects for planning agents.
Tiervendor, price list
Price$500–3,000 / month
Hostingcloud
EU datapartial
Takesnobody — hosted only, about 0.05 FTE to run
Maturitygrowing

Notion

Categoryservers over your systems
RoleDocs and databases
DoesNotion-hosted server: pages and databases as a knowledge source.
Tieropen source, open core
Priceunder $500 / month
Hostingboth
EU datapartial
Takesnobody — hosted only, about 0.25 FTE to run
Maturitygrowing

Sentry

Categoryservers over your systems
RoleError tracking
DoesOfficial remote server: exceptions and traces as agent context.
Tieropen source, open core
Priceunder $500 / month
Hostingboth
EU datapartial
Takesnobody — hosted only, about 0.25 FTE to run
Maturitygrowing

Slack

Categoryservers over your systems
RoleTeam messaging
DoesOfficial remote server with OAuth: channels, threads and search.
Tiervendor, price list
Price$500–3,000 / month
Hostingcloud
EU datapartial
Takesnobody — hosted only, about 0.05 FTE to run
Maturitygrowing

Stripe

Categoryservers over your systems
RolePayments
DoesOfficial remote server: billing data and operations for commerce agents.
Tieropen source, open core
Priceunder $500 / month
Hostingboth
EU datapartial
Takesnobody — hosted only, about 0.25 FTE to run
Maturitygrowing

Vault

Categoryservers over your systems
RoleSecrets MCP
DoesOfficial HashiCorp server for scoped credentials. Local use only.
Tieropen source, open core
Priceunder $500 / month
Hostingboth
EU datapartial
Takesnobody — hosted only, about 0.25 FTE to run
Maturitygrowing

Nextcloud

Categoryservers over your systems
RoleSelf-hosted files
DoesFiles on your own infrastructure. Community MCP server only; no official one.
Tieropen source, open core
Priceunder $500 / month
Hostingboth
EU datapartial
Takesnobody — hosted only, about 0.25 FTE to run
Maturityexperimental

Agent Skills — first choice

Categoryskills
RoleSkill format
DoesOpen specification for packaging a skill — instructions, scripts, resources — that any agent can load.
Tieropen source
Pricefree
Hostingboth
EU datayes
Takesone to three people
Maturitygrowing

## 09 Channel + handoff (8)

Where people talk to it, and how a hard case reaches a person.

Stage 1 of 3 in the article’s order.

Intercom Fin

Categorycustomer channel and handoff
RoleCustomer AI agent
DoesAnswers customers in chat and email and hands the conversation to a person in the helpdesk; billed per resolution. Works on Intercom, Zendesk or Salesforce.
Tiervendor, price list
Price$500–3,000 / month
Hostingcloud
EU datapartial
Takesnobody — hosted only, about 0.05 FTE to run
Maturityestablished

Zendesk AI agents

Categorycustomer channel and handoff
RoleCustomer AI agent
DoesAI agents inside Zendesk that resolve tickets and pass the rest to the team; billed per automated resolution.
Tiervendor, sales call
Price$3,000–10,000 / month
Hostingcloud
EU datapartial
Takesnobody — hosted only, about 0.05 FTE to run
Maturityestablished

LibreChat — first choice

Categorystaff chat
RoleMulti-provider chat UI
DoesUnified chat UI with agents and MCP. Not orchestration itself. Owned by ClickHouse since 2025.
Tieropen source
Priceunder $500 / month
Hostingself
EU datayes
Takesone to three people, about 0.25 FTE to run
Maturityestablished

Microsoft Copilot Studio

Categorystaff chat
RoleLow-code agents in M365
DoesAgents built inside the Microsoft tenant, metered per message; the thing a Microsoft shop is offered first.
Tiervendor, sales call
Price$3,000–10,000 / month
Hostingcloud
EU datayes
Takesnobody — hosted only, about 0.05 FTE to run
Maturityestablished
Native toazure

Open WebUI

Categorystaff chat
RoleSelf-host chat UI
DoesChat front end for local and hosted models. Custom licence with a branding clause.
Tieropen source
Priceunder $500 / month
Hostingself
EU datayes
Takesone to three people, about 0.25 FTE to run
Maturityestablished

Amazon Q Business

Categorystaff chat
RoleChat in AWS
DoesA chat surface over company data and connectors, per user per month.
Tiervendor, sales call
Price$3,000–10,000 / month
Hostingcloud
EU datayes
Takesnobody — hosted only, about 0.05 FTE to run
Maturityestablished
Native toaws

Gemini Enterprise

Categorystaff chat
RoleChat in GCP
DoesThe company-wide chat and agent surface, per user per month.
Tiervendor, sales call
Price$3,000–10,000 / month
Hostingcloud
EU datayes
Takesnobody — hosted only, about 0.05 FTE to run
Maturitygrowing
Native togcp

Snowflake Intelligence

Categorystaff chat
RoleChat in Snowflake
DoesThe agent surface over governed data for business users.
Tiervendor, sales call
Price$3,000–10,000 / month
Hostingcloud
EU datayes
Takesnobody — hosted only, about 0.05 FTE to run
Maturitygrowing
Native tosnowflake

## 10 Identity + access (18)

Acts on the user's behalf or under its own identity, with the right permissions and secrets.

Stage 2 of 3 in the article’s order.

AgentCore Identity

Categoryagent identity
RoleAgent identity in AWS
DoesIdentities and credentials for agents acting across services.
Tiervendor, price list
Priceunder $500 / month
Hostingcloud
EU datayes
Takesnobody — hosted only, about 0.05 FTE to run
Maturitygrowing
Native toaws

Microsoft Entra Agent ID

Categoryagent identity
RoleAgent identity in Azure
DoesIdentities for agents inside Entra, with the tenant's policies.
Tiervendor, price list
Priceunder $500 / month
Hostingcloud
EU datayes
Takesnobody — hosted only, about 0.05 FTE to run
Maturitygrowing
Native toazure

Okta for AI Agents

Categoryagent identity
RoleAgent IAM
DoesAgents as first-class identities with short-lived credentials.
Tiervendor, sales call
Price$3,000–10,000 / month
Hostingcloud
EU datayes
Takesa platform team, about 0.05 FTE to run
Maturitygrowing

Auth0 for AI Agents

Categoryon the user's behalf
RoleAgent auth
DoesToken vaults and user consent for agent tool access.
Tiervendor, price list
Price$500–3,000 / month
Hostingcloud
EU datayes
Takesfour to fifteen people, about 0.05 FTE to run
Maturitygrowing

Descope

Categoryon the user's behalf
RoleAgentic identity
DoesIdentity flows built for agents acting for users.
Tiervendor, price list
Price$500–3,000 / month
Hostingcloud
EU datapartial
Takesa platform team, about 0.05 FTE to run
Maturitygrowing

WorkOS

Categoryon the user's behalf
RoleEnterprise auth
DoesSSO, directory sync and agent credentials.
Tiervendor, price list
Price$500–3,000 / month
Hostingcloud
EU datapartial
Takesa platform team, about 0.05 FTE to run
Maturityestablished

OpenFGA

Categoryfine-grained authorisation
RoleRelationship-based authorisation
DoesFine-grained permissions in the style of Google's Zanzibar: who may see which document, checked per request. A CNCF project; Apache-2.0.
Tieropen source
Priceunder $500 / month
Hostingself
EU datayes
Takesfour to fifteen people, about 0.25 FTE to run
Maturitygrowing

Cerbos

Categoryfine-grained authorisation
RoleAuthorisation
DoesDecoupled authorisation decisions as a service.
Tieropen source, open core
Priceunder $500 / month
Hostingboth
EU datapartial
Takesfour to fifteen people, about 0.25 FTE to run
Maturitygrowing

OPA

Categoryfine-grained authorisation
RolePolicy engine
DoesPolicy-as-code for tool-call authorisation.
Tieropen source
Priceunder $500 / month
Hostingself
EU datayes
Takesfour to fifteen people, about 0.25 FTE to run
Maturityestablished

OpenBao — first choice

Categorysecrets
RoleSecrets
DoesLinux Foundation fork of Vault: dynamic credentials, encryption as a service.
Tieropen source
Priceunder $500 / month
Hostingself
EU datayes
Takesfour to fifteen people, about 0.5 FTE to run
Maturityestablished

AWS Secrets Manager

Categorysecrets
RoleSecrets in AWS
DoesSecrets with IAM policies and rotation.
Tiervendor, price list
Priceunder $500 / month
Hostingcloud
EU datayes
Takesnobody — hosted only, about 0.05 FTE to run
Maturityestablished
Native toaws

Azure Key Vault

Categorysecrets
RoleSecrets in Azure
DoesKeys and secrets with tenant identity; the default for anything in Azure.
Tiervendor, price list
Priceunder $500 / month
Hostingcloud
EU datayes
Takesnobody — hosted only, about 0.05 FTE to run
Maturityestablished
Native toazure

Infisical

Categorysecrets
RoleSecrets platform
DoesSecret management with a self-host path.
Tieropen source, open core
Priceunder $500 / month
Hostingboth
EU datapartial
Takesone to three people, about 0.25 FTE to run
Maturitygrowing

Secret Manager

Categorysecrets
RoleSecrets in GCP
DoesSecrets with IAM and rotation.
Tiervendor, price list
Priceunder $500 / month
Hostingcloud
EU datayes
Takesnobody — hosted only, about 0.05 FTE to run
Maturityestablished
Native togcp

Databricks secrets

Categorysecrets
RoleSecrets in Databricks
DoesSecret scopes backed by the cloud's key vault.
Tiervendor, price list
Pricefree
Hostingcloud
EU datayes
Takesnobody — hosted only, about 0.05 FTE to run
Maturityestablished
Native todatabricks

Doppler

Categorysecrets
RoleManaged secrets
DoesSecrets as a service with per-environment access; the hosted answer below a platform team.
Tiervendor, price list
Priceunder $500 / month
Hostingcloud
EU datapartial
Takesnobody — hosted only, about 0.05 FTE to run
Maturityestablished

HashiCorp Vault

Categorysecrets
RoleSecrets
DoesThe original, under BSL since 2023 and owned by IBM.
Tiervendor, sales call, open core
Price$3,000–10,000 / month
Hostingboth
EU datapartial
Takesfour to fifteen people, about 0.05 FTE to run
Maturityestablished

AWS IAM

Categorysecrets
RoleCloud IAM
DoesIdentity and access for AWS-first agent deployments.
Tiervendor, price list
Price$500–3,000 / month
Hostingcloud
EU datapartial
Takesnobody — hosted only, about 0.05 FTE to run
Maturityestablished
Native toaws

## 11 Filter (13)

Catches prompt injection on the way in and checks answers on the way out.

Stage 1 of 3 in the article’s order.

Azure AI Content Safety

Categoryinjection guard
RoleGuardrails in Azure
DoesPrompt Shields and content filters in front of Azure models.
Tiervendor, price list
Priceunder $500 / month
Hostingcloud
EU datayes
Takesnobody — hosted only, about 0.05 FTE to run
Maturityestablished
Native toazure

Bedrock Guardrails

Categoryinjection guard
RoleGuardrails in AWS
DoesContent, topic and injection filters on Bedrock calls.
Tiervendor, price list
Priceunder $500 / month
Hostingcloud
EU datayes
Takesnobody — hosted only, about 0.05 FTE to run
Maturityestablished
Native toaws

Lakera (Check Point)

Categoryinjection guard
RolePrompt injection filter
DoesJailbreak and injection detection API.
Tiervendor, sales call
Price$3,000–10,000 / month
Hostingcloud
EU datayes
Takesa platform team, about 0.05 FTE to run
Maturityestablished

Model Armor

Categoryinjection guard
RoleGuardrails in GCP
DoesPrompt and response screening for injection, data loss and harmful content.
Tiervendor, price list
Priceunder $500 / month
Hostingcloud
EU datayes
Takesnobody — hosted only, about 0.05 FTE to run
Maturitygrowing
Native togcp

NeMo Guardrails

Categoryinjection guard
RoleProgrammable rails
DoesSelf-host guardrails over dialog flows.
Tieropen source
Priceunder $500 / month
Hostingself
EU datayes
Takesone to three people, about 0.25 FTE to run
Maturityestablished

Cisco AI Defense

Categoryinjection guard
RoleAI firewall
DoesRuntime AI defence and model risk.
Tiervendor, sales call
Price$3,000–10,000 / month
Hostingcloud
EU datapartial
Takesa platform team, about 0.05 FTE to run
Maturitygrowing

Cortex Guard

Categoryinjection guard
RoleGuardrails in Snowflake
DoesSafety filtering on Cortex model calls.
Tiervendor, sales call
Priceunder $500 / month
Hostingcloud
EU datayes
Takesnobody — hosted only, about 0.05 FTE to run
Maturityestablished
Native tosnowflake

LLM Guard

Categoryinjection guard
RoleInput and output scanners
DoesOpen scanners from Protect AI for prompt injection, personal data and leaked secrets, on the way in and out; MIT.
Tieropen source
Priceunder $500 / month
Hostingself
EU datayes
Takesone to three people, about 0.25 FTE to run
Maturitygrowing

Palo Alto Prisma AIRS

Categoryinjection guard
RoleAI runtime security
DoesRuntime protection, agent security, model scanning, red teaming.
Tiervendor, sales call
Price$3,000–10,000 / month
Hostingcloud
EU datapartial
Takesa platform team, about 0.05 FTE to run
Maturityestablished

HiddenLayer

Categoryinjection guard
RoleModel security
DoesModel scanning and detection of adversarial use.
Tiervendor, sales call
Price$3,000–10,000 / month
Hostingcloud
EU datano
Takesa platform team, about 0.05 FTE to run
Maturitygrowing

Zenity

Categoryinjection guard
RoleAgent posture
DoesDiscovery and control for agents built across SaaS.
Tiervendor, sales call
Price$3,000–10,000 / month
Hostingcloud
EU datano
Takesa platform team, about 0.05 FTE to run
Maturitygrowing

Guardrails AI

Categoryoutput validation
RoleOutput validation
DoesValidators on model output, self-hostable. Hosted Hub retired; owned by Harvey since 2026.
Tieropen source, open core
Priceunder $500 / month
Hostingboth
EU datapartial
Takesnobody — hosted only, about 0.25 FTE to run
Maturityestablished

Llama Guard

Categoryoutput validation
RoleSafety classifier
DoesOpen-weight classifier for input and output screening. Llama community licence, not OSI.
Tieropen source
Priceunder $500 / month
Hostingself
EU datayes
Takesone to three people, about 0.25 FTE to run
Maturityestablished

## 12 Gateway (12)

One door for every model call: masks personal data before it leaves, keys and budgets, a fallback when a provider fails, a cache that respects rights, routing by price and quality, a log of every call.

Stage 1 of 3 in the article’s order.

Cloudflare AI Gateway

Categorycache
RoleEdge gateway
DoesCaching, rate limits and analytics at the edge.
Tiervendor, price list
Pricefree
Hostingcloud
EU datayes
Takesnobody — hosted only, about 0.05 FTE to run
Maturityestablished

Presidio

Categorypersonal data masking
RolePII detection and masking
DoesMicrosoft's open library that finds and masks personal data in text before it reaches a model or a trace; MIT.
Tieropen source
Priceunder $500 / month
Hostingself
EU datayes
Takesone to three people, about 0.1 FTE to run
Maturityestablished

AI Gateway guardrails

Categorypersonal data masking
RoleGuardrails in Databricks
DoesSafety filters and PII detection on gateway calls.
Tiervendor, price list
Priceunder $500 / month
Hostingcloud
EU datayes
Takesnobody — hosted only, about 0.05 FTE to run
Maturitygrowing
Native todatabricks

LiteLLM — first choice

Categorymodel proxy
RoleModel proxy
DoesOpenAI-compatible API to many models, with budgets and keys. Pin versions: two PyPI releases were compromised in March 2026.
Tieropen source, open core
Priceunder $500 / month
Hostingboth
EU datayes
Takesone to three people, about 0.25 FTE to run
Maturityestablished

AgentCore Gateway

Categorymodel proxy
RoleGateway in AWS
DoesTool and model gateway for Bedrock agents, with auth and MCP.
Tiervendor, price list
Price$500–3,000 / month
Hostingcloud
EU datayes
Takesnobody — hosted only, about 0.1 FTE to run
Maturitygrowing
Native toaws

Azure API Management AI gateway

Categorymodel proxy
RoleGateway in Azure
DoesToken limits, caching and routing for Azure OpenAI and other models behind APIM.
Tiervendor, price list
Price$500–3,000 / month
Hostingcloud
EU datayes
Takesnobody — hosted only, about 0.1 FTE to run
Maturityestablished
Native toazure

Mosaic AI Gateway

Categorymodel proxy
RoleGateway in Databricks
DoesRate limits, logging and guardrails on model endpoints.
Tiervendor, price list
Price$500–3,000 / month
Hostingcloud
EU datayes
Takesnobody — hosted only, about 0.1 FTE to run
Maturityestablished
Native todatabricks

Portkey

Categorymodel proxy
RoleAI gateway
DoesRouting, caching, guardrails and spend controls. Part of Palo Alto Networks since 2026.
Tieropen source, open core
Priceunder $500 / month
Hostingboth
EU datapartial
Takesnobody — hosted only, about 0.25 FTE to run
Maturityestablished

Apigee

Categorymodel proxy
RoleGateway in GCP
DoesAPI management with model routing and token policies.
Tiervendor, sales call
Price$3,000–10,000 / month
Hostingcloud
EU datayes
Takesnobody — hosted only, about 0.1 FTE to run
Maturityestablished
Native togcp

Kong AI Gateway

Categorymodel proxy
RoleAPI gateway
DoesLLM traffic on the API gateway you may already run. Free only if built from source since 3.10.
Tiervendor, sales call, open core
Price$3,000–10,000 / month
Hostingboth
EU datapartial
Takesfour to fifteen people, about 0.05 FTE to run
Maturityestablished

OpenRouter

Categoryrouter
RoleModel router
DoesOne key and one bill across many providers. Being acquired by Stripe.
Tiervendor, price list
Priceunder $500 / month
Hostingcloud
EU datapartial
Takesnobody — hosted only, about 0.05 FTE to run
Maturityestablished

RouteLLM

Categoryrouter
RoleCost-based routing
DoesLMSYS framework that sends easy requests to a cheap model and hard ones to a strong one; research-grade, Apache-2.0.
Tieropen source
Priceunder $500 / month
Hostingself
EU datayes
Takesone to three people, about 0.25 FTE to run
Maturityexperimental

## 13 Traces (7)

Records every step the system took.

Stage 1 of 3 in the article’s order.

Langfuse — first choice

Categorytracing
RoleTraces and prompts
DoesSelf-host traces, evals, prompt management and datasets. Owned by ClickHouse since 2026.
Tieropen source, open core
Priceunder $500 / month
Hostingboth
EU datayes
Takesone to three people, about 0.25 FTE to run
Maturityestablished

Arize Phoenix

Categorytracing
RoleOpen tracing
DoesSelf-host tracing and evaluation for LLM apps. Elastic License 2.0, not OSI.
Tieropen source, open core
Priceunder $500 / month
Hostingboth
EU datapartial
Takesnobody — hosted only, about 0.25 FTE to run
Maturityestablished

LangSmith

Categorytracing
RoleHosted tracing
DoesTracing, datasets and evals for LangChain stacks.
Tiervendor, price list
Price$500–3,000 / month
Hostingboth
EU datayes
Takesnobody — hosted only, about 0.05 FTE to run
Maturityestablished

MLflow

Categorytracing
RoleML lifecycle
DoesExperiment tracking and model registry.
Tieropen source
Priceunder $500 / month
Hostingboth
EU datapartial
Takesnobody — hosted only, about 0.25 FTE to run
Maturityestablished
Native todatabricks

Opik

Categorytracing
RoleTraces and evals
DoesOpen-source tracing and evaluation from Comet.
Tieropen source, open core
Priceunder $500 / month
Hostingboth
EU datapartial
Takesnobody — hosted only, about 0.25 FTE to run
Maturitygrowing

W&B Weave

Categorytracing
RoleExperiment tracking
DoesTracing and evaluation inside Weights & Biases, now part of CoreWeave.
Tiervendor, price list
Price$500–3,000 / month
Hostingcloud
EU datapartial
Takesnobody — hosted only, about 0.05 FTE to run
Maturityestablished

CloudWatch

Categorytracing
RoleAWS observability
DoesMetrics and logs for agent operations on AWS.
Tiervendor, price list
Price$500–3,000 / month
Hostingcloud
EU datapartial
Takesnobody — hosted only, about 0.05 FTE to run
Maturityestablished
Native toaws

## 14 Evals (9)

Tests every change against a set of reference questions.

Stage 1 of 3 in the article’s order.

Promptfoo

CategoryCI evals
RoleCI evals
DoesRegression evals and red-teaming in CI. Owned by OpenAI since 2026.
Tieropen source, open core
Pricefree
Hostingself
EU datayes
Takesone to three people, about 0.1 FTE to run
Maturityestablished

DeepEval

CategoryCI evals
RoleTest-style evals
DoesEvals written as unit tests.
Tieropen source, open core
Priceunder $500 / month
Hostingboth
EU datapartial
Takesnobody — hosted only, about 0.25 FTE to run
Maturitygrowing

Bedrock Evaluations and CloudWatch

Categoryeval platform
RoleEvals in AWS
DoesModel and RAG evaluation jobs; traces and metrics in CloudWatch.
Tiervendor, price list
Priceunder $500 / month
Hostingcloud
EU datayes
Takesnobody — hosted only, about 0.1 FTE to run
Maturitygrowing
Native toaws

Foundry evaluations and observability

Categoryeval platform
RoleEvals in Azure
DoesBuilt-in evaluators, tracing and monitoring for agents in Foundry.
Tiervendor, price list
Priceunder $500 / month
Hostingcloud
EU datayes
Takesnobody — hosted only, about 0.1 FTE to run
Maturitygrowing
Native toazure

MLflow agent evaluation

Categoryeval platform
RoleEvals in Databricks
DoesTracing and evaluation for agents, in MLflow on the lakehouse.
Tiervendor, price list
Priceunder $500 / month
Hostingcloud
EU datayes
Takesnobody — hosted only, about 0.1 FTE to run
Maturityestablished
Native todatabricks

Vertex AI Evaluation

Categoryeval platform
RoleEvals in GCP
DoesEvaluation service and tracing for Vertex agents.
Tiervendor, price list
Priceunder $500 / month
Hostingcloud
EU datayes
Takesnobody — hosted only, about 0.1 FTE to run
Maturitygrowing
Native togcp

Braintrust

Categoryeval platform
RoleEval platform
DoesEval workflows, datasets and scoring for teams.
Tiervendor, price list
Price$500–3,000 / month
Hostingcloud
EU datano
Takesa platform team, about 0.05 FTE to run
Maturityestablished

Cortex AI Observability

Categoryeval platform
RoleEvals in Snowflake
DoesTraces and evaluations for Cortex agents.
Tiervendor, sales call
Priceunder $500 / month
Hostingcloud
EU datayes
Takesnobody — hosted only, about 0.1 FTE to run
Maturitygrowing
Native tosnowflake

Ragas

CategoryRAG evals
RoleRAG evals
DoesFaithfulness and recall metrics for retrieval pipelines.
Tieropen source
Pricefree
Hostingself
EU datayes
Takesone to three people, about 0.1 FTE to run
Maturityestablished

## 15 Feedback (1)

Turns bad answers from real users into tests and fixes.

Stage 3 of 3 in the article’s order.

Argilla

Categorylabelling
RoleFeedback and labelling
DoesOpen tool where people review and label the assistant's answers; the bad ones become the next test set. Part of Hugging Face; Apache-2.0.
Tieropen source
Priceunder $500 / month
Hostingself
EU datayes
Takesone to three people, about 0.5 FTE to run
Maturityestablished