brianletort.ai
All Posts
Enterprise AIAgent NativePractitioner-BuilderEvaluationOperating Model

The Rise of the Domain Practitioner-Builder

The forward-deployed engineer is not a phase every domain passes through — it is a fork. Which side your domain walks down is decided by whether it owns its evals fast enough to outrun acquisition. The capstone of the four-part series on designing work for agents.

agent native work / Part 04July 9, 202618 min read
A branching path diverging into two forks under a bridge labeled FDE; on one side a domain native at a workbench authoring evals, on the other a governed packaged vertical delivered by a services team.

TL;DR

  • The forward-deployed engineer is a bridge, not a destination — every domain walks one of two forks from that bridge: build its own practitioner-builder band, or accept a governed vendor package
  • The tipping variable is eval ownership: Bridgewater's tuned Qwen3-235B beat frontier by 6.5 points at 13.8x lower cost on internal finance evals (vendor-reported, 2026-07-04) because the eval suite came first — the model followed
  • The new scarce role is the person who can write the domain's unit tests — a domain native who owns process decomposition, context assembly, verification design, and human-judgment placement
  • Both forks require a fluent band inside the domain: the build-fork uses them as configurators, the buy-fork uses them as owners of acceptance criteria — if nobody in your function can author the acceptance spec, you are not buying an agent, you are subscribing to the vendor's definition of correct
  • Find, title, and equip the fluent band you already employ — before a recruiter, a services firm, or a packaged vertical does it for you

A field call, last month. A CFO at a mid-cap financial services firm had just sat through a vendor demo — a governed multi-agent workflow for expense-anomaly triage, priced per resolved case, wrapped in an SI's deployment shell. She turned to her director of finance transformation and asked one question. He couldn't answer it. Neither could the vendor. Neither could the SI.

"We can buy the agent. But who tells us it's right?"

That is the executive question of the next twenty-four months. Not build or buy. Not model choice. Not platform. Who owns the acceptance criteria.

The series, in one paragraph

If you have been reading this series, the shape is now visible. In Part 1 I argued that software got agents first because software has a compiler — one law, three multipliers, and machine-checkable ground truth is the law. In Part 2 I argued that every domain needs an AGENTS.md — not a document, an interface stack: MCP server, policy pack, skill catalog, audit stream, with a README on top. In Part 3 I argued that verification is not merely the reliability blocker; it is the pricing lever. Margin follows verification.

The series has been circling one operational question. Who does the work of making a domain agent-ready? Who authors the evals, wires the tool contracts, decides where human judgment goes, and holds the receipt when the agent is wrong?

Every enterprise will answer this in one of two ways. This is the capstone. This is the fork.

The fork

Fork A: your domain natives build.

Fork B: you rent forward-deployed engineers today, then buy packaged verticals tomorrow.

Both are legitimate. Neither is universal. And the variable that decides which fork your organization walks down is exactly the variable Part 3 identified: whether your domain owns its evals fast enough to outrun acquisition.

The Practitioner-Builder Fork

The bridge phase splits into two durable paths: BUILD and BUY. Click any node for dated evidence.

Tipping variable: Does the domain own its evals?

Domains that own evaluation suites can sustain the BUILD fork. Domains that do not usually rent the BUY fork.

Availability risk pressures regulated domains toward BUY unless open-weight hedges exist.

Recent shocks include GPT-5.6 gov-gate (2026-06-26) and a reported 19-day Fable 5 outage, both highlighting concentration risk.

Forward-Deployed Engineers (the bridge)

2026-06-11/12

Anthropic + TCS/DXC patterns scaled to ~50,000 seats.

FDE capacity connected model capability to enterprise process design before domains fully owned internal builder capability.

Forward-deployed engineers are the bridge; practitioner-builders and eval ownership determine the destination.

Trace the timeline above. In the middle, the transitional form: the forward-deployed engineer. Anthropic + TCS, ~50,000 seats across banking, insurance, airlines (2026-06-11). Anthropic + DXC (2026-06-12). The frontier lab supplies model and skills; the SI supplies the vertical wrapper and the humans who translate the lab's tooling into the domain's language. That is the bridge. Bridges are useful. Forward-deployed engineers are a bridge. You don't want to live on bridges.

Two paths diverge from that bridge. On one side, domains that build their own eval suites, tune their own models, and grow their own practitioner-builder bands. On the other, domains that consume a packaged vertical — a workbench, a service, a bundle — and rent the definition of "right" from the vendor.

Watch which markers appear on each path and the mechanism is obvious. Build-fork markers: Bridgewater fine-tuning Qwen3-235B, reported 84.7% on internal finance-task evals vs 78.2% best frontier at 13.8x lower cost (vendor-reported, 2026-07-04). Wordsmith serving 500+ in-house legal teams, revenue up 14x YoY (2026-06-03). Cisco rolling agents to all 90,000 employees including finance (2026-07-01). Claude Science — the workbench playbook applied to a second practitioner-builder population, $30K credit grants, Novo Nordisk and the Allen Institute named (2026-06-30). Buy-fork markers: Salesforce's Fin acquisition ($3.6B), TCS/DXC forward-deployed bundles across ~50,000 seats, Convey $38M for no-code back-office "AI teammates" with white-glove deployment (2026-06-17). LTM's BlueVerse Currency (2026-06-10) — even the services layer is repricing itself for the fork.

The tipping variable is not size, not sector, not "digital maturity." It is whether the domain can construct a machine-checkable definition of a correct answer, and how fast. Software could. Bridgewater's finance research org just did. Legal is trying (Harvey Bench, HAQQ). Sales and HR are not trying yet.

Everything else — hiring, tooling, roadmap, vendor selection, negotiating position — is downstream of that.

The named framework: the fork and the tipping variable

Call it the fork. Say it out loud. Every enterprise agent conversation for the next two years is going to be some version of "which fork are we walking down for this domain, and why."

The tipping variable is eval ownership. Own your evals fast enough and Fork A is viable — you can hire, tune, and configure inside the domain. Fall behind and Fork B is the only remaining path — you accept a governed vendor package and your evals become table stakes negotiated in the contract.

There is a corollary I want to state plainly. If you don't own the evals, you don't own the agent. You may operate the agent. You may deploy it. You may pay for its output. But the definition of "right" — the thing that decides which outputs count and which don't — lives on someone else's roadmap.

Who does the work — and what do we call her

Inside every domain that walks Fork A, one role does most of the heavy lifting. It doesn't have a settled name yet.

I have heard six candidates in the last quarter: AI Workflow Architect. AI Engineer for [Domain]. Automation Engineer. Practitioner-Builder. Fluent Practitioner. AI Domain Owner. Every one of them is imperfect.

"AI Workflow Architect" is the most common and, in my read, the worst. It implies a visitor who parachutes in, designs a workflow, and departs. The whole point of the role is that it lives inside the domain, not adjacent to it. A financial controller who can author reconciliation eval suites in the morning and negotiate a policy pack with compliance in the afternoon is not a visiting architect. She is a domain native who has taken a second craft.

I default to "practitioner-builder" for lack of a better term. It captures both halves — practitioner (she is a lawyer, a controller, a scientist, a supply-chain planner first) and builder (she authors the workflow, the tests, the tool contracts). But I hold the name loosely. The unsettled name is itself evidence the role is new. Software went through this in the 2000s — "webmaster" gave way to "web developer" gave way to "front-end engineer" — and each renaming reflected the craft crystallizing. Legal, finance, scientific, and operational domains are in the first naming phase now.

What the role actually does, though, is not fuzzy. Four responsibilities:

  • Process decomposition. Break the domain's workflow into steps a machine can attempt and a human can verify. This is the FIXR pattern — Morgan Stanley cut per-book reconciliation time from 6 hours to 2–3 hours across roughly 100 controllers by making agents less autonomous, not more (secondary reporting, 2026-07-01). Decomposition is the craft.
  • Context assembly. Package the domain's tribal knowledge, precedents, and policies into agent-legible artifacts. This is the AGENTS.md interface stack from Part 2 — MCP tool catalogs, skill definitions, machine-readable policies, audit streams. Wordsmith's product is essentially the config surface for this in legal (2026-06-03).
  • Verification design. Author the domain's unit tests. This is the domain CI from Part 3. Bridgewater's tuned-Qwen story is not principally a model story; it is an eval story. The internal finance eval suite is the asset that made fine-tuning decidable (vendor-reported, 2026-07-04).
  • Human-judgment placement. Decide where the human belongs — pre-decision, in-decision, post-decision, or on-appeal — and instrument the handoff. The autonomy paradox from Part 3 shows up here in the flesh. Verification-bounded autonomy is a design decision. It doesn't happen by accident.

The new scarce role is the person who can write the domain's unit tests.

That is a hiring statement, a training statement, and a career statement. In every regulated domain, over the next thirty-six months, the people who can do this will be scarce, expensive, and — if you already employ them — undervalued.

Two adjacent frames that have been standing in this space, and that I still endorse: Superworkers, Not Replacements is the augmentation frame — AI amplifies the domain native rather than substituting for her. The Three Postures — Chat, Build, Automate — is the interaction-topology frame. The practitioner-builder is what the Build and Automate postures look like when the person doing them is not from IT.

Build-fork, in the field

Fork A is visible today, in specific places, at specific scales.

Bridgewater is the clearest case. A hedge fund — not a tech vendor — tuned Qwen3-235B with Thinking Machines and reported 84.7% on internal finance-task evals against 78.2% for the best frontier model, at 13.8x lower cost per task (vendor-reported, 2026-07-04). Take the numbers as the vendor-reported claims they are. What matters is the shape: a domain firm built its own eval suite first, then made a fine-tune decidable, then owned the resulting artifact. That is the end state of Fork A.

Wordsmith is the mid-shape. $70M Series B (2026-06-03), 500+ in-house legal teams operating named "AI workers" that route, resolve, draft, and approve routine legal requests. Revenue reported up 14x in twelve months. In-house lawyers do not write Python. But they do configure playbooks — trigger conditions, escalation rules, precedent bundles, sign-off gates. That is domain-native building, dropped below the code barrier. Grok's Voice Agent Builder (2026-07-01), pitching no-code speech-to-speech agents in "under two minutes" (vendor-reported), is the same directional bet: builder surfaces are moving to where the domain natives already are.

Claude Science is the frontier-lab bet on the same pattern. Anthropic didn't ship a new model on 2026-06-30; it shipped a workbench. Scientists get tools, auditable artifacts, compute, and $30K in credits. Novo Nordisk and the Allen Institute are named. TechCrunch called it, correctly, the Claude Code playbook applied to a second practitioner-builder population — with law and finance the obvious next verticals. Frontier labs are not neutral about this fork. They are actively scaffolding the build side.

Cisco's disclosure that its CFO is rolling agents to all 90,000 employees including finance (2026-07-01) is upstream of building. Practitioner access precedes practitioner building.

Buy-fork, in the field

Fork B is at least as well-funded, and in many domains it will be the majority path.

Salesforce closed its Fin acquisition for $3.6B to bundle a vertical financial-services agent into the same procurement motion as CRM. Anthropic + TCS and Anthropic + DXC (2026-06-11/12) are not tooling deals — they are distribution deals: forward-deployed engineers embedded into banking, insurance, airlines, ~50,000 seats. Convey pulled $38M (2026-06-17) to sell no-code "AI teammates" with white-glove deployment; the pitch is that even the "no-code" surface is too much surface, and the service should absorb it.

LTM's BlueVerse Currency (2026-06-10) is the tell that even the GSI layer is preparing for the fork's next act. If services are repriced to outcomes, the FDE is being priced as if he were replaceable — and in most low-alpha lanes, eventually he will be.

Fork B is not a failure state. In some domains it is the correct answer. The alpha/commodity split cuts cleanly: commodity back-office work → buy; alpha workflows (trading, legal strategy, R&D, clinical) → build. A regional bank does not need a fluent practitioner-builder band inside compliance to run KYC agents. A tier-one investment bank probably does need one inside its structured products team. The fork is workflow-specific, not firm-specific.

Regulated and gated domains have another reason to prefer the buy side: availability risk. GPT-5.6 previewed only to about twenty government-approved organizations (2026-06-26). Fable 5 was pulled out of some geographies for 19 days on export-control restrictions and restored 2026-07-01. Single-vendor dependence is a new class of operational risk that software never priced in. The build-fork inherits this too — Bridgewater's tune on Qwen is not accidentally on an open-weights base — but the buy-fork can outsource the resilience question entirely, at the cost of also outsourcing the acceptance criteria.

Steelman: practitioner-builders scale poorly

The hardest counterargument: "You have described a role that requires domain mastery, engineering literacy, and product intuition. Those people are already scarce for every executive function you can name. Enterprises will not scale hiring for a triple-threat role. Governed vendor platforms will win by default, and Salesforce plus Microsoft will out-distribute every attempt at in-house building. Fork A is a niche."

That argument is strong. It is right about half of it.

Where it is right: not every analyst becomes a builder. Never was the claim. Inside every domain, a small band emerges. Call it the fluent band — the developer-equivalent inside the domain. In software the fluent band is essentially the whole workforce, because the domain is coding. In legal it is single digits today. In finance research it is larger, and largest inside the alpha functions of tier-one shops. In HR it may stay a rounding error. Nobody has measured any of this yet — which is itself a Part 3 problem.

Where the counterargument fails: even Fork B requires the fluent band. You cannot be a competent buyer of a governed vertical agent without owning the acceptance criteria. Somebody in your organization has to say "these outputs count as correct, these do not, here is the audit spec, here is the escalation policy, here is the boundary of autonomy." If nobody in your finance team can author that spec, you are not buying an agent — you are subscribing to the vendor's definition of correct finance. That is a governance failure, not a procurement outcome.

Both forks require the fluent band. Fork A hires and grows the band as configurators and builders. Fork B hires and grows the band as owners of acceptance criteria. Practitioner-builders scale only where they have a compiler to argue with — which is why software got there first. But the definition of "compiler" is generalizing. Bridgewater's eval suite is a compiler. Wordsmith's playbook validator is a compiler. Morgan Stanley's reconciliation-to-source check is a compiler. The scarcity constraint is real; the ceiling is domain-specific, not universal.

The steelman also underestimates how quickly builder surfaces are commoditizing below the code line. No-code has been failing for twenty years because the eval layer was missing. Grok's voice builder and Wordsmith's config surface are early moves, and my expectation is that whatever GPT-Rosalind and Gemini for Science ship over the next twelve months as their equivalents of the Claude Code workbench will ship with eval scaffolding built in — the pressure points that way. If that holds, the scaling curve changes. The field-report version of the same ladder generalized past software is I Stopped Using ChatGPT.

Predictions on the record

Three dated claims, measurable, tied to the evidence above.

  • By 2027-Q3, a frontier lab ships a third practitioner-builder workbench after Claude Code and Claude Science — most likely legal or finance. Criterion: a first-party product page from Anthropic, OpenAI, or Google labeling a vertical workbench (not a chat product) for a named non-engineering, non-scientific domain, with tools, auditable artifacts, and credit grants comparable to the Claude Science structure. Evidence base: Claude Science (2026-06-30) is explicitly positioned as the second workbench after Claude Code, and lab economics favor scaffolding the build-fork inside high-margin verticals.
  • By 2027-06-30, at least one major regulated enterprise publicly titles a role equivalent to "domain AI engineer" — practitioner-builder — tied to owning an evaluation suite. Criterion: a job posting, press release, or executive talk from an F500 regulated firm (banking, insurance, life sciences, energy, telecom) that names a role, situates it inside the domain function (not IT or data), and explicitly assigns ownership of an eval suite or "domain CI." Evidence base: Bridgewater's tuned-Qwen shape (2026-07-04, vendor-reported) and Wordsmith's 500+ team footprint (2026-06-03) are precursors; the naming lag is what makes this a real prediction rather than an assertion of the present.
  • By 2027-03-31, at least one major no-code agent builder ships first-class test cases, replay, and pass/fail gating. Criterion: a GA feature announcement from a top-five no-code or low-code agent-builder product that names evaluations as a first-class object, with authoring UI, replay against saved cases, and gating on merge or deploy. Evidence base: Grok Voice Agent Builder (2026-07-01, vendor-reported) and Wordsmith config surfaces show builder tooling moving below the code line; LangChain Harbor (2026-07-02) generalizes eval infra beyond benchmarks. The two vectors converge inside the year.

Vendor-reported claims above are flagged as vendor-reported. Grade 2–3 secondary evidence (FIXR write-ups, Bridgewater press) is used with hedged language. Predictions are the author's, not vendor-endorsed.

What to do on Monday

The capstone's action list is not about tools. It is about people. Specifically: finding, growing, and paying the fluent band inside your organization before your competitors do.

Three moves, in order.

  1. Find the fluent band you already employ. Every enterprise has a handful of them per domain, and almost every enterprise misidentifies them. They are not the people who "know AI." They are the domain natives who already automate their own work — the controller with the spreadsheet macros nobody documented, the paralegal who wrote the intake form logic, the ops lead running the Zapier shim behind the SLA report. Run a two-week discovery: ask each business function's leader for the three people whose informal automation the team would miss if they left. That list is your seed population.
  2. Give them the two artifacts, not more seat licenses. The two artifacts are (a) a versioned repo scoped to their domain — even if it starts as an internal git with a README, a policy pack, and a skill catalog — and (b) an eval suite scaffold, however small. Not a Copilot license. Not another agent-tool subscription. The scarce resource is not model access; it is a governed surface on which the fluent band can author, version, and grade domain-specific work. Model access is the token economy line item. Repos and evals are the operating-model investment. If you want the pricing spine underneath, Results as a Service is where the outcome-based pattern was first named.
  3. Title the role, publicly, before your peers do. Naming is a hiring lever and a retention lever. If your finance function's most fluent controller has no title that reflects her second craft, she is one recruiter call from becoming someone else's practitioner-builder. Pick a title — I will defend "practitioner-builder," but any of the candidates in this post will do — and elevate it inside the function, not inside IT. The signal to the market and to your own workforce is the point.

Do those three things and Fork A stays open to you domain by domain. Skip them and the fork closes silently — the vendors and the SIs pick it up, and your negotiating position collapses from "here are our acceptance criteria" to "please send us yours."

The series, in one page

Four posts. One argument.

Software got agents first because it could grade itself. Every domain now needs the same thing — an AGENTS.md interface stack that makes intent, policy, context, and telemetry legible to machines. Verification is the pricing lever; where a domain can verify cheaply, it can price outcomes, tune smaller open models, and compress vendor markup. And the fork every domain now walks — build its own practitioner-builder band, or rent them from a lab, an SI, or a packaged vertical — is decided by whether the domain owns its evals fast enough to keep the option open.

Ground truth is the master variable. Margin follows verification. The fork is real, and it is being taken this year.

If you want the systems-level view of why any of this behaves differently in Chat, Agent, Deep Research, or Cowork mode, start at the earlier series: Modes of the LLM OS. The four operating modes are the substrate the practitioner-builder is designing against.

The domain practitioner-builder is not a forecast. She is already at the desk in software. She is showing up in legal, science, and pockets of finance. She is not showing up in HR or supply chain yet, and I read that as a call — not a verdict.

Find her. Title her. Give her a compiler to argue with.

Operate. Publish. Teach.

Designing Work for Agents, Not Humans

Part 4 of 4