Back to the episode map

Article

AI Integration Requires Structural Workflows

Durable AI integration connects an owned task to authoritative data, identity, state, rules, review, action boundaries, evidence, recovery, and change.

Aug 4, 20267 min readBy Dalton Anderson

AI Integration Requires Structural Workflows

Durable AI integration is not a chat window beside existing work. It connects an owned task to authoritative data, identity, durable state, business rules, qualified review, bounded action authority, evidence, monitoring, failure recovery, and change ownership.

A thin interface may be exactly right for exploration or a disposable low-risk task. The mistake is calling it integration while people quietly perform every important control around it.

flowchart LR
    A["Owned task"] --> B["Authorized data"]
    B --> C["Identity, access, and state"]
    C --> D["Rules and model operation"]
    D --> E["Qualified review"]
    E --> F["Bounded action"]
    F --> G["Evidence and monitoring"]
    G --> H["Failure recovery and change"]
    H --> A

The isolated assistant hides the workflow

An employee can copy information into a model, receive a plausible answer, check it, paste it into another system, and correct the record when something goes wrong.

The demonstration looks simple because the person is supplying the integration. They retrieve data, choose what is current, preserve context, apply policy, notice uncertainty, protect access, make the decision, document the result, and recover from failure.

That can still be useful. It can reveal a task worth improving. It does not show that the organization has built a durable system.

Integration starts with an owned task

The unit of design is a specific task or decision, not "AI for operations."

The team must know who owns the work, what triggers it, what completion means, which service promise it supports, and what happens before and after the model operation.

This is why E004's business-constraint thesis matters. The same model capability can enter different companies through different tasks. An incumbent may improve an existing process with regulatory and system dependencies. A new entrant may design a narrower workflow around the capability from the start.

Authoritative data must remain visible

A workflow needs more than access to documents. It needs a rule for which source is authoritative, permitted, current, and relevant.

If customer status exists in several systems, the integration must resolve meaning and precedence. If a policy or knowledge article changes, the workflow must know when the earlier version stops controlling.

Long context does not solve this problem. A system can accept more material and still use the wrong record, miss the controlling evidence, or receive information the task is not allowed to process. Research such as Lost in the Middle also shows that model performance can vary with where relevant information appears in long input.

Capacity is an input boundary. Authority is a workflow decision.

Identity and access carry through the operation

The system must know who is acting, for whom, and with which permission.

An employee who may view a record may not have authority to export it to a third-party service. A model that may draft a recommendation may not have authority to approve or execute it. A service account with broad access can turn a narrow feature into a large security boundary.

Identity, access, consent, purpose, tenant boundaries, retention, and audit requirements should not disappear when a model enters the workflow.

Durable state belongs outside the conversation

Important work has status, ownership, history, deadlines, approvals, dependencies, and recovery.

A conversation can help a user perform the task. It should not become the only record of what happened. Durable state should live in a system designed to preserve it, with explicit transitions and access controls.

This separation also makes model changes safer. The organization can replace or update one operation without losing the workflow record.

Rules and models should do different work

Not every step benefits from probabilistic generation. Deterministic rules may be better for permissions, calculations, required fields, thresholds, format validation, routing, and commitments.

A model can help extract, classify, retrieve, compare, summarize, or draft within a bounded step. The surrounding system can validate structure, require evidence, apply fixed rules, and prevent unauthorized action.

The goal is not to maximize model use. It is to design reliable work.

Review must expose evidence and disagreement

A reviewer needs the input, relevant source, model output, uncertainty or conflict signals, applicable rule, and proposed action.

Review fails when the interface hides evidence or makes approval easier than inspection. It also fails when the task volume exceeds the review capacity or the reviewer lacks the expertise and authority to intervene.

The NIST Generative AI Profile frames generative AI risk management across the lifecycle. That is a useful corrective to controls that exist only at launch.

The reviewer is part of the operating design, not a label placed on the end.

Action authority should be explicit

Recommendation, drafting, staging, sending, approving, paying, denying, binding, pricing, publishing, and writing to a source system are different actions.

State which one the system may perform. Keep consequential or irreversible action below the level justified by testing, governance, and applicable authority.

An organization can automate preparation while retaining human commitment. It can later expand authority if evidence, controls, law, reviewer capacity, and recovery support the change.

Evidence turns use into an accountable system

Preserve the input or a lawful reference to it, source versions, instruction, product and model context, output, validation, reviewer decision, action, correction, timestamps, and owner.

The record should support investigation without collecting information indefinitely or beyond permitted purpose. Retention and access require their own design.

For insurers, the NAIC Model Bulletin describes regulator expectations for governance, risk management, controls, and documentation when AI systems support consumer-impacting decisions. The bulletin is a model, and applicable state adoption and law must be checked.

Failure and recovery are first-class paths

The workflow needs a response to uncertainty, conflicting evidence, malformed input, unavailable services, permission failure, harmful output, reviewer disagreement, model change, misuse, and an incorrect action.

State whether the system should stop, return to a manual process, request more information, escalate, retry, or roll back. Preserve enough evidence to understand the event.

Recovery is what distinguishes an operational workflow from a successful demo.

Measurement must include the surrounding work

Model accuracy or output preference is only part of the result.

Measure completion quality, unsupported claims, reviewer agreement, correction, review time, escalation, recovery, accessibility, latency, cost, and user experience. Include data preparation, integration, logging, vendor management, training, incident response, and organizational change.

The NIST AI Risk Management Framework connects governance, context, measurement, and management. That structure matters because a metric without an owner or response threshold does not control the workflow.

Change ownership keeps the system real

Models, product terms, source data, policies, users, threats, and regulations change.

Someone must own monitoring, evaluation, incident review, access review, updates, documentation, retraining or configuration decisions, and retirement. A workflow that nobody can safely change is not durable.

This is also an economic question. The integration must remain worth its operating, review, compliance, and recovery cost after the novelty disappears.

A structural test for AI integration

Trace one task from trigger to final action. Ask where authoritative data comes from, whose identity controls access, where state persists, which rules are deterministic, what the model does, what the reviewer sees, which action is allowed, what evidence remains, how failure recovers, what is measured, and who owns change.

If the answer repeatedly depends on a careful employee remembering what to do, the organization has learned something useful. It has found the missing workflow.

[[Start AI Adoption With Bounded Tasks and Review]] explains how to test that workflow without beginning with broad deployment. [[AI Strategy Follows Business Constraints]] explains why the structure will differ by company. For the historical episode context, read [[What Gemini 1.5 and Sora Revealed About AI Adoption]].

Editorial and authority note

This essay is educational and does not prescribe one architecture. It is not legal, regulatory, security, privacy, insurance, employment, procurement, accessibility, or investment advice. Requirements depend on the organization, product, data, workflow, jurisdiction, and consequence. Architecture, security, privacy, legal, governance, insurance, editorial, accessibility, and founder review remain required before publication or operational use.

AI assisted with research, structure, drafting, and validation. Dalton Anderson remains the attributed author and final editorial authority.

Sources

Follow the evidence.

  1. Holland and Kavuri, HICSS-56aisel.aisnet.org
  2. Google: Our next-generation model, Gemini 1.5blog.google
  3. Liu et al.: Lost in the Middleaclanthology.org
  4. OpenAI: Video generation models as world simulatorsopenai.com
  5. Google AI for Developers: Long contextai.google.dev
  6. NAIC: Artificial Intelligencecontent.naic.org
  7. Spotify episode recordpodcasters.spotify.com
  8. OpenAI: Sora is hereopenai.com
  9. NAIC: Model Bulletin on the Use of Artificial Intelligence Systems by Insurerscontent.naic.org
  10. NIST: Artificial Intelligence Risk Management Framework, Generative Artificial Intelligence Profilenist.gov
AI Integration Requires Structural Workflows