Back to the episode map

Research Note

Bounded AI Task and Review Control Record

The first adoption unit should be a bounded task rather than a broad instruction to use AI.

Aug 4, 20262 min readBy Dalton Anderson

Bounded AI Task and Review Control Record

Adoption unit

The first adoption unit should be a bounded task rather than a broad instruction to use AI.

Define the input, permitted data, expected output, excluded actions, reviewer, review method, accuracy or task measure, failure signals, escalation, retention, security, accessibility, rollback, duration, and owner.

The task should be reversible and should not give the system more authority than the evidence supports.

Review design

Human review must be operational. State what the reviewer checks, which source record is authoritative, how much time is available, what disagreement means, and who owns the final action.

A human name attached to an approval field does not create meaningful oversight when the evidence is hidden, the volume is unmanageable, or the reviewer lacks authority and expertise.

Evidence boundary

NIST's Generative AI Profile is a cross-sectoral companion to the AI Risk Management Framework for incorporating trustworthiness considerations into design, development, use, and evaluation.

NAIC's Model Bulletin reminds insurers that consumer-impacting decisions supported by AI remain subject to applicable law and sets expectations for a written AI-systems program, governance, risk management, and examination documentation.

The bulletin is not itself a model law or regulation. State adoption and applicable law must be checked for the organization and use case.

Expansion rule

Expand only when observed evidence supports the task, data, controls, reviewer load, failure handling, and next level of authority. A polished output or successful demonstration is not sufficient.

Sources

Follow the evidence.

  1. Holland and Kavuri, HICSS-56aisel.aisnet.org
  2. Google: Our next-generation model, Gemini 1.5blog.google
  3. Liu et al.: Lost in the Middleaclanthology.org
  4. OpenAI: Video generation models as world simulatorsopenai.com
  5. Google AI for Developers: Long contextai.google.dev
  6. NAIC: Artificial Intelligencecontent.naic.org
  7. Spotify episode recordpodcasters.spotify.com
  8. OpenAI: Sora is hereopenai.com
  9. NAIC: Model Bulletin on the Use of Artificial Intelligence Systems by Insurerscontent.naic.org
  10. NIST: Artificial Intelligence Risk Management Framework, Generative Artificial Intelligence Profilenist.gov
Bounded AI Task and Review Control Record