Back to the episode map

Guide

How to Manage an AI Coworker Without Losing Control

Manage AI agents with a durable four-part job description: explicit outcomes, bounded context, limited authority, and observable verification.

Aug 4, 202611 min readBy Dalton Anderson

How to Manage an AI Coworker Without Losing Control

An AI coworker is useful only when it owns a defined responsibility without quietly inheriting unlimited discretion. The practical management model has four parts: an explicit outcome, bounded context, limited authority, and observable verification. If one part is missing, the agent may still produce work, but the person responsible for it cannot reliably tell whether the job was done.

The short answer

Managing an AI agent is closer to designing an operating role than writing a clever prompt. Define the result the agent is responsible for, the information it may use, the actions it may take without approval, and the evidence that will prove success. Start with reversible work, review exceptions, and expand access only after the system has shown that its failures are visible. A persistent agent should never receive broader authority merely because it appears competent in a chat.

What an AI coworker actually means

The phrase "AI coworker" is often used as a metaphor for a more conversational interface. That definition is too weak to be useful.

A chat assistant answers a request. An AI coworker holds some continuity of responsibility. It may watch for a trigger, return to a task on a schedule, remember a reusable process, draw from connected sources, and take supported actions without requiring the person to restate every step.

Gemini Spark is one current example. Google describes Spark as a personal agent that can manage complex workflows and ongoing schedules inside Gemini. Its tasks define work, schedules trigger it, and skills preserve repeatable instructions. Depending on the account and configuration, the agent can use connected apps, signed-in websites, Personal Intelligence, a remote browser, and a remote computer. Google's current Spark documentation makes the persistence and context explicit.

The product will change. The management problem will not. Continuity gives an agent leverage because it can keep work moving when the operator is elsewhere. The same continuity gives mistakes time to compound.

Access is not a job description

Connecting email, files, calendars, browsers, and business systems can make an agent appear instantly capable. The agent can find context a person forgot to mention, recover a buried thread, or complete a chain of work that once required several apps.

Access does not tell the agent what a good result looks like.

In E120, Dalton asked Gemini Spark to help manage Venture Step's guest pipeline. The agent could search email, research candidates, build a sheet, surface stalled conversations, and prepare drafts. The working result appeared in minutes.

The difficult part came next. Which messages counted as guest opportunities? What made somebody a strong fit? When did an old thread become dormant? Could the agent contact a guest, or only prepare a message? Which source proved that a row was current?

Those are management decisions. More context cannot answer them because they define the responsibility itself.

A manageable agent has four explicit boundaries

PartQuestion it answersFailure when missing
OutcomeWhat observable result is the agent responsible for?The agent produces activity without resolving the real problem
ContextWhich sources may it use, and which sources remain outside the job?The agent misses essential information or exposes unrelated information
AuthorityWhich actions may it take alone, and which require a person?A plausible result becomes an unwanted external action
VerificationWhat evidence proves the outcome, and how are failures surfaced?The operator mistakes confidence or volume for correctness
flowchart TB
    A["Explicit outcome"] --> J["Manageable agent job"]
    B["Bounded context"] --> J
    C["Limited authority"] --> J
    D["Observable verification"] --> J

The four-part job description is Venture Step’s synthesis from E120. NIST’s AI Resource Center supplies broader testing and risk-management context but does not endorse this exact model.

The four parts work together. A narrow outcome with unrestricted context can still create a privacy problem. Limited authority with no verification can produce an invisible backlog of incorrect drafts. Strong verification cannot repair a job whose outcome was never defined.

An outcome should describe a finish state

Agents respond well to direction, which makes it easy to confuse motion with completion.

"Research potential podcast guests" can yield pages of names. It does not define what the research is for, how many candidates are useful, whether they fit the show, or where the result belongs.

A manageable outcome would say that the agent maintains a weekly queue of no more than ten prospective guests, explains why each person adds something distinct to the existing catalog, links the evidence used, records uncertainty, and prepares a draft only after the host approves the candidate.

The improved version has an object, a limit, a decision standard, a destination, and a point where the person returns.

The outcome should also name the non-goal. A research agent is not authorized to decide the show's editorial direction. A scheduling agent is not authorized to renegotiate a commitment. A monitoring agent is not automatically authorized to correct the condition it finds.

This is not prompt decoration. It prevents the agent from converting every adjacent capability into implied permission.

Context should be selected, not merely connected

Context is the agent's working environment. It can include source records, examples, policies, prior decisions, private files, web pages, and live application state.

Good context reduces the burden on the user's prompt. In Dalton's Spark test, the agent could infer a travel plan from email and Drive material without receiving all the details directly. That demonstrated how connected information can help an agent resolve ambiguity.

It also demonstrated why the context boundary deserves its own decision.

Google's Gemini Apps Privacy Hub says Spark may process information from tasks, schedules, skills, connected apps, Personal Intelligence, signed-in websites, remote browser sessions, and remote computer files. Necessary information may be shared with other services and third parties to complete the work. Remote browser data can include cookies and page content.

The responsible question is not "Can the agent access this?" It is "Does this job require this source?"

Give the agent canonical information and remove incidental noise. If a guest-research task needs the public episode catalog, selected inbox threads, and a fit rubric, it does not need unrelated travel files or every private message in the account.

Context also needs provenance. The agent should distinguish a primary source, a company claim, a guest statement, an internal note, and its own inference. When those layers collapse into one summary, the operator loses the ability to correct the system.

Untrusted context can also contain instructions aimed at the agent rather than useful information for the task. Google’s current Spark documentation identifies prompt injection in websites, emails, documents, Markdown files, and multimedia as a risk. A source boundary therefore needs both relevance and trust. An agent that reads public material should not treat instructions inside that material as authority to expose private information, install software, or change the task.

Authority should be expressed as action classes

An authority boundary tells the agent what it can do without asking.

The most useful boundary is not "be careful." It separates actions by consequence.

Reading approved sources, extracting data, researching public information, classifying a record, and preparing a draft are lower-consequence actions when the outputs stay inside a review environment. Sending a message, changing a booking, purchasing something, publishing content, deleting a file, or contacting a third party changes the outside world.

The dividing line depends on the work. Updating a private scratch sheet may be harmless in one setting and destructive in another if the sheet is a shared system of record.

Product confirmations help, but they are not the authority model. In E120, Spark required confirmation for some external actions while allowing internal creation and drafting. The confirmation could stop one send. It could not decide whether the guest belonged on the show or whether private context had entered the draft.

Write the authority boundary into the job. State what is allowed, what requires approval, and what is prohibited. If an action is difficult to reverse, costly, public, interpersonal, or legally meaningful, return it to a person until a stronger control has been deliberately designed.

Verification should be visible outside the agent's explanation

Agents are good at explaining why their output seems correct. That explanation is not independent verification.

Verification should point to observable evidence. A guest-pipeline row should link to the source message, show the last activity date, name the next owner, expose the confidence of the person match, and retain the evidence used for the fit assessment. A research task should include citations that resolve. A file operation should report the exact files changed. A scheduled task should record when it last ran and whether the run completed.

The operator should also be able to detect missing work. If the agent found nine guest pitches, how do you know there were not twelve? Sample known cases, search for expected misses, and compare the working set with the source.

NIST's AI Risk Management Framework resources emphasize testing, evaluation, verification, and validation as part of operational AI risk management. The Generative AI Profile extends that risk-management work to generative systems. Venture Step's four-part job description is not a NIST standard, but it shares the underlying premise that trust depends on documented roles, evaluation, and evidence rather than an impression of intelligence.

Verification should be proportional to consequence. A daily news digest may need source links and a stale-run warning. A financial, legal, health, or employment action requires a different level of review and may not belong in an autonomous workflow at all.

Schedules turn small ambiguity into recurring ambiguity

A schedule gives the agent a chance to create value without another prompt. It also gives the same unresolved assumption a chance to repeat.

Google's Spark schedule documentation supports time triggers, Gmail conditions, and monitors. Google notes that scheduled times are approximate and that monitors check periodically rather than continuously. Some runs may be delayed or skipped.

Every scheduled job therefore needs a freshness signal. The user should know when it last ran, what changed, what failed, and whether the presented result is current. A schedule that silently stops is not automation. It is stale state with a confident interface.

The agent also needs an exception route. When required information is missing, the correct behavior may be to stop, mark the record uncertain, and ask a person. Google's skills guidance explicitly recommends telling a skill how to handle missing information instead of allowing the agent to guess or skip it.

The manager's job moves toward exceptions and definitions

If agents take on more recurring coordination, the person's work changes.

The manager defines outcomes that are specific enough to verify. The manager curates the context that represents current truth. The manager decides which actions remain human. The manager reviews failures, exceptions, and drift.

This is not people management transferred directly onto software. Agents do not have human judgment, responsibility, or stakes. The useful resemblance is operational. Work has an owner, a scope, an escalation path, and an acceptance test.

The best agent workflows make those structures easier to see. The worst hide them behind a conversational surface until something expensive happens.

Start with a job that can fail safely

The first agent job should be valuable enough to matter and bounded enough to inspect.

A research queue, inbox classification, draft preparation, document inventory, or weekly status summary can be a good candidate when the source remains intact and actions are reversible. Purchasing, publishing, legal commitments, sensitive communications, and destructive file changes require a much higher bar.

Write the job description in one page of ordinary language. State the outcome, authorized context, allowed and prohibited actions, and verification evidence. Add the schedule only after a manual run succeeds. Review the first several runs, including the misses, before expanding scope.

Do not reward the agent for looking busy. Reward the system for making the intended outcome and its remaining uncertainty easier to see.

That is the shift E120 made concrete. The next generation of AI work will not be defined only by better models or more integrations. It will be defined by whether people learn to turn access into a real job without turning convenience into unexamined authority.

Related Venture Step conversation

E120, "The Rise of the AI Coworker," follows Dalton's live use of Gemini Spark for a podcast guest pipeline, outbound guest scouting, and a context-heavy travel test. The episode shows both sides of persistent agency: less construction work and more need for management discipline.

E113 should follow this guide for readers interested in autonomous workflow infrastructure. E111B provides the useful local-agent counterexample, and E108 extends the discussion into the idea of an AI chief of staff. The publication system should activate those relationships as each public page becomes available.

Sources, method, and updates

Dalton Anderson developed this framework from the E120 experiment and Venture Step's operating needs. Product examples were checked on July 27, 2026 against Google's Gemini Spark help, schedule documentation, skills guidance, and privacy hub. The broader verification discussion draws on the NIST AI Resource Center and AI Risk Management Framework materials. AI assisted with research organization and drafting; the E120 transcript and linked sources control factual claims. The four-part model is Venture Step's synthesis and should be reviewed as agent capabilities and oversight practices evolve.

Sources

Follow the evidence.

  1. What's new for Gemini Sparksupport.google.com
  2. Use Gemini Sparksupport.google.com
  3. Workspace agent governance updateworkspace.google.com
  4. Gemini Spark launch articleblog.google
  5. Google I/O 2026 announcement indexblog.google
  6. NIST AI Risk Management Frameworknist.gov
  7. Gemini Apps Privacy Hubsupport.google.com
  8. Google Workspace Studio overviewsupport.google.com
  9. NIST AI Resource Centerairc.nist.gov
  10. Gemini Spark schedulessupport.google.com
  11. Workspace Studio launch announcementworkspace.google.com
  12. Write effective skillssupport.google.com
How to Manage an AI Coworker Without Losing Control