Back to the episode map

Evergreen

Can Coachability Be Measured Without Rewarding Compliance?

Coachability can be studied through how people seek, process, test, and learn from feedback. One interview cannot replace context, repeated behavior, and later outcomes.

Aug 4, 20266 min readBy Dalton Anderson

Can Coachability Be Measured?

Coachability can be studied, but it should not be reduced to whether a person accepts feedback in one conversation.

The useful signal is how someone seeks, understands, evaluates, tests, and learns from feedback and other learning opportunities across time. Context matters because advice can be poor, incentives can conflict, power can silence disagreement, and a strong leader sometimes needs to say no.

Measurement is most credible when it combines self-report, scenarios, observations, work history, other raters, and later outcomes.

Agreement is not learning

Imagine two founders.

The first agrees with every investor suggestion, changes direction repeatedly, and cannot explain what was learned. The second challenges the advice, tests the underlying assumption with customers, and changes the plan after the evidence is clear.

The first may feel easier to coach. The second has shown a stronger learning process.

Coachability cannot mean obedience. It also cannot mean resistance to every outside view. It concerns how a person engages with information that may require change.

Research defines several parts of coachability

A 2021 workplace Coachability Scale study developed short and long measures across four samples. It treated coachability as multidimensional and reported evidence about factor structure, reliability, and validity. The authors also called for more research across cultures, populations, behaviors, and outcomes.

A 2025 multi-study workplace scale examined awareness, openness, vulnerability, growth orientation, and external support. Its predictive correlations with later engagement and program impact were positive but modest.

A 2024 situational judgment study used scenarios instead of only a Likert scale and followed participants for nine months. It defines coachability through how people seek, engage with, process, and react to feedback and learning opportunities.

These studies show that coachability is measurable enough to investigate. They do not establish a universal founder score or validate every transcript-based method.

A practical observation model

Coachability becomes more concrete when it is treated as a sequence.

flowchart LR
    A["Seek or receive feedback"] --> B["Understand the claim"]
    B --> C["Evaluate source, evidence, and context"]
    C --> D["Choose a test or action"]
    D --> E["Observe the result"]
    E --> F["Update the decision or explain why not"]
    F --> G["Transfer the learning to later work"]

The sequence creates observable evidence. It also leaves room for justified rejection.

A person may understand the feedback and decide that testing it would violate a customer commitment. Another may run a small experiment and discover the advice was wrong. Both can be coachable if the reasoning is clear and later evidence is integrated.

Feedback quality belongs in the measure

Coachability is relational. The person giving feedback can be vague, self-interested, uninformed, inconsistent, abusive, or unaware of the operating constraints.

A measure that ignores feedback quality can reward deference to authority. This is especially risky when the evaluator controls funding, employment, promotion, or access to a program.

The observer should record the source, specificity, evidence, actionability, authority, risk, and relevance of the feedback. The response should be judged against that context.

One interview reveals reasoning, not a complete trait

An open interview can show how a person narrates feedback, conflict, mistakes, and change. It can reveal whether the person names other perspectives, distinguishes evidence from identity, and describes later action.

It also depends on memory, self-presentation, language, topic, trust, preparation, and the prompt. A convincing story about learning may be better practiced than the behavior itself.

Readiness Engine's current methodology page says the product analyzes real-work language, ties ratings to excerpts, and reads coachability with identity flexibility among six dimensions. It says it can use a structured interview or existing recordings.

That approach can generate a hypothesis and coaching discussion. The current company also says the instrument is early in validation and is not validated for selection decisions.

Context changes the behavior

A founder may seek feedback on product design and avoid it on hiring. A new executive may appear defensive in a hostile board setting and reflective with a trusted peer. A person can be open when stakes are low and rigid when identity, money, or status is threatened.

Pressure is part of the construct, but pressure also changes measurement. The observer needs repeated examples across domains and stakes.

The cleanest record follows an actual decision. What advice was given? What did the person believe? What test was chosen? What changed? What happened later? How was the learning used the next time?

Coachability can change

Calling someone uncoachable often turns a situational pattern into a permanent identity.

Self-awareness, feedback literacy, trust, incentives, role clarity, psychological safety, and coaching quality can change. A person can learn to separate criticism of the system from an attack on the self.

In episode 104, Logan Yonavjak describes this as seeing oneself as one component of a larger system. That is a useful developmental hypothesis. It should not be used to diagnose a founder from one transcript.

Use several sources and preserve disagreement

Evidence sourceWhat it can addMain limitation
Self-report scaleAttitudes, intent, and perceived habitsImpression management and self-knowledge
Situational judgment taskChoices across standardized scenariosScenario realism and scoring assumptions
Structured interviewReasoning and examples in the person's wordsMemory, language, and practiced narratives
Work sample or simulationBehavior under a shared taskShort time horizon and artificial context
References and peersRepeated observations across workRater bias, politics, and uneven opportunity
Longitudinal decision logFeedback, action, evidence, and later resultCost, time, and attribution

Disagreement among sources is information. A high self-rating with repeated evidence of ignored feedback should not be averaged into a comfortable middle. It should prompt a closer look.

Define the use before assigning the score

For coaching, a measure can surface hypotheses and create a shared language. The cost of error can be relatively low if the person sees the evidence, can contest the interpretation, and chooses the development goal.

For hiring, promotion, funding, or termination, the cost and power are much higher. The construct must be job or decision relevant, the method validated for the population and use, accommodations available, subgroup results monitored, and the result reviewable.

Refusing an assessment is not proof of low coachability. The person may be protecting sensitive data, objecting to an unclear use, or responding to a power imbalance.

Coachability is best measured as a pattern of learning behavior, not a personality label. Define the behavior, feedback context, observation period, raters, evidence, and later outcome before deciding what any score means.

The [[How to Evaluate an AI Leadership Assessment|AI assessment buyer guide]] provides the broader validity, fairness, privacy, and governance review.

AI assisted with research organization and drafting. Dalton Anderson remains responsible for the analysis, source boundaries, and publication decision.

Sources

Follow the evidence.

  1. multi-study workplace scaledoi.org
  2. Coachability Scale studydoi.org
  3. guidance on employment tests and selection procedureseeoc.gov
  4. NIST AI Risk Management Frameworknist.gov
  5. Leadership Quarterly review of constructive-developmental theorydoi.org
  6. situational judgment studydoi.org
  7. Readiness Enginereadinessengine.io
  8. media pagefounderready.io
  9. privacy policyreadinessengine.io
  10. termsreadinessengine.io
  11. recommendations for AI-based employee selection assessmentssiop.org
  12. Uniform Guidelines clarificationeeoc.gov
  13. methodology pagereadinessengine.io
  14. Trust and Ethics pagereadinessengine.io
Can Coachability Be Measured Without Rewarding Compliance?