Back to the episode map

Research Note

VR Training Program Evaluation Record

Does the defined VR program improve retained and transferable performance for the intended learner, compared with a credible alternative, at acceptable safety, accessibil

Aug 4, 20262 min readBy Dalton Anderson

VR Training Program Evaluation Record

Evaluation question

Does the defined VR program improve retained and transferable performance for the intended learner, compared with a credible alternative, at acceptable safety, accessibility, privacy, operational, and financial cost?

Immersion, enjoyment, presence, completion, and simulated performance do not by themselves answer that question.

Outcome ladder

LevelEvidence
AccessSetup, accommodations, exclusions, support, and completion
ReactionStructured learner response
KnowledgeValid assessment against baseline or comparator
Simulated skillObservable behavior, errors, decisions, and time in the scenario
RetentionDelayed assessment after practice
TransferBehavior in real or higher-fidelity work
OutcomeOperational, quality, or safety result with confounders addressed
Burden and harmSymptoms, incidents, disruption, instructor load, support, time, and cost

Current evidence boundary

A health-professions systematic review found advantages for some knowledge and cognitive-skill outcomes, with the certainty and comparison depending on outcome:

https://pubmed.ncbi.nlm.nih.gov/30668519/

A construction-safety systematic review and meta-analysis concerns that defined field:

https://pubmed.ncbi.nlm.nih.gov/38485365/

A 2024 review of mental-health training for health professionals reported promising findings while emphasizing heterogeneity, small samples, and risk of bias:

https://pubmed.ncbi.nlm.nih.gov/38693509/

These findings cannot be transferred automatically to surgery, rehabilitation, manufacturing, correctional settings, consumer learning, or another domain.

Pilot boundary

Domain experts should define the real behavior, learner, error, consequence, baseline, comparator, assessment, retention window, and transfer environment before selecting technology.

A real pilot may require safety, accessibility, privacy, security, procurement, professional standards, research ethics, statistical methods, labor, and legal review. This record does not authorize a pilot or establish clinical, educational, or operational effectiveness.

Sources

Follow the evidence.

  1. meta.com: safety centermeta.com
  2. open.spotify.com: 4VxWRqRFbaxedmB4bBWXtDopen.spotify.com
  3. pubmed.ncbi.nlm.nih.gov: 38693509pubmed.ncbi.nlm.nih.gov
  4. youtu.be: 8Ha7ODt8qTgyoutu.be
  5. pubmed.ncbi.nlm.nih.gov: 38485365pubmed.ncbi.nlm.nih.gov
  6. meta.com: privacy policymeta.com
  7. daltonanderson.net: my 30 hour meta quest 3 journey is vr worth itdaltonanderson.net
  8. meta.com: quest 3meta.com
  9. Meta Quest 3 launchabout.fb.com
  10. pubmed.ncbi.nlm.nih.gov: 30668519pubmed.ncbi.nlm.nih.gov
  11. daltonanderson.ghost.io: my 30 hour meta quest 3 journey is vr worth itdaltonanderson.ghost.io
VR Training Program Evaluation Record