← Back to writing

Writing

VR Training Program Evaluation Record

Does the defined VR program improve retained and transferable performance for the intended learner, compared with a credible alternative, at acceptable safety, accessibil

Research Note

Does the defined VR program improve retained and transferable performance for the intended learner, compared with a credible alternative, at acceptable safety, accessibil

Aug 4, 20262 min readBy Dalton Anderson
In this article

VR Training Program Evaluation Record

Evaluation question

Does the defined VR program improve retained and transferable performance for the intended learner, compared with a credible alternative, at acceptable safety, accessibility, privacy, operational, and financial cost?

Immersion, enjoyment, presence, completion, and simulated performance do not by themselves answer that question.

Outcome ladder

LevelEvidence
AccessSetup, accommodations, exclusions, support, and completion
ReactionStructured learner response
KnowledgeValid assessment against baseline or comparator
Simulated skillObservable behavior, errors, decisions, and time in the scenario
RetentionDelayed assessment after practice
TransferBehavior in real or higher-fidelity work
OutcomeOperational, quality, or safety result with confounders addressed
Burden and harmSymptoms, incidents, disruption, instructor load, support, time, and cost

Current evidence boundary

A health-professions systematic review found advantages for some knowledge and cognitive-skill outcomes, with the certainty and comparison depending on outcome:

https://pubmed.ncbi.nlm.nih.gov/30668519/

A construction-safety systematic review and meta-analysis concerns that defined field:

https://pubmed.ncbi.nlm.nih.gov/38485365/

A 2024 review of mental-health training for health professionals reported promising findings while emphasizing heterogeneity, small samples, and risk of bias:

https://pubmed.ncbi.nlm.nih.gov/38693509/

These findings cannot be transferred automatically to surgery, rehabilitation, manufacturing, correctional settings, consumer learning, or another domain.

Pilot boundary

Domain experts should define the real behavior, learner, error, consequence, baseline, comparator, assessment, retention window, and transfer environment before selecting technology.

A real pilot may require safety, accessibility, privacy, security, procurement, professional standards, research ethics, statistical methods, labor, and legal review. This record does not authorize a pilot or establish clinical, educational, or operational effectiveness.

Sources

Follow the evidence.

  1. Meta Quest 3 launchabout.fb.com
  2. daltonanderson.ghost.io: my 30 hour meta quest 3 journey is vr worth itdaltonanderson.ghost.io
  3. open.spotify.com: 4VxWRqRFbaxedmB4bBWXtDopen.spotify.com
  4. pubmed.ncbi.nlm.nih.gov: 30668519pubmed.ncbi.nlm.nih.gov
  5. pubmed.ncbi.nlm.nih.gov: 38485365pubmed.ncbi.nlm.nih.gov
  6. pubmed.ncbi.nlm.nih.gov: 38693509pubmed.ncbi.nlm.nih.gov
  7. daltonanderson.net: my 30 hour meta quest 3 journey is vr worth itdaltonanderson.net
  8. meta.com: privacy policymeta.com
  9. meta.com: quest 3meta.com
  10. meta.com: safety centermeta.com
  11. youtu.be: 8Ha7ODt8qTgyoutu.be