Back to the episode map

Research Note

Mixed Reality Product Demo Evaluation Framework

A product demonstration supports a claim about the demonstrated setup under recorded conditions. It does not automatically establish repeatability, independence, safety,

Aug 4, 20262 min readBy Dalton Anderson

Mixed Reality Product Demo Evaluation Framework

Demonstration principle

A product demonstration supports a claim about the demonstrated setup under recorded conditions. It does not automatically establish repeatability, independence, safety, accessibility, economics, availability, or everyday usefulness.

Evidence record

FieldRecord
ClaimExact behavior the demonstration is presented to show
ArticlePrototype, development kit, shipping product, or simulation
EnvironmentLighting, space, network, markers, calibration, content
OperatorPresenter, trained staff, participant, remote support
ControlLive, scripted, prerecorded, edited, assisted, or mixed
InputsVoice, gaze, hand, controller, wristband, external systems
OutputDisplay, audio, latency, alignment, tracking, errors
DurationLength and continuity of the demonstrated task
RepetitionTrial count, failure rate, resets, selection
RecoveryFallback, intervention, restart, safe stop
AccessWho can test, where, under what restrictions
Later stateShipment, update, independent evaluation, unresolved work

Interpretation

The demonstrated success is the narrowest defensible sentence.

A staged environment may be appropriate for engineering work. It should remain visible in the claim.

Repeated independent use under representative conditions provides stronger evidence than one controlled presentation.

Prototype boundary

A prototype can validate technical integration and produce learning without being manufacturable, supportable, repairable, affordable, durable, safe, accessible, or ready for a consumer.

Public language

Use demonstrated, publisher-reported, observed, independently reproduced, shipping, available, or planned according to the evidence. Avoid "proved the future" and other language that converts a bounded demo into a product verdict.

Sources

Follow the evidence.

  1. daltonanderson.net: metas ai vision from vr headsets to smart glassesdaltonanderson.net
  2. about.fb.com: introducing orion our first true augmented reality glassesabout.fb.com
  3. daltonanderson.ghost.io: metas ai vision from vr headsets to smart glassesdaltonanderson.ghost.io
  4. meta.com: comparemeta.com
  5. open.spotify.com: 62HVWPy2EJ1B7pfu05pVWLopen.spotify.com
  6. Meta Quest 3S announcementabout.fb.com
  7. NIST AI Risk Management Frameworknist.gov
  8. youtu.be: p0H3F3eG47oyoutu.be
  9. meta.com: ai glassesmeta.com
  10. meta.com: privacy policymeta.com
  11. ai.meta.com: llama 3 2 connect 2024 vision edge mobile devicesai.meta.com
  12. meta.com: ray ban metameta.com
  13. ftc.gov: privacy securityftc.gov
  14. support.bemyeyes.com: 29893014835729 Meta AI Glasses FAQsupport.bemyeyes.com
  15. about.fb.com: metas ai product news connectabout.fb.com
  16. about.fb.com: new ray ban meta smart glasses styles and meta ai updatesabout.fb.com
Mixed Reality Product Demo Evaluation Framework