Research Note
Engineering Demonstration Evaluation Framework
A demonstration supports the narrowest claim that matches its article, objective, conditions, measurements, and result.
In this article
Engineering Demonstration Evaluation Framework
A demonstration supports the narrowest claim that matches its article, objective, conditions, measurements, and result.
Evidence record
| Field | Required question |
|---|---|
| Claim | What statement is the demonstration supposed to support? |
| Article | Concept, component, prototype, production unit, or operational system? |
| Environment | Laboratory, simulated, relevant, controlled operational, or actual operation? |
| Control | Autonomous, scripted, supervised, teleoperated, remotely assisted, or mixed? |
| Criteria | What passed, failed, or remained conditional? |
| Measurement | What telemetry, observation, inspection, or independent evidence exists? |
| Anomaly | What deviated from plan and how was it classified? |
| Repetition | Has the result persisted across trials and variation? |
| Scale | Does the demonstrated article match the intended load, rate, fleet, or environment? |
| Lifecycle | What maintenance, support, safety, cost, and governance evidence exists? |
NASA's Technology Readiness Levels distinguish early concept and proof of concept from relevant-environment demonstration, operational-environment prototype, qualification, and successful mission operation. This guide can borrow the distinction without assigning a formal TRL outside an accountable program process.
Decision rule
Write two sentences. The first states exactly what the demonstration showed. The second states the larger claim that remains untested.
Do not infer repeatability from one success, reliability from edited highlights, safety from the absence of a visible incident, autonomy from human-like motion, or operational maturity from a prototype in a controlled venue.
Sources
Follow the evidence.
- ir.tesla.com: tsla 20251231 genir.tesla.com
- nhtsa.gov: automated vehicles safetynhtsa.gov
- dmv.ca.gov: autonomous vehicles program permit resourcesdmv.ca.gov
- open.spotify.com: 40qV14aYmmoYMkcQdIO21eopen.spotify.com
- ir.tesla.com: tsla 20260128 genir.tesla.com
- nhtsa.gov: standing general order crash reportingnhtsa.gov
- nhtsa.gov: voluntary safety self assessmentnhtsa.gov
- tesla.com: AItesla.com
- tsapps.nist.gov: get pdftsapps.nist.gov
- faa.gov: activity archivefaa.gov
- daltonanderson.net: elon musks big bets starship teslas ai fleetdaltonanderson.net
- faa.gov: spacex starshipfaa.gov
- ir.tesla.comir.tesla.com
- tesla.com: we robottesla.com
- daltonanderson.ghost.io: elon musks big bets starship teslas ai fleetdaltonanderson.ghost.io
- tesla.com: fsdtesla.com
- esto.nasa.gov: trlesto.nasa.gov
- spacex.com: starship flight 5spacex.com
- nist.gov: autonomy levels unmannednist.gov
- youtu.be: c6yeP cvRzwyoutu.be