Research Note
Multimodal Claim Evidence Ladder
| State | What it establishes | |---|---| | Concept | A proposed architecture, task, or research direction | | Internal experiment | A tested setup under reported conditi
Multimodal Claim Evidence Ladder
Evidence states
| State | What it establishes |
|---|---|
| Concept | A proposed architecture, task, or research direction |
| Internal experiment | A tested setup under reported conditions |
| Benchmark result | A measured result for a named artifact, dataset, metric, and baseline |
| Demonstration | A selected interaction or prototype path |
| Released artifact | Weights, code, or another reproducible object with terms |
| Accessible interface | An API or product surface available to a defined audience |
| Supported capability | A documented, maintained feature with operational boundaries |
Claim record
Record exact input and output modalities, task, model path, component versions, training and evaluation data, metric, comparator, limitation, artifact identity, access, terms, product surface, support state, geography, account, and verification date.
Historical application
The Llama 3 paper reported compositional image, video, and speech experiments. Its research page explicitly said the resulting models were still under development and not broadly released. The July 2024 Llama 3.1 model card identified the released family as text in and text out.
Later multimodal Llama releases are descendant evidence. They do not make the 2024 text artifacts multimodal retroactively.
Sources
Follow the evidence.
- ai.meta.com: the llama 3 herd of modelsai.meta.com
- ai-challenges.nist.gov: genaiai-challenges.nist.gov
- owasp.org: www project top 10 for large language model applicationsowasp.org
- youtu.be: 1KNOcY e9Tsyoutu.be
- github.com: PurpleLlamagithub.com
- crfm.stanford.edu: indexcrfm.stanford.edu
- NIST AI Risk Management Frameworknist.gov
- mlcommons.org: jailbreak 0 7mlcommons.org
- mlcommons.org: safety faqmlcommons.org
- github.com: MODEL CARDgithub.com
- ai-challenges.nist.gov: ariaai-challenges.nist.gov
- github.com: MODEL CARDgithub.com
- daltonanderson.ghost.io: metas llama 3 safety scaling and simple solutionsdaltonanderson.ghost.io
- ai.meta.com: meta llama 3 1 ai responsibilityai.meta.com
- NIST Generative AI Profilenvlpubs.nist.gov
- mlcommons.org: safety methodologymlcommons.org
- huggingface.co: concept guidehuggingface.co
- github.com: MODEL CARDgithub.com
- csrc.nist.gov: red teamingcsrc.nist.gov
- open.spotify.com: 44o5OPSumaZJcvRkXutorBopen.spotify.com