Research Note
AI Citation Claim Audit Framework
A citation is an inspection path. Confidence belongs to the claim only after the cited artifact and surrounding evidence have been checked.
In this article
AI Citation Claim Audit Framework
Verification principle
A citation is an inspection path. Confidence belongs to the claim only after the cited artifact and surrounding evidence have been checked.
Claim audit
| Check | Question |
|---|---|
| Identity | Is this the intended artifact, author, edition, and version? |
| Passage | Does the cited text exist and match the representation? |
| Support | Does the passage entail the claim or merely share its topic? |
| Context | Do surrounding conditions, exceptions, definitions, or uncertainty change the meaning? |
| Inference | Which part of the answer comes from the source and which part is synthesis? |
| Coverage | Are relevant contrary, limiting, or necessary sources missing? |
| Currency | Was the source effective for the decision date? |
| Authority | Can this source answer this kind of question? |
Method
Break a response into independently checkable claims.
Open each citation and record the exact source identity and passage. Read enough surrounding material to capture definitions, scope, and exceptions.
Classify the claim as directly supported, supported with qualification, inferred, contradicted, unsupported, or unverifiable from the pack.
Search the source set for material that could change the conclusion. Do not let one convenient citation hide an incomplete evidence set.
Rewrite the answer so its confidence, conditions, date, and source role are visible. Remove unsupported claims.
Escalation
Do not use the checklist to certify high-impact advice. Escalate medical, legal, financial, employment, education, security, safety, and other consequential decisions to the relevant authoritative process and qualified person.
Sources
Follow the evidence.
- blog.google: notebooklm new features december 2024blog.google
- blog.google: notebooklm audio overviewsblog.google
- daltonanderson.ghost.io: googles ai tutor the future of personalized learningdaltonanderson.ghost.io
- edu.google.com: ai notebooklmedu.google.com
- journals.sagepub.com: fulljournals.sagepub.com
- NIST Generative AI Profilenvlpubs.nist.gov
- open.spotify.com: 1YXy6yyC4u2mnqeARVB5qvopen.spotify.com
- studentprivacy.ed.gov: privacy and education technologystudentprivacy.ed.gov
- support.google.com: notebooklmsupport.google.com
- support.google.com: 16164461support.google.com
- support.google.com: 16213268support.google.com
- support.google.com: 16212820support.google.com
- support.google.com: 16179559support.google.com
- support.google.com: 16215270support.google.com
- support.google.com: 16322204support.google.com
- support.google.com: 17003757support.google.com
- support.google.com: 17004255support.google.com
- daltonanderson.net: googles ai tutor the future of personalized learningdaltonanderson.net
- NIST AI Risk Management Frameworknist.gov
- www2.ed.gov: ai reportwww2.ed.gov
- youtu.be: 6BwWKkZ7aeAyoutu.be