Research Note
AI System Identity Stack
One model name can hide several systems.
In this article
AI System Identity Stack
One model name can hide several systems.
| Layer | What can change |
|---|---|
| Weights | Revision, adapter, merge, precision, quantization, tokenizer, and license |
| Runtime | Library, kernel, template, batching, hardware, and decoding |
| Endpoint | Provider, served revision, safety controls, caching, and updates |
| Router | Model selection, fallback, load balancing, and experiments |
| Wrapper | System prompt, retrieval, tools, memory, postprocessing, and retries |
| Product | User state, policy, interface, rate limits, and connected data |
An output from a private endpoint cannot be assumed to come from the public checkpoint with the same label. An output from a wrapper cannot be assigned entirely to the underlying weights.
The minimum comparison record needs the request path, artifact revision or provider, time, prompts, settings, and response evidence. Stylistic similarity can raise a question but cannot prove hidden identity.
Sources
Follow the evidence.
- arxiv.org: 1810arxiv.org
- crfm.stanford.edu: indexcrfm.stanford.edu
- HELM MMLU recordcrfm.stanford.edu
- daltonanderson.ghost.io: the ai that wasnt unmasking reflection 70bs hypedaltonanderson.ghost.io
- huggingface.co: Reflection Llama 3.1 70Bhuggingface.co
- huggingface.co: 458962ed801fac4eadd01a91a2029a3a82f4cd84huggingface.co
- huggingface.co: mainhuggingface.co
- huggingface.co: a376762159d10b8077c6a162ebd2f72267fe8a2fhuggingface.co
- huggingface.co: discussionshuggingface.co
- huggingface.co: 58huggingface.co
- huggingface.co: 59huggingface.co
- open.spotify.com: 4xX50HChI6FBLaYetiVZQHopen.spotify.com
- venturebeat.com: meet the new most powerful open source ai model in the world hyperwrites reflection 70bventurebeat.com
- daltonanderson.net: the ai that wasnt unmasking reflection 70bs hypedaltonanderson.net
- NIST AI Risk Management Frameworknist.gov
- nist.gov: towards best practices automated benchmark evaluationsnist.gov
- youtu.be: hmXfbvJOBY8youtu.be