Research Note
Hybrid AI Execution Evaluation Protocol
For one named AI feature and task, what input crosses which system boundary, under which device, software, account, network, region, and policy conditions?
In this article
Hybrid AI Execution Evaluation Protocol
Question
For one named AI feature and task, what input crosses which system boundary, under which device, software, account, network, region, and policy conditions?
Evaluation record
| Field | Required record |
|---|---|
| Feature and task | Exact user action and intended outcome |
| Device state | Model, OS build, language, region, account, storage, battery, and relevant settings |
| Input | Text, image, audio, file, application context, personal context, and metadata |
| Documented paths | On device, vendor cloud, external provider, or unsupported |
| Routing signal | Prompt, notice, consent step, setting, log, or report |
| Network test | Connected, constrained, offline, and restored behavior |
| Output | Result, latency, error, fallback, and visible provider |
| Data terms | Purpose, retention, access, logging, training, deletion, and jurisdiction claims |
| Evidence limits | What the documentation and test cannot establish |
| Decision | Allow, restrict, pilot, block, or escalate |
Procedure
Fix the device and account state. Capture current vendor documentation and settings. Draw the documented data flow before testing. Run the same bounded task while connected, constrained, and offline. Record prompts, failures, changes in output, and any provider handoff.
Use available system reports where relevant. Apple's PCC documentation describes an Apple Intelligence report that can distinguish OnDevice and PrivateCloudCompute execution environments for recorded model requests. A report can strengthen the record but does not reveal every network flow or prove the complete security property.
Do not use sensitive or regulated data merely to test a boundary. Use synthetic or authorized low-risk inputs and escalate unresolved questions to qualified technical, privacy, security, legal, and business owners.
Sources
Follow the evidence.
- daltonanderson.ghost.io: apples wwdc 2024 ai ios 18 whats next for youdaltonanderson.ghost.io
- github.com: security pccgithub.com
- open.spotify.com: 3HwL2aWitmMezTHw5n19iFopen.spotify.com
- security.apple.com: private cloud computesecurity.apple.com
- security.apple.com: expanding pccsecurity.apple.com
- security.apple.com: appendix appleintelligencereportsecurity.apple.com
- security.apple.com: releasetransparencysecurity.apple.com
- support.apple.com: 118105support.apple.com
- support.apple.com: 108771support.apple.com
- support.apple.com: 100100support.apple.com
- support.apple.com: 121582support.apple.com
- support.apple.com: 121115support.apple.com
- support.apple.com: 122195support.apple.com
- apple.com: apple intelligence is available today on iphone ipad and macapple.com
- apple.com: introducing apple intelligence for iphone ipad and macapple.com
- apple.com: wwdc24 highlightsapple.com
- gsma.com: rcs universal profile 4 1 stronger foundations for secure messaginggsma.com
- gsma.com: RCC.71 v3.0gsma.com
- youtu.be: ZQGKh2ulJ3Yyoutu.be