Research Note
Model Customization Decision Framework
Start from a measured failure. Use prompting for instruction, structure, examples, and supplied context. Use retrieval when answers require changing external knowledge wi
In this article
Model Customization Decision Framework
Start from a measured failure. Use prompting for instruction, structure, examples, and supplied context. Use retrieval when answers require changing external knowledge with provenance and access control. Consider fine-tuning when a stable task or behavior remains weak after prompt and system design and suitable labeled data exists. Consider distillation when a smaller model must reproduce defined behavior and the teacher, data, license, evaluation, and safety boundaries permit it.
Methods can be combined, but each adds data, evaluation, operations, security, privacy, and license obligations.
Choose the smallest intervention that passes a frozen evaluation set and operating constraints.
Sources
Follow the evidence.
- Introducing Llama 3.1ai.meta.com
- ai.meta.com: the llama 3 herd of modelsai.meta.com
- cloud.google.com: prompt design strategiescloud.google.com
- daltonanderson.ghost.io: unlocking llama 3 1 metas open source ai revolutiondaltonanderson.ghost.io
- docs.cloud.google.com: tune modelsdocs.cloud.google.com
- docs.cloud.google.com: rag quickstartdocs.cloud.google.com
- docs.nvidia.com: benchmarkingdocs.nvidia.com
- genai.owasp.org: owasp top 10 for llm applications 2025genai.owasp.org
- Meta Llama models repositorygithub.com
- github.com: LICENSEgithub.com
- github.com: MODEL CARDgithub.com
- github.com: USE POLICYgithub.com
- github.com: PurpleLlamagithub.com
- huggingface.co: modelshuggingface.co
- huggingface.co: model memory anatomyhuggingface.co
- open.spotify.com: 6DI2GolY5QTfflWBunE2xiopen.spotify.com
- opensource.org: open source ai definitionopensource.org
- owasp.org: www project top 10 for large language model applicationsowasp.org
- NIST AI Risk Management Frameworknist.gov
- NIST: Artificial Intelligence Risk Management Framework, Generative Artificial Intelligence Profilenist.gov
- youtu.be: gg2I5iO1x0oyoutu.be