Back to the episode map

Research Note

Personalized Feed Audit Protocol

This protocol helps one person observe what a recommendation surface exposed during a bounded period. It does not reverse-engineer hidden weights, diagnose a person, or m

Aug 4, 20262 min readBy Dalton Anderson

Personalized Feed Audit Protocol

Purpose

This protocol helps one person observe what a recommendation surface exposed during a bounded period. It does not reverse-engineer hidden weights, diagnose a person, or measure platform-wide effects.

Observation design

Choose one surface, one account state, one device, one time window, and a fixed sample rule. A workable design is the first twenty eligible items seen at the same time each day for seven days. Do not interact for the purpose of changing the feed until the baseline sample is complete.

Record only what is necessary. Do not collect commenters' personal information, protected characteristics, private messages, or speculative mental-health labels.

FieldMeaning
Date, time, platform, surfaceDefines the observation context
Item positionPreserves order without implying causation
Publisher or creatorMeasures source concentration
TopicGroups the subject at a useful level
FrameRecords the main interpretive angle in neutral language
Evidence typeSeparates primary record, reporting, opinion, promotion, and unknown
Familiar or new sourceMeasures discovery
Commercial or synthetic disclosureRecords visible labeling
Action takenCaptures skip, open, follow, like, hide, or no action

Controls and intervention

TikTok describes "Not interested," creator or sound controls, and recommendation diversification in its For You explainer. YouTube documents "Not interested," "Don't recommend channel," history controls, and fewer-Shorts feedback in Manage your recommendations and search results.

After the baseline, make one documented change. Examples include following two well-sourced publishers outside the dominant source cluster, using a current platform control, or pausing history during unrelated research. Hold other behavior as steady as practical, repeat the sample, and compare exposure rather than judging success from one surprising item.

Interpretation rule

A narrow sample can show concentration, repetition, and change within that sample. It cannot reveal why the system ranked an item, whether another user saw the same surface, or whether exposure changed beliefs. If the audit causes distress or compulsive checking, stop. The guide is an information-literacy exercise, not health advice.

Sources

Follow the evidence.

  1. support.google.com: 14328491support.google.com
  2. nature.com: s41586 023 06297 wnature.com
  3. solomonmg.github.io: bakshy 2015 exposuresolomonmg.github.io
  4. ftc.gov: federal trade commission announces updated advertising guides combat deceptive reviews endorsementsftc.gov
  5. FTC Disclosures 101ftc.gov
  6. support.google.com: 16533387support.google.com
  7. spec.c2pa.org: Explainerspec.c2pa.org
  8. youtu.be: GhR9NuCQwlMyoutu.be
  9. FTC Endorsement Guides questions and answersftc.gov
  10. support.google.com: 2801947support.google.com
  11. cor.inquirygroup.org: lateral reading and the nature of expertisecor.inquirygroup.org
  12. support.google.com: 6342839support.google.com
  13. newsroom.tiktok.com: how tiktok recommends videos for younewsroom.tiktok.com
  14. open.spotify.com: 6pC7h1LY88I1LnfvH6h4dvopen.spotify.com
  15. daltonanderson.ghost.io: ai influencers and the dangers of a filtered realitydaltonanderson.ghost.io
Personalized Feed Audit Protocol