Crawler policy

Where Roster collects public web data (a supplementary source — official APIs and creator consent come first), the crawler behaves as follows, enforced in code:

Site operators: blocking the UA above in robots.txt is honoured. Individuals: use the removal form — it outranks everything else.