Known bots · X
X’s bots
X runs one bot tidekeeper knows by name.
Its bots
Keep one out
A crawler reads by the group that names it. To keep it out:
User-agent: Twitterbot Disallow: /
X runs one bot tidekeeper knows by name.
A crawler reads by the group that names it. To keep it out:
User-agent: Twitterbot Disallow: /