Known bots · Ahrefs
Ahrefs’s bots
Ahrefs runs one bot tidekeeper knows by name.
Its bots
Ahrefs’s own page on them: ahrefs.com/robot
Keep one out
A crawler reads by the group that names it. To keep it out:
User-agent: AhrefsBot Disallow: /
Ahrefs runs one bot tidekeeper knows by name.
Ahrefs’s own page on them: ahrefs.com/robot
A crawler reads by the group that names it. To keep it out:
User-agent: AhrefsBot Disallow: /