Known bots · Majestic
Majestic’s bots
Majestic runs one bot tidekeeper knows by name.
Its bots
Majestic’s own page on them: mj12bot.com/
Keep one out
A crawler reads by the group that names it. To keep it out:
User-agent: MJ12bot Disallow: /
Majestic runs one bot tidekeeper knows by name.
Majestic’s own page on them: mj12bot.com/
A crawler reads by the group that names it. To keep it out:
User-agent: MJ12bot Disallow: /