Known bots · Mojeek
Mojeek’s bots
Mojeek runs one bot tidekeeper knows by name.
Its bots
Mojeek’s own page on them: www.mojeek.com/bot.html
Keep one out
A crawler reads by the group that names it. To keep it out:
User-agent: MojeekBot Disallow: /
Mojeek runs one bot tidekeeper knows by name.
Mojeek’s own page on them: www.mojeek.com/bot.html
A crawler reads by the group that names it. To keep it out:
User-agent: MojeekBot Disallow: /