Known bots · Semrush
What is SemrushBot?
Semrush’s SEO tool's crawler. tidekeeper knows it by its User-Agent.
- Run by
- Semrush
- Reads for
- SEO tool
- Known by
- “semrushbot” in its User-Agent, and SemrushBot in robots.txt
- Its addresses
- Semrush publishes no list, so a read is known by its name alone: anyone can send it.
- Its owner’s page
- www.semrush.com/bot/
Keep it out
User-agent: SemrushBot Disallow: /
Or only part of the site: Disallow: /private/ under the same User-agent line.
On tidekeeper.eu
SemrushBot read tidekeeper.eu 532 times in the last 30 days, as tidekeeper counts its own site, from its server.