Documentation · Known bots
Known bots, by who runs them
Every bot tidekeeper knows by name: 45 from 31 companies. What each reads for, how to know it, whether its owner says where it reads from, and the robots.txt lines for it.
AI training8AI search7For someone now5robots.txt names2Search engines8Link previews9SEO tools4Monitoring2
AI companies
“Read us” is what each read on tidekeeper.eu in the last 30 days, as tidekeeper counts its own site. “Address list”: its owner publishes the addresses it reads from, and tidekeeper checks every read against them.
Search, previews and the rest
A bot that is not here is still left out of every figure, as a crawler, by its User-Agent and its behaviour; it is only not named. The free tool Can AI read your site? reads your robots.txt as each of these would.