Cutbot is an online media monitoring service. We crawl a wide variety of internet publications to find the latest news.
Our crawler identifies itself with an HTTP user-agent header that should allow publishers to easily exclude it from any logfile analysis:
Cutbot; 1.5; http://cutbot.net/
We aim to make sure our crawler never has a detrimental effect on publications’ web sites. If the crawler seems to be causing any problems, please get in touch with our technical department.