
City of Toronto internet scraper bot scrapes my site a couple of times per month. Why? Toronto, Canada
According to our analysis of internet traffic, these requests are from corporate internet proxies that are trying to prefetch (similar to googlebot) the WordPress pages for fast retrieval.
If you wish to disable/disallow WordPress embeds you can use plugins or remove references in HTML head.Regards,
Internet Security Support
City of Toronto
IP Range: 204.187.67.0/24 206.130.160.0 – 206.130.174.255
IPs: 206.130.173.25 206.130.173.28 206.130.173.29 206.130.174.27
Bot name: anonymous
Host Name: none
Net Name: TORNET-03
User Agents
- Mozilla/4.0 (compatible;)
- Mozilla/5.0 (compatible; MSIE 9.0; Windows NT 6.1; Trident/5.0)
- Mozilla/5.0 (Windows NT 10.0; WOW64; Trident/7.0; rv:11.0) like Gecko
- Mozilla/5.0 (Windows NT 6.1) AppleWebKit/537.36 (KHTML, like Gecko) Chrome/56.0.2924.87 Safari/537.36
- Mozilla/5.0 (Windows NT 6.1; rv:44.0) Gecko/20100101 Firefox/44.0
- Mozilla/5.0 (Windows NT 6.1; rv:51.0) Gecko/20100101 Firefox/51.0
- Mozilla/5.0 (Windows NT 6.1; Trident/7.0; rv:11.0) like Gecko
- Mozilla/5.0 (Macintosh; Intel Mac OS X 10_8_5) AppleWebKit/537.36 (KHTML, like Gecko) Chrome/27.0.1453.93 Safari/537.36
- Mozilla/5.0 (Windows NT 10.0; Win64; x64) AppleWebKit/537.36 (KHTML, like Gecko) Chrome/46.0.2486.0 Safari/537.36 Edge/13.10586
- Mozilla/5.0 (Windows NT 6.1; rv:43.0) Gecko/20100101 Firefox/43.0
Addendum 2017-apr-21: They turned off their host name, so a lookup returns “not found”. Changed their net name to tornet-02. They are trying to evade detection.