Bot Strategy: Fetch, Scrape, Change IP, repeat

Four IPs scraped my site in identical ways: Fetch the most recent document, then scrape parts of the rest of the site. The IP changes, and they repeat. They fetch the same identical document, but then scrape different parts of my site but only for images.

I’ll keep my eye on such activity and see if I further pin down something more definite.

UA: Mozilla/4.0 (compatible; MSIE 8.0; Windows NT 5.1; Trident/4.0; .NET CLR 2.0.50727), which seems to be not unique

192.103.252.104 [25/Feb/2017:14:39:45 GET /stuff*/ HTTP/1.1 200 28544 – Mozilla/4.0 (compatible; MSIE 8.0; Windows NT 5.1; Trident/4.0; .NET CLR 2.0.50727)

45.58.47.7 [25/Feb/2017:21:31:39 GET /stuff*/ HTTP/1.1 200 28543 – Mozilla/4.0 (compatible; MSIE 8.0; Windows NT 5.1; Trident/4.0; .NET CLR 2.0.50727)

103.4.16.144 [25/Feb/2017:22:03:52 GET /stuff*/ HTTP/1.1 200 28544 – Mozilla/4.0 (compatible; MSIE 8.0; Windows NT 5.1; Trident/4.0; .NET CLR 2.0.50727)

89.33.7.163 [25/Feb/2017:23:54:48 GET /stuff*/ HTTP/1.1 200 28543 – Mozilla/4.0 (compatible; MSIE 8.0; Windows NT 5.1; Trident/4.0; .NET CLR 2.0.50727)

192.103.252.104 Empire Technology Us,
45.58.47.7 Atlantic.net Us
103.4.16.144 Virtual Datacentre Au, risk 1/10, bots
89.33.7.163 SYN Uk

Leave a Reply

Your email address will not be published. Required fields are marked *