schussman.com logo

rogue robots

Has gw.ocg-corp.com been showing up in your logs lately? How about IP addr 209.126.176.3? Behind those addresses was a heavy-duty webcrawling robot, sucking up everything in its path and ignoring important robot etiquette. The robot was responsible for at least one fifth of my traffic so far this month! But thanks to a few sleuths, the robot appears to be shut down. It's neat to see people gather information and take some action in a situation like this. Read more at phonezilla and the fascinating and useful webmasterworld.com spider discussion. Traffic logs make for interesting, if sometimes cryptic, reading.