rogue robots

Has been showing up in your logs lately? How about IP addr Behind those addresses was a heavy-duty webcrawling robot, sucking up everything in its path and ignoring important robot etiquette. The robot was responsible for at least one fifth of my traffic so far this month! But thanks to a few sleuths, the robot appears to be shut down. It's neat to see people gather information and take some action in a situation like this. Read more at phonezilla and the fascinating and useful spider discussion. Traffic logs make for interesting, if sometimes cryptic, reading.