Bots in hell

I’ve been fascinated by Mark Pilgrim’s posts on banning bad robots and spambots and so on.

The latest—How to block spambots, ban spybots, and tell unwanted robots to go to hell—has me actually downloading my access log and checking for abusive bots.

(Once upon a time—like seven years ago or something—I wrote a WebSTAR plugin called DenyAgent which allowed people to block bots on their systems. So I’ve been interested in this topic before.)