Robot Exclusion Enforcement

With thanks to Paul Ford for permission to write a sequel to the original “Robot Exclusion Protocol” short story. I hope I haven’t done the original any disfavours.

I was on a job when I saw it. A couple of feet tall, made of metal, with camera lenses for eyes and a few dozen gripping arms. [...]

How Long’s A CAPTCHA take to die?

With all due apologies to the Beautiful South for the title .
Anything that can be exploited eventually gets broken so how come so many people seem to think that CAPTCHAs are somehow exempt from this?
Surely their history so far is sufficient to establish that they will become less and less useful.

Over A Third Of My Visitors Are Bad Bots!

I’m starting on the long, long learning curve of blocking bad bots. I have a long way to go yet but just wondered what the work I had done so far had revealed.
The site running the most up to date code was not a huge site. A long-standing, decidely niche site, it used to generate [...]