Review App

Internet Entrepreneurs Blog

Cuil bot is slowing websites

September 2nd, 2008

Just thought I’d follow up my first post about Cuil by adding more fuil to the fire (get it, fuel?). TechCrunch is reporting that some webmasters are experiencing crippling web traffic from the Cuil spider. We haven’t noticed anything on our sites yet but we have had problems with poorly crafted web spiders in the past.

Last year it was the Limelight Networks spider that was causing problems with our analytics, logging unique visits hundreds of times each day and only viewing a single page at a time. This went on for weeks (if not months) before we caught on and we contacted the company to fix their spider. Of course this didn’t happen and we eventually just filtered it from our analytics while the spider continued to suck server resources.

Anyway, sounds like it’s one more nail in the Cuil coffin - who needs a new Google anyway?

Leave a Reply