[WEB4LIB] WiseCrawler? Or dumb as a stone?

Danny Sullivan danny at calafia.com
Tue Nov 20 12:09:01 EST 2001


> In looking at my raw log file, I discovered that I was indeed being
> crawled by something that calls itself "WiseCrawler". Since it
> completely blew past my block, and was crawling my site at 2-4
> requests a second, it doesn't seem very wise to me. At the very
> least, it is not abiding by common rules of decency for web crawlers.
>
> I searched Google for any information on it, and came up blank. Does
> anyone know anything about it, and is it hitting you hard, and in
> places where it shouldn't? Thanks

I thought it might be from WiseNut.com, but they apparently call their
crawler Zyborg. However, the name may have been changed. You can check with
them here: http://www.wisenut.com/corp/contact.html

cheers,
danny

-----------------------------------
Danny Sullivan
Editor, SearchEngineWatch.com
http://searchenginewatch.com



More information about the Web4lib mailing list