FW: [WEB4LIB] user agent log file - unknown platform and Other ag ents

[Gimon, Charles A]

Try grepping through the actual logs--the non-Mozilla and non-Windows/Mac
entries can be quite interesting.

Here are some examples from our logs for July:

Robots:

Scooter/1.0               
Slurp/cat+(slurp at inktomi.com;+http://www.inktomi.com/slurp.html)
Googlebot/2.0+(+http://googlebot.com/bot.html)

Validators (these were primarily me, validating my work):

Bobby+3.0               
W3C_Validator/1.66+libwww-perl/5.48  
WDG_SiteValidator/1.1   

Browsers that are not Netscape or IE:

Mozilla/4.73+(Windows+NT+4.0;+U)+Opera+4.01++[en]
Lynx/2.8.2rel.1+libwww-FM/2.14

Platforms that are not Windows or Mac:

Mozilla/4.73+[en]+(X11;+U;+Linux+2.2.16+i686;+Nav)
Mozilla/4.72+[en]+(X11;+I;+SunOS+5.7+sun4u)
Mozilla/4.7+[en]+(X11;+I;+FreeBSD+3.4-STABLE+i386;+Nav)
Mozilla/4.07C-SGI+[en]+(X11;+I;+IRIX+6.5+IP20)

People writing their own bots in perl or tcl:

Tcl+http+client+package+2.3
libwww-perl/5.47
LWP::Simple/5.36

Who knows????

Lexicus+Chocolate+Corpus+Constructor
SpaceBison/0.01+[fu]+(Win67;+X;+ShonenKnife)
RepoMonkey+Bait+&+Tackle/v1.01

All these are actual examples from our July logs. Once you subtract the
Netscape/MSIE/Windows/Mac lines, the rest seems to be a consistent 5% of
external users of our site. (Yet another reason to write HTML to the W3C
standards, rather than for either Netscape or IE...maybe I should put a
button on our site that says "SpaceBison compatible!")

--Charles Gimon
  Web Coordinator
  Minneapolis Public Library


-----Original Message-----
From: Stéphane Dudart [mailto:dudart at bse.ucl.ac.be] 
Sent: Tuesday, August 22, 2000 4:42 AM
To: Multiple recipients of list
Subject: [WEB4LIB] user agent log file - unknown platform and Other
agents


Dear list,

In our detailed User agent records we find hits for "Unknown platform" and
"Other agents". What can we find with these two elements? Robots for "Other
agents"?

Thank you

Stéphane