Spiders & META Tags
Pat Anderson
pfa at nwu.edu
Wed May 21 11:46:23 EDT 1997
I am trying to verify something which I thought I had
read previously on this list. Yes, I searched the archive,
and didn't find it.
My question is:
Are there any major web search engines, robots, spiders,
etc. (such as InfoSeek, Altavista, Yahoo, Excite, etc.)
which have decided *not* to index sites which use META tags?
I remember this being discussed in the context of using
a META tag to tell robots and spiders to "go away."
Our reason is that we want to use META tags to assign
subject terms for our web site for our own search engine,
but do not want to scare off any possible indexing by other
search engines. We want as many people as possible to find
the site. If META tags have been banned by a major web search
service due to abuse by poor web designers, then we will
find some other way to assign subject terms.
Thanks in advance for all your help!
Pat Anderson
. . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . .
P. F. (Pat) Anderson "Learning, study, reading,
Barnes Learning Resources Center and the preservation of
Galter Library / Northwestern U. books are all integral
303 E. Chicago Ave. to spiritual practice.
Chicago IL 60611-3008 We get into trouble when
312/503-8238, voice we give up any of these ..."
312/503-8028, fax
Internet: pfa at nwu.edu Thomas Moore, Meditations,
WWW: http://www.galter.nwu.edu/ pg. 29
WWW: http://pubweb.acns.nwu.edu/~pfa/pfahome.html
. . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . .
More information about the Web4lib
mailing list