Alexa project

Grace Garbe garbe_grace at dsmc.dsm.mil
Tue Mar 16 10:03:22 EST 1999


I need some advice about the Alexa project <http://www.alexa.com>.  I could find only 3 messages in the archives dating back to 1997, and none address my question.

I recently received an email from Alexa saying that they had archived our entire website.  I went to their website and read about the project, but I'm not sure that I want our library website archived.  There are certainly pages that I don't want archived and even some that I probably don't want robots indexing.  Our website just recently grew from 3 pages to 13 and I had not put any meta tags in the documents to prohibit indexing, nor had I created a robots.txt file.  I'm doing that today.  But my question to those of you with more experience is do you permit Alexa (or other projects, if there are any) to archive your library's website?  Should I be concerned about this archival?  Do you permit robots to index all of your pages?

Any advice is appreciated.

Grace Garbe
ZAI-AMELEX
Systems Librarian/Webmaster
Acker Library
Defense Systems Management College
Ft. Belvoir, VA

garbe_grace at dsmc.dsm.mil
www.library.dsmc.dsm.mil/



More information about the Web4lib mailing list