[Web4lib] new scholarly content in (vanilla) Google?

[Rudy Leon]

Some google searches this morning consistently brought back results
from JSTOR, which is a very new wrinkle 9at least to me).

If I recall correctly, Google spiders were not allowed to crawl sites
they did not have full access to, and thus Google Scholar was born to
have different rules and allow the spidering of journal home pages and
other password blocked sites. However, this morning's results were in
plain old vanilla google, and also failed to include the "Full text @"
links we see from Schoogle results.

Has anyone any solid information about this? Have Google's rules
changed? What else is now being crawled by regular google spiders?
Will scholar be eliminated? Bueller?

-- 
Rudy Leon
Instruction & Collection Development Librarian
College Libraries            SUNY Potsdam
http://www2.potsdam.edu/leonre
http://www.deepening.wordpress.com
(315) 267-3309
AIM: leonre3309
Meebo: rudyleon