[Web4lib] Federated Search versus Crawler or Spider

[Thomas,Dylan]

McIntyre, Ruth wrote:
> Dear Colleagues
> 
>  
> 
> I manage the Livestock Library, http://www.livestocklibrary.com.au/
> <http://www.livestocklibrary.com.au/> , an online database of links to over
> 22,000 journal articles and conference papers about livestock production
> developed for the benefit of all participants in Australia's livestock
> industries.
> 
>  
> 
> We wish to also provide access to information that has been written for
> producers (farmers); however producer information changes frequently, so it
> is important to access current information from its publishers' sites.  We
> are having a debate as to whether a federated search or a spider/crawler is
> the best way to access this information.  There are probably about 20 - 30
> target sites, most of which are freely available to the public and do not
> require authentication. 
> 
>  
> 
> We have trialled a federated search and are reasonably confident it will
> work with the target sites, though it is preferable for target sites to have
> advanced search screens, which is not always the case.
> 
>  
> 
> I would be interested to know the opinion of list members.
> 
>  
> 
> Kind regards
> 
>  
> 
> Ruth McIntyre
> 
>  
> 
>  
> 
> Ruth McIntyre
> 
> Manager, Livestock Library
> 
> c/- Department of Agriculture and Food, Western Australia 
> 
> 3 Baron Hay Court
> 
> South Perth  WA  6151
> 
>  
> 
> Tel:  61 8 9368 3611
> 
> Mob:  0409 688 546
> 
> Fax:  61 8 9368 4051
> 
> e-mail:  rmcintyre at agric.wa.gov.au <mailto:rmcintyre at agric.wa.gov.au> 
> 
>  
> 
> www.livestocklibrary.com.au <http://www.livestocklibrary.com.au> 
> 
> The leading Australian site for credible beef and sheep industry
> publications.
> 
>  
> 
> I work part-time, on Mondays, Tuesdays and Wednesdays.
> 
>  
> 
>  
> 
> 
> 
> This e-mail and files transmitted with it are privileged and confidential information 
> intended for the use of the addressee. The confidentiality and/or privilege in this e-mail is 
> not waived, lost or destroyed if it has been transmitted to you in error. If you received this 
> e-mail in error you must 
> (a) not disseminate, copy or take any action in reliance on it; 
> (b) please notify the Department of Agriculture and Food, WA immediately by return e-mail to the sender; 
> (c) please delete the original e-mail.
> 
> This email has been successfully scanned by
> McAfee Anti-Virus software.
> Department of Agriculture and Food WA
> _______________________________________________
> Web4lib mailing list
> Web4lib at webjunction.org
> http://lists.webjunction.org/web4lib/
It appears that perhaps Fsrch is perhaps bets suited, given the apparent 
limitations on srch bots' capabilities in accessing data sources..., 
(Though I may be wrong!)...

Are there obvious advantages and disadvantage that you can highlight?

-- 
Gall y neges e-bost hon, ac unrhyw atodiadau a anfonwyd gyda hi,
gynnwys deunydd cyfrinachol ac wedi eu bwriadu i'w defnyddio'n unig
gan y sawl y cawsant eu cyfeirio ato (atynt). Os ydych wedi derbyn y
neges e-bost hon trwy gamgymeriad, rhowch wybod i'r anfonwr ar
unwaith a dilëwch y neges. Os na fwriadwyd anfon y neges atoch chi,
rhaid i chi beidio â defnyddio, cadw neu ddatgelu unrhyw wybodaeth a
gynhwysir ynddi. Mae unrhyw farn neu safbwynt yn eiddo i'r sawl a'i
hanfonodd yn unig  ac nid yw o anghenraid yn cynrychioli barn
Prifysgol Cymru, Bangor. Nid yw Prifysgol Cymru, Bangor yn gwarantu
bod y neges e-bost hon neu unrhyw atodiadau yn rhydd rhag firysau neu
100% yn ddiogel. Oni bai fod hyn wedi ei ddatgan yn uniongyrchol yn
nhestun yr e-bost, nid bwriad y neges e-bost hon yw ffurfio contract
rhwymol - mae rhestr o lofnodwyr awdurdodedig ar gael o Swyddfa
Cyllid Prifysgol Cymru, Bangor.  www.bangor.ac.uk

This email and any attachments may contain confidential material and
is solely for the use of the intended recipient(s).  If you have
received this email in error, please notify the sender immediately
and delete this email.  If you are not the intended recipient(s), you
must not use, retain or disclose any information contained in this
email.  Any views or opinions are solely those of the sender and do
not necessarily represent those of the University of Wales, Bangor.
The University of Wales, Bangor does not guarantee that this email or
any attachments are free from viruses or 100% secure.  Unless
expressly stated in the body of the text of the email, this email is
not intended to form a binding contract - a list of authorised
signatories is available from the University of Wales, Bangor Finance
Office.  www.bangor.ac.uk