[WEB4LIB] tools for creating subject specific search engine

[Avi Rappoport]

For free large search engines, it's hard to go wrong with ht://Dig. 
I've seen posts from people with humongous indexes, in the 2 GB 
range, and the speed still seems OK.  It's got a great group of 
developers and is very much a successful open source effort.  For 
more info, try <http://www.htdig.org/>.

For more info on available site, intranet and portal search engines, 
see my pages at <http://www.searchtools.com/>.

Avi

At 5:48 PM -0700 8/5/1999, glen.davies at cce.ac.nz wrote:
>Hi
>
>I would be interested in hearing what tools people are using to
>create subject specific search engines.
>I am using Thunderstones free webinator at the moment to run a
>very small search engine indexing about 15 sites. I would like to
>expand it but free webinator will only index a maximum of 10,000
>docs, so I am wanting to investigate the other options available,
>preferably in the free, gnu arena.
>
>I have tried htdig, swish-e, alkaline, and will also have a look at
>Combine and Harvest when time permits. Any other options that
>people are using?
>
>Thanks
>Regards
>Glen
________________________________________________________________
Avi Rappoport, Search Tools Maven: <mailto:avirr at lanminds.com>
Guide to Site Indexing and Local Search Engines: <http://www.searchtools.com>