[WEB4LIB] Frames and Search Engines

[Avi Rappoport]

At 10:43 AM -0800 2/12/2000, Spencer Gasson wrote:
>Currently working on a site redesign, hence working from home
>on a weekend :( 
>
>The site has grown to such an extent that a decision has been
>made to introduce frames to aid user navigation (we are also
>having a non-frames version in order to maintain access).
>
>The question I have is what is the best way of preventing search
>engines from indexing every page on the frames version?

robots.txt lets you specify which paths should not be indexed: see 
<http://info.webcrawler.com/mak/projects/robots/exclusion-admin.html> 
for details.

If you build non-framed and framed pages with separate paths into 
your site design, you're in good shape.

Avi
-- 
________________________________________________________________
Avi Rappoport, Search Tools Maven: <mailto:avirr at lanminds.com>
Guide to Site Indexing and Local Search Engines: <http://www.searchtools.com>