[Web4lib] Home-brewed link checkers?

[Randy Norwood]

I've written a few variations of a script that uses LWP (and some other
modules) to do link checking. The simplest uses only LWP and is about 15
lines long, and is used when one is given a list of URLs to check (i.e., no
need to traverse a set of web pages).

Another one is used to search through the content of my library's website,
stored in a MySQL database, to extract links, check them and then populate
another MySQL table containing the website's links. This uses LWP,
HTML::LinkExtor, URI::URL (and of course DBI for the database interface).

In general, if you're link checking live web pages on a server, some of the
free or commercial products mentioned earlier would be more than adequate.
The scripts I wrote were meant for some specialized needs.


-- 
~~~~~~~~~~~~~~~~~~~~~~~~~~~
Randy Norwood
Web  Manager
Texas Tech University Libraries
Office: 806-742-2238  x236
Fax: 806-742-8669
E-mail: randy.norwood at ttu.edu






On 07/01/05 6:56 PM, "K.G. Schneider" <kgs at bluehighways.com> wrote:

> Have any of you cooked up your own link checkers? Maybe using something
> based on LWP::UserAgent..? If so I'd like to talk to you. Or have you used
> this one...
> 
> http://www.oreilly.com/openbook/webclient/ch06.html#30995
> 
> thanks,
> 
> Karen G. Schneider
> kgs at bluehighways.com
> 
> _______________________________________________
> Web4lib mailing list
> Web4lib at webjunction.org
> http://lists.webjunction.org/web4lib/