Command Line http request

William Oldfield wroldfie at library.uwaterloo.ca
Wed Jan 29 14:53:43 EST 1997


Thank you everyone for your help and particularly MacKenzie Smith  and
Thomas 
Dowling.

I simply collected the filenames in a file and then used the -source
option in lynx to retrieve and append the files into one large file.

The little script is below for anyone interested. Thanks again.        

-------------------------------------
#!/bin/sh 
# Script to retrieve automatically a series of files through http 
# names of files contained on separate lines in filelist
clear 
# cat the file containing the filenames you wish to retrieve
cat /path/filelist/ |\   
while read line 
do 
# use lynx -source option and  the URL of the source and the filename
lynx -source url/$line >> recs 
# echo so I know something is happening
echo $line 
done       


William Oldfield (Networked Information Research Associate)
University of Waterloo Library
(519) 888-4567 Ext 2461  wroldfie at library.uwaterloo.ca
http://www.lib.uwaterloo.ca/~wroldfie/home.html



More information about the Web4lib mailing list