Command Line http request
William Oldfield
wroldfie at library.uwaterloo.ca
Wed Jan 29 14:53:43 EST 1997
Thank you everyone for your help and particularly MacKenzie Smith and
Thomas
Dowling.
I simply collected the filenames in a file and then used the -source
option in lynx to retrieve and append the files into one large file.
The little script is below for anyone interested. Thanks again.
-------------------------------------
#!/bin/sh
# Script to retrieve automatically a series of files through http
# names of files contained on separate lines in filelist
clear
# cat the file containing the filenames you wish to retrieve
cat /path/filelist/ |\
while read line
do
# use lynx -source option and the URL of the source and the filename
lynx -source url/$line >> recs
# echo so I know something is happening
echo $line
done
William Oldfield (Networked Information Research Associate)
University of Waterloo Library
(519) 888-4567 Ext 2461 wroldfie at library.uwaterloo.ca
http://www.lib.uwaterloo.ca/~wroldfie/home.html
More information about the Web4lib
mailing list