FW: [Web4lib] http batch downloader that will submit cookies and postdata

Brown, Alan A.Brown at bury.gov.uk
Wed Aug 26 05:35:10 EDT 2009

At 25 August 2009 12:58 Galen Charlton wrote:

> On Tue, Aug 25, 2009 at 6:50 AM, John
> Fitzgibbon<jfitzgibbon at galwaylibrary.ie> wrote:
>> This will not work if the site requires a cookie to be submitted
>> each time. None of the downloaders I have tried will submit a
>> cookie. Is there a downloader that will do this?  
> If you have access to a Unix environment such as Linux or Cygwin,
> both wget [1] and curl [2] have the ability to store and submit
> cookies.  
> [1] http://www.gnu.org/software/wget/
> [2] http://curl.haxx.se/

Similarly, if you want to build one you could use LWP with perl, you can
get this with Activeperl for windows.



Alan Brown
Library Systems Liaison Officer
Resource Services
Bury Libraries
Textile Hall
Manchester Rd
Tel 0161 253 5877
Fax 0161 253 6003
4* Excellent Council
Bury Council is now rated as a four star 'excellent' council by the Audit Commission.
This rating recognises the council's commitment to providing first class services
and providing good value for money.
Why not visit our website www.bury.gov.uk
Incoming and outgoing e-mail messages are routinely monitored for compliance
with our information security policy.
The information contained in this e-mail and any files transmitted
with it is for the intended recipient(s) alone. It may contain
confidential information that is exempt from the disclosure under
English law and may also be covered by legal,professional or other privilege.
If you are not the intended recipient, you must not copy, distribute or take any
action in reliance on it. 
If you have received this e-mail in error, please notify us immediately by using 
the reply facility on your e-mail system.
If this message is being transmitted over the Internet, be aware that it may be 
intercepted by third parties.
As a public body, the Council may be required to disclose this e-mail or any 
response to it under the Freedom of Information Act 2000 unless the information
in it is covered by one of the exemptions in the Act.  
Electronic service accepted only at legalservices at bury.gov.uk and on fax number 
0161 253 5119 .

More information about the Web4lib mailing list