[Web4lib] http batch downloader that will submit cookies and post data

[John Fereira]

Galen Charlton wrote:
> Hi,
>
> On Tue, Aug 25, 2009 at 6:50 AM, John
> Fitzgibbon<jfitzgibbon at galwaylibrary.ie> wrote:
>   
>> This will not work if the site requires a cookie to be submitted each time. None of the downloaders I have tried will submit a cookie. Is there a downloader that will do this?
>>     
>
> If you have access to a Unix environment such as Linux or Cygwin, both
> wget [1] and curl [2] have the ability to store and submit cookies.
>
> [1] http://www.gnu.org/software/wget/
> [2] http://curl.haxx.se/
>   
You can also get curl support through a PHP extension.  If you've got 
PHP installed, whether it's in a unix or windows environment, you can 
invoke the curl module as a function call instead of through the command 
line which is probably a good idea if you're going to be parsing the 
results anyway.

> Regards,
>
> Galen
>