ftp directory mirror via squid
Bob Gorman
bob at rsi.com
Tue Jul 12 13:34:57 EDT 2005
At 11:03 AM 7/11/2005, Bob Gorman wrote:
>Quick question... when doing ftp via wget through a squid proxy server, how can one do a recursive directory mirror?
>
> export ftp_proxy=http://proxy.my.com:3128
> wget -m ftp://apt.sw.be/pub/dag/redhat/el4/en/i386/dag/
>
>And one gets a nice html file instead of the directory structure.
>
>Is there an easy way to work around this? Or is there a better, simple, command line tool for doing an ftp mirror via squid?
I was able to use lftp for this.
lftp -c '
set ftp:sync-mode 0
set ftp:proxy http://proxy.my.com:3128
mirror ftp://apt.sw.be/pub/dag/redhat/el4/en/i386/dag/
'
The disabling synchronous issuing of ftp commands allowed lftp to run (about 8) concurrent ftp connections through squid. Nice!
More information about the Discuss
mailing list