ftp directory mirror via squid

Bob Gorman bob at rsi.com
Tue Jul 12 13:34:57 EDT 2005


At 11:03 AM 7/11/2005, Bob Gorman wrote:
>Quick question... when doing ftp via wget through a squid proxy server, how can one do a recursive directory mirror?
>
>        export ftp_proxy=http://proxy.my.com:3128
>        wget -m ftp://apt.sw.be/pub/dag/redhat/el4/en/i386/dag/
>
>And one gets a nice html file instead of the directory structure.
>
>Is there an easy way to work around this?  Or is there a better, simple, command line tool for doing an ftp mirror via squid?

I was able to use lftp for this.

lftp -c '
        set ftp:sync-mode 0
        set ftp:proxy http://proxy.my.com:3128
        mirror ftp://apt.sw.be/pub/dag/redhat/el4/en/i386/dag/
        '

The disabling synchronous issuing of ftp commands allowed lftp to run (about 8) concurrent ftp connections through squid.  Nice!




More information about the Discuss mailing list