Boston Linux & UNIX was originally founded in 1994 as part of The Boston Computer Society. We meet on the third Wednesday of each month, online, via Jitsi Meet.

BLU Discuss list archive


[Date Prev][Date Next][Thread Prev][Thread Next][Date Index][Thread Index]

[Discuss] large log file transfer



Maybe he wants the file to appear smaller for other reasons?  It is ?restricted? to quote the op.

Eric Chadbourne
Nonprofit-CRM.org

> On Jun 23, 2015, at 11:17 AM, Mike Small <smallm at panix.com> wrote:
> 
> John Malloy <jomalloy at gmail.com> writes:
> 
>> I have a log file (325MB)  that I need to transfer from a restricted
>> network, that I cannot plug a USB into.
>> 
>> Is there an easy way to "split up" the log file into smaller chunks and Zip
>> it to get it over the net?
> 
> So Jerry and Jack have pointed you to split, but why do you want to
> split it into chunks?
> 
> I must admit I've not dealt with any networks lately that I couldn't
> reliably download a 300 MB file on, but is it not still possible to
> resume interrupted transfers?  Are you using vanilla ftp, http or scp?
> 
> If you're using scp, I'd be inclined not to zip it but to use ssh's
> compression so when it finally does arrive I wouldn't have to unzip and
> then again find something else to do while that happens. But I guess scp
> doesn't support resume (hmmm, maybe ssh dd and adjust the offset based
> on the file size after the failure? -- perhaps that's more trouble than
> splitting).
> 
> By "restricted network" do you mean that rsync is not an option?
> 
> -- 
> Mike Small
> smallm at panix.com
> _______________________________________________
> Discuss mailing list
> Discuss at blu.org
> http://lists.blu.org/mailman/listinfo/discuss




BLU is a member of BostonUserGroups
BLU is a member of BostonUserGroups
We also thank MIT for the use of their facilities.

Valid HTML 4.01! Valid CSS!



Boston Linux & Unix / webmaster@blu.org