[LUNI] resuming large slow transfer

Mike Scott luni at pyewacket.org
Tue Aug 7 07:53:04 CDT 2007


I have used curl in the past to download big files (iso images of CD/DVD
install discs) and it did a decent job of resuming interrupted
downloads.  http://curl.haxx.se/

- Mike Scott


> -------- Original Message --------
> Subject: Re: [LUNI] resuming large slow transfer
> From: Mark Stuart Burge <mark at msbrepairs.com>
> Date: Tue, August 07, 2007 8:44 am
> To: Linux Users Of Northern Illinois - Technical Discussion
> <luni at luni.org>
> 
> I have a windows solution that might prompt a linux way of doing the 
> same thing ...
> 
> In the 'old' days, we used to use winzip to compress a large file into 
> several smaller floppy images
> 
> You could try something similar perhaps with one of the linux archiving 
> tools.
> Compress and fragment the file into a bunch of smaller files, then try 
> again, but build a shell script to send each one individually.
> 
> 
> 
> 
> sten wrote:
> > I'm attempting to scp a large amount of data (~8GB) to a friend's house.
> > We're both on Comcast, and my upload rate is a measly 45KB on a good day.
> > I'd sneaker-net it, but I keep forgetting, and at least this way it gets
> > done. 
> >
> > Or not. 
> >
> > Since my link falls over about every 36 hours, I tried doing  rsync -r
> > --partial --progress to pick up where I left off. When I do this over my
> > wifi link from PC to PC, I get ~12MB/s on partial files vs the normal ~2.2,
> > I'm assuming because rsync is jut doing a sanity check to make sure all the
> > data is where it should be. However, when I do the same over the external
> > line, I see no speed gain at all; its like I'm just transferring the files
> > all over again. I tried using a --size-only, first in addition to
> > --partial, then in place of it, to avoid sending files I've already sent,
> > but that doesn't appear to help. Any suggestions on getting this stuff
> > across? 
> >
> > Thanks!
> >
> > Sten
> >
> >   
> -- 
> Linux Users Of Northern Illinois - Technical Discussion 
> http://luni.org/mailman/listinfo/luni



More information about the luni mailing list