Hi,
Les Mikesell wrote on 2013-04-12 15:05:27 -0500 [Re: [BackupPC-users] Stuck in
a loop??????]:
> On Fri, Apr 12, 2013 at 2:31 PM, Gregory Malsack
> <gmalsack AT coastalacq DOT com> wrote:
> >
> > Been having problems with BackupPC backing up our primary storage server
> > using rsync. It seems to run, but is taking a ridiculous long time, so I'm
> > not sure if it's really working. [...]
> > Thus with 2gb of bandwidth I wouldn't expect it to take hours on top of
> > hours to backup 1.6tb...
really? I would. You don't mention how fast your storage system is, but a
quick estimation gives me 4.66 hours at a sustained data rate of 100MB/s just
to *read* the data from a source disk, and that is not doing anything with the
data yet (filesystem overhead, calculate block checksums, build directory
tree, network *latency* - raw throughput is not the whole story, compress
files on the server, etc.). I doubt your bottleneck is the network, and that's
the only thing you've given details on. 1.6 TB is a *lot* of data. You
shouldn't forget that.
> > [...]
> > write(7,
> > "x^\355\3201\1\0\0\0\302\240\365Om\f\37\210@a\300\200\1\3\6\f\0300`\300\200\1\3"...,
> > 82371) = 82371
>
> It does seem to be reading/writing the same blocks.
We see the first few bytes of 80 KiB (for each syscall). That's not really
much to base a comparison on. What would an rsync directory tree exchange look
like? What does a normal data exchange look like?
> Might be worth an fsck to see if the underlying filesystem is corrupted.
That can't hurt in any case.
> Or maybe the file it is working on holds some repeated
> data.
I haven't seen anything surprising so far. How long have you let it run? Does
it complete eventually if you just give it a few days?
Regards,
Holger
------------------------------------------------------------------------------
Precog is a next-generation analytics platform capable of advanced
analytics on semi-structured data. The platform includes APIs for building
apps and a phenomenal toolset for data science. Developers can use
our toolset for easy data analysis & visualization. Get a free account!
http://www2.precog.com/precogplatform/slashdotnewsletter
_______________________________________________
BackupPC-users mailing list
BackupPC-users AT lists.sourceforge DOT net
List: https://lists.sourceforge.net/lists/listinfo/backuppc-users
Wiki: http://backuppc.wiki.sourceforge.net
Project: http://backuppc.sourceforge.net/
|
