BackupPC-users

Re: [BackupPC-users] Backing up many, many files over a medium speed link - kills CPU and fails halfway. Any help?

2009-11-24 22:22:33
Subject: Re: [BackupPC-users] Backing up many, many files over a medium speed link - kills CPU and fails halfway. Any help?
From: Adam Goryachev <mailinglists AT websitemanagers.com DOT au>
To: "General list for user discussion, questions and support" <backuppc-users AT lists.sourceforge DOT net>
Date: Wed, 25 Nov 2009 14:19:12 +1100
-----BEGIN PGP SIGNED MESSAGE-----
Hash: SHA1

GB wrote:
> Hi,
>
> Thanks for the reply. The data is, in fact, "all time" in the sense that
> it goes back years, but it's sorted by filename, rather than date; it's
> essentially equivalent to how BackupPC stores data in cpool/, i.e. the
> first 3 characters of the filename will generate 3 levels of
> subdirectories. The best I was able to do, to date, was to make 10
> shares, 1-9, and back up 10 separate backup trees. But that was before,
> when I had about 100k files... I tried this recently, and seem to have
> made it go under. So I guess I'd need to make TWO levels of shares, so
> 1/0-1/9, 2/0-2/9, etc. Then, maybe, once I go through the full loop,
> it'll be easier to perform future incrementals since the delta will be
> small.
>
> My BackupPC box doesn't swap too much, it doesn't behave like it's under
> massive load at all; but then again, I think my IO subsystem (Dell Perc6
> + 4x WD Greens in RAID5) hopefully outperforms the speed of the link+any
> overhead :) I haven't tried stracing rsync on the remote server. Any
> suggestions on how to use it? I've never tried it before.

Also check for memory usage on the remote server... if it runs out of
memory then you will have the same issue.

Also, memory is very handy for cache on both sender and receiver...

Regards,
Adam

- --
Adam Goryachev
Website Managers
www.websitemanagers.com.au
-----BEGIN PGP SIGNATURE-----
Version: GnuPG v1.4.9 (GNU/Linux)
Comment: Using GnuPG with Mozilla - http://enigmail.mozdev.org

iEYEARECAAYFAksMojAACgkQGyoxogrTyiWF8ACghh947yJcm24V09bI8m9xWavy
l20An28v3TXbDAULBpjP1Ez5uw4sd5o4
=EYFQ
-----END PGP SIGNATURE-----

------------------------------------------------------------------------------
Let Crystal Reports handle the reporting - Free Crystal Reports 2008 30-Day 
trial. Simplify your report design, integration and deployment - and focus on 
what you do best, core application coding. Discover what's new with
Crystal Reports now.  http://p.sf.net/sfu/bobj-july
_______________________________________________
BackupPC-users mailing list
BackupPC-users AT lists.sourceforge DOT net
List:    https://lists.sourceforge.net/lists/listinfo/backuppc-users
Wiki:    http://backuppc.wiki.sourceforge.net
Project: http://backuppc.sourceforge.net/