On Mon, Mar 9, 2015 at 2:28 AM, Andrea Carpani
<andrea.carpani AT dnshosting DOT it> wrote:

> is there an easy way to parallelize the rsync operations on the host to
> beckup?
>
> Here's my problem: the host I need to back up has a /home of about 300Gb
> full of really small files (10 millions maybe). Each scan of the file
> system takes a really long time. The storage I use for it, though, is
> quite fast and has a lot of disks, thus parallelizing the operations
> (say, 1 rsync for each user under /home/* and 10 parallel threads) would
> ideally shorten the scan time by a factor of 10 given a powerful enough
> backup server.
>
> I know I could create several backuppc "hosts" all pointing to the same
> hostname, and one backs up a subset of users, but maybe there's some
> other parameter I could use.

One thing you get from dividing into fake hosts that I don't think you
can do any other way is to be able to skew the full runs of different
sections to different days.  Fulls are the slowest operation because
even with rsync and checksum-seed, the target side has to do a full
read of all the data.

-- 
   Les Mikesell
     lesmikesell AT gmail DOT com

------------------------------------------------------------------------------
Dive into the World of Parallel Programming The Go Parallel Website, sponsored
by Intel and developed in partnership with Slashdot Media, is your hub for all
things parallel software development, from weekly thought leadership blogs to
news, videos, case studies, tutorials and more. Take a look and join the 
conversation now. http://goparallel.sourceforge.net/
_______________________________________________
BackupPC-users mailing list
BackupPC-users AT lists.sourceforge DOT net
List:    https://lists.sourceforge.net/lists/listinfo/backuppc-users
Wiki:    http://backuppc.wiki.sourceforge.net
Project: http://backuppc.sourceforge.net/