BackupPC-users

Re: [BackupPC-users] Usage of BackupPC in large environment

2015-02-28 23:24:42
Subject: Re: [BackupPC-users] Usage of BackupPC in large environment
From: Les Mikesell <lesmikesell AT gmail DOT com>
To: "General list for user discussion, questions and support" <backuppc-users AT lists.sourceforge DOT net>
Date: Sat, 28 Feb 2015 22:22:55 -0600
On Sat, Feb 28, 2015 at 6:26 PM, Andrea Carpani
<andrea.carpani AT dnshosting DOT it> wrote:
> Thank you for your input.
>
> I'm a bit worried about the performance of the data structure used to
> back up file attributes: if I understand correctly everything is written
> in files inside a directory structure. Anyway I'll make some tests and
> I'll see.
>

Filesystems aren't such a bad place to store data...   But when
testing, keep in mind that your capacity will really depend on the
rate of change of the target data.   That is, when you use rsync you
only transfer the changes - but there are some quirks to consider.
One is that on full runs, all of the data is read for a block-checksum
comparision which can take a long time even though only the changes
are transferred, so you may need to skew the days when fulls happen by
adding systems on different days.   Another is that using the
--checksum-seed option caches and avoids the need to compute the block
checksums on the server side which will save some time but it only
takes effect on the 3rd full run.   Also, large files with random
small changes can take a long time to copy because the server has to
uncompress and merge the data from the original copy with the changes
sent by the remote.

-- 
   Les Mikesell
    lesmikesell AT gmail DOT com

------------------------------------------------------------------------------
Dive into the World of Parallel Programming The Go Parallel Website, sponsored
by Intel and developed in partnership with Slashdot Media, is your hub for all
things parallel software development, from weekly thought leadership blogs to
news, videos, case studies, tutorials and more. Take a look and join the 
conversation now. http://goparallel.sourceforge.net/
_______________________________________________
BackupPC-users mailing list
BackupPC-users AT lists.sourceforge DOT net
List:    https://lists.sourceforge.net/lists/listinfo/backuppc-users
Wiki:    http://backuppc.wiki.sourceforge.net
Project: http://backuppc.sourceforge.net/