BackupPC-users

Re: [BackupPC-users] Splitting up large directories.

2010-05-18 17:27:43
Subject: Re: [BackupPC-users] Splitting up large directories.
From: Kameleon <kameleon25 AT gmail DOT com>
To: "General list for user discussion, questions and support" <backuppc-users AT lists.sourceforge DOT net>
Date: Tue, 18 May 2010 16:26:00 -0500
Why not just make backuppc take a week or so to traverse the entire pool using $Conf{BackupPCNightlyPeriod} = 7 or similar? Also you can use the rsync option to limit bandwidth so it won't kill their outbound connections using the --bwlimit=XX where XX is the speed in kB/sec to limit to.

On Tue, May 18, 2010 at 4:04 PM, Robin Lee Powell <rlpowell AT digitalkingdom DOT org> wrote:

A customer we're backing up has a directory with ~500 subdirs and
hundreds of GiB of data.  We're using BackupPC in rsync+ssh mode.

As a first pass at breaking that up, I made a bunch of seperate host
entries like /A/*0, /A/*1, ... (all the dirs have numeric names).

That seems to select the right files, but it doesn't work because
BackupPC ends up running a bunch of them at once, hammering that
customer's machine.

I could make those into share names, but I'm worried about running
out of command-line argument space in that case; that is, that
"rsync /A/*0" will at some point in the future expand to a hundred
or more directories and break.

What I want to do is have a bunch of shares like [ "/A", "/A", ...],
and have something like:

$Conf{BackupFilesOnly} = {
 "/A" => "/A/*0",
 "/A" => "/A/*1",
 "/A" => "/A/*2",
 }

But obviously that's not going to work.

Does anyone have any other way to handle this?

-Robin

--
http://singinst.org/ :  Our last, best hope for a fantastic future.
Lojban (http://www.lojban.org/): The language in which "this parrot
is dead" is "ti poi spitaki cu morsi", but "this sentence is false"
is "na nei".   My personal page: http://www.digitalkingdom.org/rlp/

------------------------------------------------------------------------------

_______________________________________________
BackupPC-users mailing list
BackupPC-users AT lists.sourceforge DOT net
List:    https://lists.sourceforge.net/lists/listinfo/backuppc-users
Wiki:    http://backuppc.wiki.sourceforge.net
Project: http://backuppc.sourceforge.net/

------------------------------------------------------------------------------

_______________________________________________
BackupPC-users mailing list
BackupPC-users AT lists.sourceforge DOT net
List:    https://lists.sourceforge.net/lists/listinfo/backuppc-users
Wiki:    http://backuppc.wiki.sourceforge.net
Project: http://backuppc.sourceforge.net/