BackupPC-users

Re: [BackupPC-users] Converting whole v3 repository to v4?

2017-03-09 10:37:21
Subject: Re: [BackupPC-users] Converting whole v3 repository to v4?
From: Michael Huntley <michael AT huntley DOT net>
To: "General list for user discussion, questions and support" <backuppc-users AT lists.sourceforge DOT net>
Date: Thu, 09 Mar 2017 07:35:48 -0800

Will do!

 


On 2017-03-08 22:34, Craig Barratt wrote:

Mph,
 
I probably will write a script that implements the hybrid upgrade, so even if you archive your V3 backups, please keep some of them around for testing :).
 
Craig

On Wed, Mar 8, 2017 at 7:55 AM, Michael Huntley <michael AT huntley DOT net> wrote:

Oh those pesky deltas!

I slept on it; it's better to make a break with the past.  I'm going to tar up the old data+hardlinks and put it to cold storage.

Time is a finite resource so I'd rather move forward than get stuck in the weeds of the past.

 

Pavel - have you considered using tar+tape to archive your data?  I deal with CPA's and lawyers so everything must be saved basically forever but it doesn't mean the data must be instantly available. Just a thought.

Cheers!

mph

On 2017-03-07 23:19, Craig Barratt wrote:

There are two options to implement this:
  • truly convert v3 backups to v4 format.  This is quite complex since forward deltas (ie, incrementals) would have to be converted into reverse deltas; there are lots of cases to consider and testing them all would take a lot of time.  The effort and risk (of messing up an old backup) doesn't seem worth it. 
  • hybrid - convert just the backup storage from V3 to V4, but keep the V3 logical dependency (ie: replace the V3 attrib file + hardlinks in each directory with just a V4 attrib file).  This is a good bit easier and lower risk, as each directory can be updated in a self-contained manner.  The testing would need to ensure that V3 viewing / restore etc works with this hybrid storage.
If there is enough interest I would consider implementing the hybrid approach.  But I'm working on rsync-bpc-3.1.2 right now.
 
Craig

On Tue, Mar 7, 2017 at 6:41 PM, Michael Huntley <michael AT huntley DOT net> wrote:

Hi Craig - 

among the billion other things to do in life - is this reasonably possible?  I looked at the perl and came to the considered conclusion, I'm just not a perl guy.  However, it would be great to convert older backups to v4 - that would reduce my workload on BTRFS snapshops, etc.  No hardlinks makes moving large sums of data so much easier......

 

2cents.....

mph

On 2017-03-06 01:58, Pavel Hofman wrote:

Hello,

please is it possible somehow to script the BackupPC_backupDuplicate
tool to be able to convert not only the last v3 backup to v4, but also
all previous backups? I would run the script in the background.

The intention is migrating from XFS to ZFS for server consolidation and
I am afraid I need to get rid of the hardlinks in the 10 yrs of
historical backups.

I have read about running an arbitrary filesystem over ZFS block device,
but  I am afraid of poor performance.

Thanks a lot.

Best regards,

Pavel.

------------------------------------------------------------------------------
Check out the vibrant tech community on one of the world's most
engaging tech sites, SlashDot.org! http://sdm.link/slashdot
_______________________________________________
BackupPC-users mailing list
[email protected]ge.net
List:    https://lists.sourceforge.net/lists/listinfo/backuppc-users
Wiki:    http://backuppc.wiki.sourceforge.net
Project: http://backuppc.sourceforge.net/

------------------------------------------------------------------------------
Announcing the Oxford Dictionaries API! The API offers world-renowned
dictionary content that is easy and intuitive to access. Sign up for an
account today to start using our lexical data to power your apps and
projects. Get started today and enter our developer competition.
http://sdm.link/oxford
_______________________________________________
BackupPC-users mailing list
[email protected]ge.net
List:    https://lists.sourceforge.net/lists/listinfo/backuppc-users
Wiki:    http://backuppc.wiki.sourceforge.net
Project: http://backuppc.sourceforge.net/

------------------------------------------------------------------------------
Announcing the Oxford Dictionaries API! The API offers world-renowned
dictionary content that is easy and intuitive to access. Sign up for an
account today to start using our lexical data to power your apps and
projects. Get started today and enter our developer competition.
http://sdm.link/oxford

_______________________________________________
BackupPC-users mailing list
BackupPC-users@lists.sourceforge.net
List:    https://lists.sourceforge.net/lists/listinfo/backuppc-users
Wiki:    http://backuppc.wiki.sourceforge.net
Project: http://backuppc.sourceforge.net/

------------------------------------------------------------------------------
Announcing the Oxford Dictionaries API! The API offers world-renowned
dictionary content that is easy and intuitive to access. Sign up for an
account today to start using our lexical data to power your apps and
projects. Get started today and enter our developer competition.
http://sdm.link/oxford
_______________________________________________
BackupPC-users mailing list
BackupPC-users@lists.sourceforge.net
List:    https://lists.sourceforge.net/lists/listinfo/backuppc-users
Wiki:    http://backuppc.wiki.sourceforge.net
Project: http://backuppc.sourceforge.net/

------------------------------------------------------------------------------
Announcing the Oxford Dictionaries API! The API offers world-renowned
dictionary content that is easy and intuitive to access. Sign up for an
account today to start using our lexical data to power your apps and
projects. Get started today and enter our developer competition.
http://sdm.link/oxford

------------------------------------------------------------------------------
Announcing the Oxford Dictionaries API! The API offers world-renowned
dictionary content that is easy and intuitive to access. Sign up for an
account today to start using our lexical data to power your apps and
projects. Get started today and enter our developer competition.
http://sdm.link/oxford
_______________________________________________
BackupPC-users mailing list
BackupPC-users AT lists.sourceforge DOT net
List:    https://lists.sourceforge.net/lists/listinfo/backuppc-users
Wiki:    http://backuppc.wiki.sourceforge.net
Project: http://backuppc.sourceforge.net/