BackupPC-users

Re: [BackupPC-users] Backup of VM images

2011-06-03 10:22:59
Subject: Re: [BackupPC-users] Backup of VM images
From: Adam Goryachev <mailinglists AT websitemanagers.com DOT au>
To: "General list for user discussion, questions and support" <backuppc-users AT lists.sourceforge DOT net>
Date: Sat, 04 Jun 2011 00:20:53 +1000
-----BEGIN PGP SIGNED MESSAGE-----
Hash: SHA1

On 03/06/11 22:54, Andrew Schulman wrote:
>> I'm about to set up a remote backup server to backup images of virtual
>> machines.
>>
>> What would the data transfer be (after the intial "sneakernet" transfer)
>> when a remote image gets updated/changed? Filename would not change, but
>> contents and maybe size would.
> 
> An entire new copy of that day's VM disk image will be created each day.
> BackupPC doesn't compute or store diffs, if that's what you were thinking.
> All it can do is store a new copy of the entire disk image, if even one
> byte has changed in it.
> 
> This is likely to be infeasible unless you have a very large amount of
> storage and transfer bandwidth.  When I set up BackupPC I quickly realized
> that the daily VM images were going to consume all of my backup storage in
> a very short time, so I added rules to exclude all of them.
> 
> The fallback strategy is to configure each VM internally as a BackupPC
> client.

Great suggestion, backing up the VM's as if they were normal clients...
Another option that I do sometimes (not just with VM images, but also
dumps/exports from SQL server or mysql or other proprietary software, is
to get the single large file and split it into a directory with a number
of smaller files. Then let backuppc backup this directory. Thus, in the
normal case where most of the parts don't change, then most of the parts
don't consume extra space in backuppc. Also, I found backups to be
faster, and the rsync protocol to be more efficient (both in bandwidth
consumption and run time) by doing it this way.

Your mileage might vary... one thing I do suggest is to monitor in some
way that your directory of files is actually being updated with the most
recent backup.... This can catch you unawares if your split script is
failing :)

Regards,
Adam

- -- 
Adam Goryachev
Website Managers
www.websitemanagers.com.au
-----BEGIN PGP SIGNATURE-----
Version: GnuPG v1.4.11 (GNU/Linux)
Comment: Using GnuPG with Mozilla - http://enigmail.mozdev.org/

iEYEARECAAYFAk3o7aIACgkQGyoxogrTyiVPbACfRX55Q/e8qSDzNKDEZmzTQnsI
CZEAoMLo3sAFSvOg6XTpJ8A2QLwMJ+tu
=Spa4
-----END PGP SIGNATURE-----

------------------------------------------------------------------------------
Simplify data backup and recovery for your virtual environment with vRanger.
Installation's a snap, and flexible recovery options mean your data is safe,
secure and there when you need it. Discover what all the cheering's about.
Get your free trial download today. 
http://p.sf.net/sfu/quest-dev2dev2 
_______________________________________________
BackupPC-users mailing list
BackupPC-users AT lists.sourceforge DOT net
List:    https://lists.sourceforge.net/lists/listinfo/backuppc-users
Wiki:    http://backuppc.wiki.sourceforge.net
Project: http://backuppc.sourceforge.net/