I'm working with remote backups of large files, and found a solution that
can be used when the backup file is quite similar to the previous one.
I think that it could be used to send by rsync large backups of virtual disks.
Basically, you have to:
* gzip --rsyncable today_backup_file (very important to use --rsyncable)
* rollcut -d 65536 today_backup_file.gzip
* dupemerge backup_folder (deduplication using hardlinks)
* use backuppc and rsync to remote backup your backup_folder
Rollcut is a tool that I've done to cut similar large files, into several small
chunks with a hig probability of some being equal.
After using rollcut, you deduplicate all the small chunks, using hardlinks.
So, every chunk that is the same of one of the previous ones, will be
hardlinked locally.
As rsync knows about hardlinks, after the first backup all the hardlinked
chunks will not have to be send over the network.
You can find more information, and download rollcut in
https://github.com/ferfebles/rollcut
------------------------------------------------------------------------------
Live Security Virtual Conference
Exclusive live event will cover all the ways today's security and
threat landscape has changed and how IT managers can respond. Discussions
will include endpoint security, mobile security and the latest in malware
threats. http://www.accelacomm.com/jaw/sfrnl04242012/114/50122263/
_______________________________________________
BackupPC-users mailing list
BackupPC-users AT lists.sourceforge DOT net
List: https://lists.sourceforge.net/lists/listinfo/backuppc-users
Wiki: http://backuppc.wiki.sourceforge.net
Project: http://backuppc.sourceforge.net/
|