Hi,

On Tue, Jan 26, 2010 at 12:22:45PM -0000, PD Support wrote:

> We are going to be backing up around 30 MS-SQL server databases via ADSL to
> a number of regional servers running CentOS (about 6 databases per backup
> server). 10 sites are 'live' as of now and this is how we have started...
> 
> The backups are between about 800MB and 5GB at the moment and are made as
> follows:
> 
> 1) A stored procedure dumps the database to SiteName_DayofWeek.bak eg:
> SHR_Mon.bak
> 
> 2) We create a local ZIP copy eg: !BSHR_Mon.zip. The !B means the file is
> EXCLUDED from backing up and is just kept as a local copy, cycled on a
> weekly basis.
> 
> 3) We rename SHR_DayofWeek.bak to SiteName.bak
> 
> 4) We split the .bak file into 200MB parts (.part1 .part2 etc.) and these
> are synced to the backup server via backuppc
> 
> This gives us a generically-named daily backup that we sync
> (backupPC/rsyncd) up to the backup server nightly.
> 
> We split the files so that if there is a comms glitch during the backing up
> of the large database file and we end up with a part backup, the next
> triggering of the backup doesn't have to start the large file again - only
> the missing/incomplete bits.
> 
> Although the zip files are relatively small, we have found that their
> contents varies so much (bit-by-bit wise) on a  weekly cycle basis that they
> take a long time to sync so we leave them as local copies only.
> 
> Seems to work OK at the mo anyway!

You might want to try gzip --rsyncable instead of ZIP and see whether it
makes a difference. Because of the file splitting etc. I'd add a .md5
checksum file, just to be sure. Also, there is a tool which name I
cannot remember which allows you to split a file and generate an
additional error-correction file, so you get a bit of redundancy and
chances are higher to reconstruct the archive, even if a part is lost.

Disabling compression in BackupPC for these hosts might speed things up
since the files cannot be compressed anyway.

Tino.

-- 
"What we nourish flourishes." - "Was wir nähren erblüht."

www.lichtkreis-chemnitz.de
www.tisc.de

------------------------------------------------------------------------------
The Planet: dedicated and managed hosting, cloud storage, colocation
Stay online with enterprise data centers and the best network in the business
Choose flexible plans and management services without long-term contracts
Personal 24x7 support from experience hosting pros just a phone call away.
http://p.sf.net/sfu/theplanet-com
_______________________________________________
BackupPC-users mailing list
BackupPC-users AT lists.sourceforge DOT net
List:    https://lists.sourceforge.net/lists/listinfo/backuppc-users
Wiki:    http://backuppc.wiki.sourceforge.net
Project: http://backuppc.sourceforge.net/