BackupPC-users

Re: [BackupPC-users] Large file stalls backup

2008-04-11 14:49:21
Subject: Re: [BackupPC-users] Large file stalls backup
From: Adam Goryachev <adam AT websitemanagers.com DOT au>
To: David Birnbaum <davidb AT pins DOT net>
Date: Thu, 10 Apr 2008 14:27:06 +1000
-----BEGIN PGP SIGNED MESSAGE-----
Hash: SHA1

David Birnbaum wrote:
> Greetings,
> 
> I've been using BackupPC for several years now, but one problem that I've 
> never 
> come up with a good answer for is when a single large file is too big to 
> transfer completely in the time the backup can run before timing out.  For 
> example, a 10M local datafile, backing up over a 768k upstream DSL, ends up 
> stalling the backup because it can never get past that file.
> 
> Does anyone have a workaround or fix for this?  Is it possible to change 
> BackupPC so it doesn't remove the in-progress file, but instead copies it 
> into 
> the pool so rsync will pick up where it left off last time?  There doesn't 
> seem 
> to be any downside to leaving off on the transfer where it was.

It sounds like the only possible problem is that you may restore the
file thinking it is the last successful backup of the file, but really
it was only a partial copy of the file. Overall though, I think it is a
great idea. Especially on a initial backup where you might have a number
of large files being backed up that never succeed.

The only way I get around this is to massively increase the timeout
value, and set a bwlimit for rsync, and then let it run over however
many days it takes to complete the backup.

BTW, it would be *really* nice if when doing rsync backups we didn't
need to transfer the entire file even though it already exists in the
pool (ie, from a backup of another host).

Regards,
Adam

- --
Adam Goryachev
Website Managers
Ph: +61 2 8304 0000                            adam AT websitemanagers.com DOT 
au
Fax: +61 2 8304 0001                            www.websitemanagers.com.au

Please note, all email from me sent after August 2007 will be signed.
-----BEGIN PGP SIGNATURE-----
Version: GnuPG v1.4.6 (GNU/Linux)
Comment: Using GnuPG with Mozilla - http://enigmail.mozdev.org

iD8DBQFH/ZcaGyoxogrTyiURAvymAJ9BaAtvf9JbPFCGwQxcPZU7nSwGSQCfaKiv
VjUNAnJ79zDLy6dvkoBFato=
=ejGu
-----END PGP SIGNATURE-----

-------------------------------------------------------------------------
This SF.net email is sponsored by the 2008 JavaOne(SM) Conference 
Don't miss this year's exciting event. There's still time to save $100. 
Use priority code J8TL2D2. 
http://ad.doubleclick.net/clk;198757673;13503038;p?http://java.sun.com/javaone
_______________________________________________
BackupPC-users mailing list
BackupPC-users AT lists.sourceforge DOT net
List:    https://lists.sourceforge.net/lists/listinfo/backuppc-users
Wiki:    http://backuppc.wiki.sourceforge.net
Project: http://backuppc.sourceforge.net/