BackupPC-users

Re: [BackupPC-users] how to examine progress of backup

2009-01-05 15:57:34
Subject: Re: [BackupPC-users] how to examine progress of backup
From: Adam Goryachev <mailinglists AT websitemanagers.com DOT au>
To: "General list for user discussion, questions and support" <backuppc-users AT lists.sourceforge DOT net>
Date: Tue, 06 Jan 2009 07:55:00 +1100
-----BEGIN PGP SIGNED MESSAGE-----
Hash: SHA1

Les Mikesell wrote:
> Matthias Meyer wrote:
>> I use rsyncd to backup both, windows as well as linux clients.
>> Is it possible to examine or calculate the progress of an actual running
>> backup?
>
> No, gnu tar has a way to get an estimate of the size of an incremental
> run that amanda uses to help compute what will fit on a tape, but rsync
> doesn't have an equivalent.
>
>> One Idea would be to calculate the duration of the last backups and assume
>> the actual backup will have the same performance. But this can be wrong if
>> some new (big) files had been added.
>> Another Idea is to examine the filespace of the share and calculate the
>> estimated duration based on the last transfer rates. But this can be wrong
>> if some (big) files are in the exclusion list.
>>
>> Any Ideas?
>
> I don't think it is even possible to guess how much rsync will transfer
> on a changed file without running through the whole comparison.
rsync does have --progress which I find very useful, this at least
displays how many files need to be looked at, and how many are left to
examine. It is a better indication than nothing, but not exactly a
good time estimate... especially if the last files are very large
and/or with a large amount of changed data/new etc.

Personally, I would like it if this data could be collected by
backuppc and displayed in the log at least. ie, at the beginning of
the log it could store how many files should get looked at, and when
it fails part way, it can display how many files it has done, and how
many are left

Also this could be shown on the status page... In fact, the status
page could even show some additional interpreted data such as
"Building file list", and "File transfer in progress" or better "File
1234 of 2344 in progress", a bw rate over the past 60 secs would also
be nice (to know it hasn't stalled when it shows the same file number
for a long period of time).

Of course, if you do this for rsync, then everyone will want the same
features for tar/smb/ftp/etc...

Regards,
Adam
-----BEGIN PGP SIGNATURE-----
Version: GnuPG v1.4.6 (GNU/Linux)
Comment: Using GnuPG with Mozilla - http://enigmail.mozdev.org

iD8DBQFJYnOkGyoxogrTyiURAoREAKC3nwPdgrnQ460OzW3by0R80qkPqQCfeW7F
fYGvnLL+kOeacmc4cWsSd5I=
=KI1u
-----END PGP SIGNATURE-----


------------------------------------------------------------------------------
_______________________________________________
BackupPC-users mailing list
BackupPC-users AT lists.sourceforge DOT net
List:    https://lists.sourceforge.net/lists/listinfo/backuppc-users
Wiki:    http://backuppc.wiki.sourceforge.net
Project: http://backuppc.sourceforge.net/