BackupPC-users

Re: [BackupPC-users] What is the meaning of "repeated", "max chain" and "max links" in the logfile?

2009-08-13 09:59:58
Subject: Re: [BackupPC-users] What is the meaning of "repeated", "max chain" and "max links" in the logfile?
From: "Jeffrey J. Kosowsky" <backuppc AT kosowsky DOT org>
To: "General list for user discussion, questions and support" <backuppc-users AT lists.sourceforge DOT net>
Date: Thu, 13 Aug 2009 09:56:21 -0400
Craig Barratt wrote at about 00:47:09 -0700 on Thursday, August 13, 2009:
 > Matthias writes:
 > 
 > > Every day I get a message in __LOGDIR__/LOG:
 > > 2009-08-12 02:35:49 Cpool is 322.19GB, 1142028 files (860 repeated, 31 max 
 > > chain, 11424 max links), 4369 directories
 > > 
 > > What is the meaning of:
 > > repeated
 > 
 > The total number of pool files with hash collisions.  Since the hash is
 > not computed over the entire file contents, it's common to get files with
 > the same hash.
 > 
 > > max chain
 > 
 > The biggest set of pool files with the same hash.  This is a potential
 > performance bottleneck if the number gets too large, since a incoming
 > file needs to be matched against every pool file in the chain.  That
 > means each file is O(n), and n files from a full backup all with the
 > same hash takes O(n^2) comparisons.  So it's a problem when this number
 > gets too big.
 > 

Just as a reminder back to another thread regarding the advantages of
storing the full md5sum in the envelope is that instead of O(n^2)
byte-byte comparisons, one would only have to do O(n^2) md5sum
comparisons or potentially none (or just a filesystem lookup which you
have to do anyway) if the full file md5sum is used as the index.

 > > max links
 > 
 > The maximum number of hardlinks on any pool file.  The minimum is
 > 2 (anything with 1 is deleted since it is no longer used).  This
 > means that across all your backups you have one file that appears
 > 11424 times.
 > 
 > Craig
 > 
 > ------------------------------------------------------------------------------
 > Let Crystal Reports handle the reporting - Free Crystal Reports 2008 30-Day 
 > trial. Simplify your report design, integration and deployment - and focus 
 > on 
 > what you do best, core application coding. Discover what's new with 
 > Crystal Reports now.  http://p.sf.net/sfu/bobj-july
 > _______________________________________________
 > BackupPC-users mailing list
 > BackupPC-users AT lists.sourceforge DOT net
 > List:    https://lists.sourceforge.net/lists/listinfo/backuppc-users
 > Wiki:    http://backuppc.wiki.sourceforge.net
 > Project: http://backuppc.sourceforge.net/
 > 

------------------------------------------------------------------------------
Let Crystal Reports handle the reporting - Free Crystal Reports 2008 30-Day 
trial. Simplify your report design, integration and deployment - and focus on 
what you do best, core application coding. Discover what's new with 
Crystal Reports now.  http://p.sf.net/sfu/bobj-july
_______________________________________________
BackupPC-users mailing list
BackupPC-users AT lists.sourceforge DOT net
List:    https://lists.sourceforge.net/lists/listinfo/backuppc-users
Wiki:    http://backuppc.wiki.sourceforge.net
Project: http://backuppc.sourceforge.net/

<Prev in Thread] Current Thread [Next in Thread>