Tyler J. Wagner wrote at about 11:20:55 +0100 on Thursday, April 15, 2010:
> We recently had a hardware failure on our backup server which caused
> filesystem
> damage on the backuppc pool partition. We had to manually remove a few
> files
> and directories in the pool before fsck would complete successfully.
>
> I'm not worried about those. I'm worry about any other files that may have
> been corrupted in the pool. We use rsync checksum caching. I've seen this:
>
> http://www.mail-archive.com/backuppc-users AT lists.sourceforge DOT
> net/msg06849.html
>
> What should I do to verify the integrity of the pool now?
>
> Regards,
> Tyler
You may also want to look at the archives for references to two
scripts that I wrote:
1. BackupPC_digestVerify.pl - For cpools that were constructed using
the rsync/rsyncd transfer method, this script recurses through the
cpool and verifies the attached md4 checksums (from the latest
rsync backup) against the current contents of the file
[see attached script]
2. BackupPC_fixLinks.pl - Deduplicate redundant pool entries and fix
missing/broken links from the pc tree to the pool - basically this
is useful if you think you have broken/missing/redundant links.
[see the wiki for latest version:
http://sourceforge.net/apps/mediawiki/backuppc/index.php?title=BackupPC_FixLinks
]
Good luck!
Here is the BackupPC_digestVerify.pl script:
--------------------------------------------------------------------------
#!/usr/bin/perl
#Validate rsync digest
use strict;
use Getopt::Std;
use lib "/usr/share/BackupPC/lib";
use BackupPC::Xfer::RsyncDigest;
use BackupPC::Lib;
use File::Find;
use constant RSYNC_CSUMSEED_CACHE => 32761;
use constant DEFAULT_BLOCKSIZE => 2048;
my $dotfreq=100;
my %opts;
if ( !getopts("cCpdv", \%opts) || @ARGV !=1
|| ($opts{c} + $opts{C} + $opts{p} > 1)
|| ($opts{d} + $opts{v} > 1)) {
print STDERR <<EOF;
usage: $0 [-c|-C|-p] [-d|-v] [File or Directory]
Verify Rsync digest in compressed files containing digests.
Ignores directories and files without digests
Only prints if digest does not match content unless verbose flag
(firstbyte = 0xd7)
Options:
-c Consider path relative to cpool directory
-C Entry is a single cpool file name (no path)
-p Consider path relative to pc directory
-d Print a '.' for every $dotfreq digest checks
-v Verbose - print result of each check;
EOF
exit(1);
}
die("BackupPC::Lib->new failed\n") if ( !(my $bpc = BackupPC::Lib->new) );
#die("BackupPC::Lib->new failed\n") if ( !(my $bpc = BackupPC::Lib->new("", "",
"", 1)) ); #No user check
my $Topdir = $bpc->TopDir();
my $root;
$root = $Topdir . "/pc/" if $opts{p};
$root = "$bpc->{CPoolDir}/" if $opts{c};
$root =~ s|//*|/|g;
my $path = $ARGV[0];
if ($opts{C}) {
$path = $bpc->MD52Path($ARGV[0], 1, $bpc->{CPoolDir});
$path =~ m|(.*/)|;
$root = $1;
}
else {
$path = $root . $ARGV[0];
}
my $verbose=$opts{v};
my $progress= $opts{d};
die "$0: Cannot read $path\n" unless (-r $path);
my ($totfiles, $totdigfiles, $totbadfiles) = (0, 0 , 0);
find(\&verify_digest, $path);
print "\n" if $progress;
print "Looked at $totfiles files including $totdigfiles digest files of which
$totbadfiles have bad digests\n";
exit;
sub verify_digest {
return -200 unless (-f);
$totfiles++;
return -200 unless -s > 0;
return -201 unless BackupPC::Xfer::RsyncDigest->fileDigestIsCached($_);
#Not cached type (i.e. first byte not 0xd7);
$totdigfiles++;
my $ret = BackupPC::Xfer::RsyncDigest->digestAdd($_, DEFAULT_BLOCKSIZE,
RSYNC_CSUMSEED_CACHE, 2); #2=verify
#Note setting blocksize=0, results in using the default blocksize of 2048 also,
but it generates an error message
#Also leave out final protocol_version input since by setting it undefined we
make it read it from the digest.
$totbadfiles++ if $ret!=1;
(my $file = $File::Find::name) =~ s|$root||;
if ($progress && !($totdigfiles%$dotfreq)) {
print STDERR ".";
++$|; # flush print buffer
}
if ($verbose || $ret!=1) {
my $inode = (stat($File::Find::name))[1];
print "$inode $ret $file\n";
}
return $ret;
}
# Return codes:
# -100: Wrong RSYNC_CSUMSEED_CACHE or zero file size
# -101: Bad/missing RsyncLib
# -102: ZIO can't open file
# -103: sysopen can't open file
# -104: sysread can't read file
# -105: Bad first byte (not 0x78, 0xd6 or 0xd7)
# -106: Can't seek to end of file
# -107: First byte not 0xd7
# -108: Error on readin digest
# -109: Can't seek when trying to position to rewrite digest data (shouldn't
happen if only verifying)
# -110: Can't write digest data (shouldn't happen if only verifying)
# -111: Can't seek looking for extraneous data after digest (shouldn't happen
if only verifying)
# -112: Can't truncate extraneous data after digest (shouldn't happen if only
verifying)
# -113: If can't sysseek back to file beginning (shouldn't happen if only
verifying)
# -114: If can't write out first byte (0xd7) (shouldn't happen if only
verifying)
# 1: Digest verified
# 2: Digest wrong
------------------------------------------------------------------------------
Download Intel® Parallel Studio Eval
Try the new software tools for yourself. Speed compiling, find bugs
proactively, and fine-tune applications for parallel performance.
See why Intel Parallel Studio got high marks during beta.
http://p.sf.net/sfu/intel-sw-dev
_______________________________________________
BackupPC-users mailing list
BackupPC-users AT lists.sourceforge DOT net
List: https://lists.sourceforge.net/lists/listinfo/backuppc-users
Wiki: http://backuppc.wiki.sourceforge.net
Project: http://backuppc.sourceforge.net/
|
