Thanks, Jeffrey. I'll put both to use immediately.
Regards,
Tyler
On Thursday 15 April 2010 16:27:25 Jeffrey J. Kosowsky wrote:
> Tyler J. Wagner wrote at about 11:20:55 +0100 on Thursday, April 15, 2010:
> > We recently had a hardware failure on our backup server which caused
> > filesystem damage on the backuppc pool partition. We had to manually
> > remove a few files and directories in the pool before fsck would
> > complete successfully.
> >
> > I'm not worried about those. I'm worry about any other files that may
> > have been corrupted in the pool. We use rsync checksum caching. I've
> > seen this:
> >
> > http://www.mail-archive.com/backuppc-users AT lists.sourceforge DOT
> net/msg0684
> >9.html
> >
> > What should I do to verify the integrity of the pool now?
> >
> > Regards,
> > Tyler
>
> You may also want to look at the archives for references to two
> scripts that I wrote:
> 1. BackupPC_digestVerify.pl - For cpools that were constructed using
> the rsync/rsyncd transfer method, this script recurses through the
> cpool and verifies the attached md4 checksums (from the latest
> rsync backup) against the current contents of the file
> [see attached script]
>
> 2. BackupPC_fixLinks.pl - Deduplicate redundant pool entries and fix
> missing/broken links from the pc tree to the pool - basically this
> is useful if you think you have broken/missing/redundant links.
> [see the wiki for latest version:
>
> http://sourceforge.net/apps/mediawiki/backuppc/index.php?title=BackupPC_Fi
> xLinks ]
>
>
> Good luck!
>
> Here is the BackupPC_digestVerify.pl script:
> --------------------------------------------------------------------------
> #!/usr/bin/perl
> #Validate rsync digest
>
> use strict;
> use Getopt::Std;
>
> use lib "/usr/share/BackupPC/lib";
> use BackupPC::Xfer::RsyncDigest;
> use BackupPC::Lib;
> use File::Find;
>
> use constant RSYNC_CSUMSEED_CACHE => 32761;
> use constant DEFAULT_BLOCKSIZE => 2048;
>
>
> my $dotfreq=100;
> my %opts;
> if ( !getopts("cCpdv", \%opts) || @ARGV !=1
>
> || ($opts{c} + $opts{C} + $opts{p} > 1)
> || ($opts{d} + $opts{v} > 1)) {
>
> print STDERR <<EOF;
> usage: $0 [-c|-C|-p] [-d|-v] [File or Directory]
> Verify Rsync digest in compressed files containing digests.
> Ignores directories and files without digests
> Only prints if digest does not match content unless verbose flag
> (firstbyte = 0xd7)
> Options:
> -c Consider path relative to cpool directory
> -C Entry is a single cpool file name (no path)
> -p Consider path relative to pc directory
> -d Print a '.' for every $dotfreq digest checks
> -v Verbose - print result of each check;
>
> EOF
> exit(1);
> }
>
> die("BackupPC::Lib->new failed\n") if ( !(my $bpc = BackupPC::Lib->new) );
> #die("BackupPC::Lib->new failed\n") if ( !(my $bpc = BackupPC::Lib->new("",
> "", "", 1)) ); #No user check
>
> my $Topdir = $bpc->TopDir();
> my $root;
> $root = $Topdir . "/pc/" if $opts{p};
> $root = "$bpc->{CPoolDir}/" if $opts{c};
> $root =~ s|//*|/|g;
>
> my $path = $ARGV[0];
> if ($opts{C}) {
> $path = $bpc->MD52Path($ARGV[0], 1, $bpc->{CPoolDir});
> $path =~ m|(.*/)|;
> $root = $1;
> }
> else {
> $path = $root . $ARGV[0];
> }
> my $verbose=$opts{v};
> my $progress= $opts{d};
>
> die "$0: Cannot read $path\n" unless (-r $path);
>
>
> my ($totfiles, $totdigfiles, $totbadfiles) = (0, 0 , 0);
> find(\&verify_digest, $path);
> print "\n" if $progress;
> print "Looked at $totfiles files including $totdigfiles digest files of
> which $totbadfiles have bad digests\n"; exit;
>
> sub verify_digest {
> return -200 unless (-f);
> $totfiles++;
> return -200 unless -s > 0;
> return -201 unless BackupPC::Xfer::RsyncDigest->fileDigestIsCached($_);
> #Not cached type (i.e. first byte not 0xd7); $totdigfiles++;
>
> my $ret = BackupPC::Xfer::RsyncDigest->digestAdd($_, DEFAULT_BLOCKSIZE,
> RSYNC_CSUMSEED_CACHE, 2); #2=verify #Note setting blocksize=0, results in
> using the default blocksize of 2048 also, but it generates an error
> message #Also leave out final protocol_version input since by setting it
> undefined we make it read it from the digest. $totbadfiles++ if $ret!=1;
>
> (my $file = $File::Find::name) =~ s|$root||;
> if ($progress && !($totdigfiles%$dotfreq)) {
> print STDERR ".";
> ++$|; # flush print buffer
> }
> if ($verbose || $ret!=1) {
> my $inode = (stat($File::Find::name))[1];
> print "$inode $ret $file\n";
> }
> return $ret;
> }
>
> # Return codes:
> # -100: Wrong RSYNC_CSUMSEED_CACHE or zero file size
> # -101: Bad/missing RsyncLib
> # -102: ZIO can't open file
> # -103: sysopen can't open file
> # -104: sysread can't read file
> # -105: Bad first byte (not 0x78, 0xd6 or 0xd7)
> # -106: Can't seek to end of file
> # -107: First byte not 0xd7
> # -108: Error on readin digest
> # -109: Can't seek when trying to position to rewrite digest data
> (shouldn't happen if only verifying) # -110: Can't write digest data
> (shouldn't happen if only verifying) # -111: Can't seek looking for
> extraneous data after digest (shouldn't happen if only verifying) # -112:
> Can't truncate extraneous data after digest (shouldn't happen if only
> verifying) # -113: If can't sysseek back to file beginning (shouldn't
> happen if only verifying) # -114: If can't write out first byte (0xd7)
> (shouldn't happen if only verifying) # 1: Digest verified
> # 2: Digest wrong
>
>
> ---------------------------------------------------------------------------
> --- Download Intel® Parallel Studio Eval
> Try the new software tools for yourself. Speed compiling, find bugs
> proactively, and fine-tune applications for parallel performance.
> See why Intel Parallel Studio got high marks during beta.
> http://p.sf.net/sfu/intel-sw-dev
> _______________________________________________
> BackupPC-users mailing list
> BackupPC-users AT lists.sourceforge DOT net
> List: https://lists.sourceforge.net/lists/listinfo/backuppc-users
> Wiki: http://backuppc.wiki.sourceforge.net
> Project: http://backuppc.sourceforge.net/
>
--
"I have long felt that any reviewer who expresses rage and loathing for
a novel is preposterous. He or she is like a person who has put on full
armor and attacked a hot fudge sundae or a banana split."
-- Kurt Vonnegut
------------------------------------------------------------------------------
Download Intel® Parallel Studio Eval
Try the new software tools for yourself. Speed compiling, find bugs
proactively, and fine-tune applications for parallel performance.
See why Intel Parallel Studio got high marks during beta.
http://p.sf.net/sfu/intel-sw-dev
_______________________________________________
BackupPC-users mailing list
BackupPC-users AT lists.sourceforge DOT net
List: https://lists.sourceforge.net/lists/listinfo/backuppc-users
Wiki: http://backuppc.wiki.sourceforge.net
Project: http://backuppc.sourceforge.net/
|
