BackupPC-users

Re: [BackupPC-users] Pool and cpool vanished

2014-07-30 20:46:20
Subject: Re: [BackupPC-users] Pool and cpool vanished
From: <backuppc AT kosowsky DOT org>
To: "General list for user discussion, questions and support" <backuppc-users AT lists.sourceforge DOT net>
Date: Wed, 30 Jul 2014 20:43:56 -0400
Hans Kraus wrote at about 14:01:32 +0200 on Wednesday, July 30, 2014:
 > Hi,
 > 
 > Am 29.07.2014 21:06, schrieb backuppc AT kosowsky DOT org:
 > > Hans Kraus wrote at about 18:45:44 +0200 on Tuesday, July 29, 2014:
 > >   > Hi,
 > >   >
 > >   > I had to fix the file system (xfs) of my backup server after a harddisk
 > >   > failure.
 > >
 > > How did you "fix" the file system and what makes you think that you
 > > actually fixed it? (the seeming lack of a pool/cpool directory might
 > > suggest you didn't)
 > 
 > I fixed the filesystem with 'xfs_repair'. 'xfs_check' doesn't find any
 > failures, therfore I am convinced that the filesystem is fixed.
 > 
 > That leaves of course things like corrupted or missing files. But these
 > are not filesystem errors.
 > 
 > In fact, I believe that corrupted or missing files are the culprits of
 > the error. How do I fix them?

If files are randomly corrupted and missing after hard disk failure,
that is really not a BackupPC problem and in general there is likely
to be very little you can do in general to fix the problem...

 > >   > BackupPC ran normally at first. But now it doesn't work any more. The
 > >   > status output of the html ui is:
 > >   > ----------------%x-----------------%x---------------%x-----------------
 > >   > 0 pending backup requests from last scheduled wakeup,
 > >   > 0 pending user backup requests,
 > >   > 0 pending command requests,
 > >   > Pool is 0.00GB comprising files and directories (as of 7/29 16:09),
 > >   > Pool hashing gives repeated files with longest chain ,
 > >   > Nightly cleanup removed 0 files of size 0.00GB (around 7/29 16:09),
 > >   > Pool file system was recently at 46% (7/29 16:08), today's max is 48%
 > >   > (7/28 15:38) and yesterday's max was %.
 > >   > ----------------%x-
 > > ----------------%x---------------%x-----------------
 > >   > I ran the following tools:
 > >
 > > How about doing some simple *nix file checking first to verify the
 > > existence of standard BackupPC directory structures & content...
 > > e.g.,
 > > du -s <topdir>/cpool
 > > du -s <topdir>/pool
 > > find  <topdir>/cpool -type f | wc
 > > find  <topdir>/cpool -type d | wc
 > > (similarly for pool if it exists...
 > > Also examine <topdir>/pc
 > > etc.
 > 
 > The results:
 > 7683888364      cpool (du -s)
 > 410587928       pool (du -s)
So you have about 8GB of data in your combined cpool and pool
trees. This is pretty small by the standards of most systems.
Can you check past log files to see how much pooled data you had
before.
Also, most people tend to have data *either* in 'pool' or 'cpool'
-- i.e. either all compressed or all uncompressed.
Do you (or have you) used both pool and cpool in the past?

> find  cpool -type f | wc        2479868 2479868 111820585
Ares these files named properly?
(32 hex characters followed by optional underscored numerical suffix)

 > find  cpool -type d | wc           4369    4369   51846
So you seem to have the full 3 layer hex tree of directories
 > find  pool -type f | wc          154009  154009 6776396
 > find  pool -type d | wc            4369    4369   47477

 > >
 > >   > BackupPC_fixupBackupSummary which reported no faults.
 > >   > BackupPC_trashClean
 > >   > BackupPC_nightly 0 255 wich gave following (truncated) output:
 > >   > ----------------%x-----------------%x---------------%x-----------------
 > >   > BackupPC_stats 0 = pool,600,18,1634472,632024,0,0,0,0,0,7,1051
 > >   > BackupPC_stats 1 = pool,620,17,1590832,497636,0,0,0,0,0,7,2150
 > >   > BackupPC_stats 2 = pool,612,17,1443460,313624,0,0,0,0,0,5,3237
 > >   > BackupPC_stats 3 = pool,594,17,1597464,591800,0,0,0,0,0,7,4286
 > >   > :
 > >   > :
 > >   > BackupPC_stats 252 = pool,585,17,1776696,643628,0,0,0,0,0,7,270040
 > >   > BackupPC_stats 253 = pool,592,17,1850752,742680,0,0,0,0,0,7,271076
 > >   > BackupPC_stats 254 = pool,656,17,1889968,606956,0,0,0,0,0,7,272232
 > >   > BackupPC_stats 255 = pool,584,17,1537300,264704,0,0,0,0,0,7,273269
 > >   > BackupPC_stats 0 = 
 > > cpool,9818,18,22314480,162060,0,0,438,1,0,2455,412024
 > >   > BackupPC_stats 1 = cpool,9850,17,9937152,303072,0,0,455,4,0,2675,557908
 > >   > BackupPC_stats 2 = 
 > > cpool,9888,17,35467844,1856280,0,0,463,10,0,4379,697083
 > >   > BackupPC_stats 3 = 
 > > cpool,9662,17,17541856,294844,0,0,424,2,0,1351,833789
 > >   > :
 > >   > :
 > >   > BackupPC_stats 252 =
 > >   > cpool,9874,17,48297752,144008,0,0,466,11,0,1705,35986948
 > >   > BackupPC_stats 253 = 
 > > cpool,9629,17,13529032,820444,0,0,416,1,0,1351,36124967
 > >   > BackupPC_stats 254 =
 > >   > cpool,9742,17,107252096,1543676,0,0,454,2,0,3688,36270782
 > >   > BackupPC_stats 255 = 
 > > cpool,9753,17,17471688,304780,0,0,423,1,0,1303,36411243
 > >   > BackupPC_nightly lock_off
 > >   > ----------------%x-----------------%x---------------%x----------------

Well this seems to verify that your pool and cpool are there...

-
 > >   > How do I restore BackupPC to normal working? I need a backup ...
 > > Seems more like a filesystem problem...

What version of BackupPC are you running?
A simple google search mentioned an error with BackupPC_nightly
accounting when using xfs....

 > >   >
 > >   > Any help appreciated,
 > >   > Hans
 > 
 > BackupPC ran the last night (it was not supposed to be but I forgot to
 > disable it).
 > 
 > Some machines were backuped, but the output didn't change, it's still:
 > ----------------%x-----------------%x---------------%x-----------------
 > 0 pending backup requests from last scheduled wakeup,
 > 0 pending user backup requests,
 > 0 pending command requests,
 > Pool is 0.00GB comprising files and directories (as of 7/29 16:09),
 > Pool hashing gives repeated files with longest chain ,
 > Nightly cleanup removed 0 files of size 0.00GB (around 7/29 16:09),
 > Pool file system was recently at 46% (7/29 16:08), today's max is 48%
 > (7/28 15:38) and yesterday's max was %.
 > ----------------%x-----------------%x---------------%x-----------------
 > Regards, Hans
 > 
 > 
 > 
 > ------------------------------------------------------------------------------
 > Infragistics Professional
 > Build stunning WinForms apps today!
 > Reboot your WinForms applications with our WinForms controls. 
 > Build a bridge from your legacy apps to the future.
 > http://pubads.g.doubleclick.net/gampad/clk?id=153845071&iu=/4140/ostg.clktrk
 > _______________________________________________
 > BackupPC-users mailing list
 > BackupPC-users AT lists.sourceforge DOT net
 > List:    https://lists.sourceforge.net/lists/listinfo/backuppc-users
 > Wiki:    http://backuppc.wiki.sourceforge.net
 > Project: http://backuppc.sourceforge.net/

------------------------------------------------------------------------------
Infragistics Professional
Build stunning WinForms apps today!
Reboot your WinForms applications with our WinForms controls. 
Build a bridge from your legacy apps to the future.
http://pubads.g.doubleclick.net/gampad/clk?id=153845071&iu=/4140/ostg.clktrk
_______________________________________________
BackupPC-users mailing list
BackupPC-users AT lists.sourceforge DOT net
List:    https://lists.sourceforge.net/lists/listinfo/backuppc-users
Wiki:    http://backuppc.wiki.sourceforge.net
Project: http://backuppc.sourceforge.net/

<Prev in Thread] Current Thread [Next in Thread>