BackupPC-users

Re: [BackupPC-users] A cleanup question for orphaned backup directories.

2017-06-20 19:01:09
Subject: Re: [BackupPC-users] A cleanup question for orphaned backup directories.
From: Ray Frush <frush AT rams.colostate DOT edu>
To: "General list for user discussion, questions and support" <backuppc-users AT lists.sourceforge DOT net>
Date: Tue, 20 Jun 2017 17:00:08 -0600
Craig-

(just returning from vacation, so pardon the late response)

The issue seems to have been caused by an odd 'out of inodes' issue caused by the NFS storage appliance we use for our storage.   After rebooting the storage appliance, the inode issue went away, and we've had no further instances of this issue.

However, in the meantime, a number of 'orphaned' backup directories were left behind.  They exist, but are not referenced by the .../BackupPC/pc/[system]/backups file. 

For example: 

[backuppc@isift090 isemt101]$ pwd
/mnt/backups/BackupPC/pc/isemt101

[backuppc@isift090 isemt101]$ ls -ld 10
drwxr-x---. 5 backuppc backuppc 4096 May 31 23:05 10

[backuppc@isift090 isemt101]$ ls 10
attrib_cf06051de16efa13986a642e2dff5f6c  backupInfo  f%2f  inode  refCnt


File/directory ownership is correct, and it looks like an orphaned backup.   So far, I've found that just deleting the orphaned directories seems like the best course of action, but I had to write a small script to help find them.

cd /mnt/backups/BackupPC/pc
for dir in $(for i in $(ls); do ls -d $i/[0-9]*| sort -n ; done) ; do 
        echo -n "$dir:"
        host=$(echo $dir |cut -f 1 -d '/')
        backup=$(echo $dir |cut -f 2 -d '/')
        #echo $host $backup
        if grep -q ^$backup $host/backups; then
                echo FOUND
         else
                echo -n "MISSING  "
                ls -l $host/XferLOG.$backup.z
                rm -rf $host/$backup
                rm $host/XferLOG.$backup.z
        fi
done





On Sat, Jun 10, 2017 at 10:42 PM, Craig Barratt via BackupPC-users <backuppc-users AT lists.sourceforge DOT net> wrote:
Ray,

Sorry about the delay in replying.  I'm not sure why those two directories are still around; BackupPC_backupDelete didn't report any errors.  It also didn't delete the XferLOG.[56].z files.

It looks like #3 was correctly deleted, and XferLOG.3.z too.

What's in those directories?  Are they owned by the backuppc user?

Craig

On Wed, May 24, 2017 at 4:03 PM, Ray Frush <frush AT rams.colostate DOT edu> wrote:
I've encountered an interesting issue:

In $TopDir/pc/host,   I have some orphaned directories that don't appear in $TopDir/pc/host/backups.

For example:   this host shows two extra directories, and XferLOGs for backup #5 and #6  that does not appear in the 'backups' file:

$ ls isxxt004
0   17  19  21  23  6  backups      LOCK          LOG.052017  RestoreInfo.0   restores     XferLOG.15.z  XferLOG.18.z  XferLOG.20.z  XferLOG.22.z  XferLOG.5.z  XferLOG.8.z
15  18  20  22  5   8  backups.old  LOG.042017.z  refCnt      RestoreLOG.0.z  XferLOG.0.z  XferLOG.17.z  XferLOG.19.z  XferLOG.21.z  XferLOG.23.z  XferLOG.6.z  XferLOG.bad.z.old

$ cat isxxt004/backups | cut -f 1,2 -d '  '
0 full
8 incr
15 incr
17 incr
18 incr
19 full
20 incr
21 incr
22 incr
23 incr

The odd thing is that the LOG suggests that Backups #5 and #6 should have been deleted:

...
2017-05-11 20:04:32 incr backup started for directory /
2017-05-11 20:08:38 incr backup 12 complete, 182376 files, 182376 bytes, 0 xferErrs (0 bad files, 0 bad shares, 0 other)
2017-05-11 20:08:38 Removing unfilled backup 3
2017-05-11 20:08:38 BackupPC_backupDelete: removing #3
2017-05-11 20:08:38 BackupPC_backupDelete: No prior backup for merge
2017-05-11 20:08:46 BackupPC_refCountUpdate: host isxxt004 got 0 errors (took 7 secs)
2017-05-11 20:08:46 Finished BackupPC_backupDelete, status = 0 (running time: 8 sec)
2017-05-12 20:03:29 incr backup started for directory /
2017-05-12 20:05:03 incr backup 13 complete, 182381 files, 182381 bytes, 0 xferErrs (0 bad files, 0 bad shares, 0 other)
2017-05-12 20:05:04 Removing unfilled backup 5
2017-05-12 20:05:04 BackupPC_backupDelete: removing #5
2017-05-12 20:05:04 BackupPC_backupDelete: No prior backup for merge
2017-05-12 20:05:08 BackupPC_refCountUpdate: host isxxt004 got 0 errors (took 4 secs)
2017-05-12 20:05:08 Finished BackupPC_backupDelete, status = 0 (running time: 4 sec)
2017-05-13 20:03:17 incr backup started for directory /
2017-05-13 20:05:20 incr backup 14 complete, 182388 files, 182388 bytes, 0 xferErrs (0 bad files, 0 bad shares, 0 other)
2017-05-13 20:05:20 Removing unfilled backup 6
2017-05-13 20:05:21 BackupPC_backupDelete: removing #6
2017-05-13 20:05:21 BackupPC_backupDelete: No prior backup for merge
2017-05-13 20:05:25 BackupPC_refCountUpdate: host isxxt004 got 0 errors (took 4 secs)
2017-05-13 20:05:25 Finished BackupPC_backupDelete, status = 0 (running time: 5 sec)
...

I'm looking for some advice on the best or safest way to clean up, or re-link in the extra directories.
At this point, I'm not concerned about losing the incremental backup history, and just want to get the '$TopDir/pc' tree into a consistent state.

Thanks!

--
Time flies like an arrow, but fruit flies like a banana.

------------------------------------------------------------------------------
Check out the vibrant tech community on one of the world's most
engaging tech sites, Slashdot.org! http://sdm.link/slashdot
_______________________________________________
BackupPC-users mailing list
[email protected]ge.net
List:    https://lists.sourceforge.net/lists/listinfo/backuppc-users
Wiki:    http://backuppc.wiki.sourceforge.net
Project: http://backuppc.sourceforge.net/



------------------------------------------------------------------------------
Check out the vibrant tech community on one of the world's most
engaging tech sites, Slashdot.org! http://sdm.link/slashdot
_______________________________________________
BackupPC-users mailing list
BackupPC-users@lists.sourceforge.net
List:    https://lists.sourceforge.net/lists/listinfo/backuppc-users
Wiki:    http://backuppc.wiki.sourceforge.net
Project: http://backuppc.sourceforge.net/




--
Time flies like an arrow, but fruit flies like a banana.
------------------------------------------------------------------------------
Check out the vibrant tech community on one of the world's most
engaging tech sites, Slashdot.org! http://sdm.link/slashdot
_______________________________________________
BackupPC-users mailing list
BackupPC-users AT lists.sourceforge DOT net
List:    https://lists.sourceforge.net/lists/listinfo/backuppc-users
Wiki:    http://backuppc.wiki.sourceforge.net
Project: http://backuppc.sourceforge.net/
<Prev in Thread] Current Thread [Next in Thread>

ADSM.ORG Privacy and Data Security by KimLaw, PLLC