BackupPC-users
[Top] [All Lists]
<prev [Date] next>
[Advanced]
 <prev [Thread] next>

Re: [BackupPC-users] acls and xattrs attributes

2017-06-11 11:25:48
Subject: Re: [BackupPC-users] acls and xattrs attributes
From: Robert Wooden <bob AT donelsontrophy DOT com>
To: "General list for user discussion, questions and support" <backuppc-users AT lists.sourceforge DOT net>
Date: Sun, 11 Jun 2017 10:24:36 -0500
Thanks, Craig. I will update to 4.1.3 and see what happens.

Suggestion, perhaps in documentation, regarding log level you could add that the range is 1 through 10. (I was uncomfortable, guessing that 10 was the limit.)

I have said it before and many others have also, GREAT JOB!! Backuppc is very good!!!

On Sat, Jun 10, 2017 at 9:17 PM, Craig Barratt via BackupPC-users <backuppc-users@lists.sourceforge.net> wrote:
Bob,

There doesn't seem to be anything untoward in the log information you sent.

To figure out why /home is empty, you should post the specific rsync_bpc commands (that are in the XferLOG file).

Note that for 4.1.2, I added --one-file-system to the default $Conf{RsyncArgs}, and it also adds that argument for 3.x upgrades.  In 4.1.3, it's still in the default $Conf{RsyncArgs}, but it no longer adds to 3.x upgrades.  This could explain why /home is empty.

Craig

On Thu, Jun 8, 2017 at 4:01 AM, Robert Wooden <bob AT donelsontrophy DOT com> wrote:
I have a second Samba4 member file server (that was replaced by the newer one I have having issues with that BackupPC v4.1.2 will NOT backup the /home directory) that has been "shutoff" for a while. It's /home directory contains the same "acls" and "xattrs" file attributes adjustments as the newer one. I created a backup host listing and started a 'full-backup'. The result for this machine was the same as the newer machine, no backup of /home despite no exclusion of the /home directory. "Browsing the backup" shows the same /home is empty as the newer member file server.

Log level set to "10" results in a huge file of repeatitive dialog similar to this:

2017-06-01 06:03:45 incr backup started for directory /
2017-06-01 06:03:48 incr backup 8 complete, 56760 files, 56760 bytes, 0 xferErrs (0 bad files, 0 bad shares, 0 other)
2017-06-02 21:00:01 incr backup started for directory /
2017-06-02 21:02:01 incr backup 9 complete, 56764 files, 56764 bytes, 0 xferErrs (0 bad files, 0 bad shares, 0 other)
2017-06-03 21:00:01 full backup started for directory /
2017-06-03 21:00:21 full backup 10 complete, 56766 files, 56766 bytes, 0 xferErrs (0 bad files, 0 bad shares, 0 other)
2017-06-04 21:00:00 bpc_attrib_backwardCompat: WriteOldStyleAttribFile = 0, KeepOldAttribFiles = 0
2017-06-04 21:00:00 Copying backup #10 to #11
2017-06-04 21:00:00 Creating directory /var/lib/backuppc/pc/192.168.16.55/11/.
2017-06-04 21:00:00 Creating directory /var/lib/backuppc/pc/192.168.16.55/11/./refCnt
2017-06-04 21:00:00 Creating directory /var/lib/backuppc/pc/192.168.16.55/11/./f%2f
2017-06-04 21:00:00 Creating directory /var/lib/backuppc/pc/192.168.16.55/11/./f%2f/fbin

.... snipped for brevity . . .

2017-06-05 06:45:02 bpc_path_refCountAll(/var/lib/backuppc/pc/192.168.16.55/12/f%2f/fusr/fshare/fterminfo/fr)
2017-06-05 06:45:02 bpc_path_refCountAll: got /var/lib/backuppc/pc/192.168.16.55/12/f%2f/fusr/fshare/fterminfo/fr/attrib_a4e4f3a0960d98eb76dab41e493bed4d
2017-06-05 06:45:02 bpc_attrib_dirRead(/var/lib/backuppc/pc/192.168.16.55/12/f%2f/fusr/fshare/fterminfo/fr/attrib_a4e4f3a0960d98eb76dab41e493bed4d); dirPath = /var/lib/backuppc/pc/192.168.16.55/12/f%2f/fusr/fshare/fterminfo/fr, attribFilePath = attrib_a4e4f3a0960d98eb76dab41e493bed4d, attribFileName = attrib_a4e4f3a0960d98eb76dab41e493bed4d
2017-06-05 06:45:02 bpc_attrib_dirRead: called with attrib file /var/lib/backuppc/pc/192.168.16.55/12/f%2f/fusr/fshare/fterminfo/fr/attrib_a4e4f3a0960d98eb76dab41e493bed4d: digest = a4e4f3a0960d98eb76dab41e493bed4d, len = 16
2017-06-05 06:45:02 bpc_fileZIO_open(/var/lib/backuppc/cpool/a4/e4/a4e4f3a0960d98eb76dab41e493bed4d, 0, 3) -> 6
2017-06-05 06:45:02 inflate returns 1; thisRead = 859, avail_in = 0, numOut = 1226
2017-06-05 06:45:02 inflate returns -5; thisRead = 859, avail_in = 0, numOut = 0
2017-06-05 06:45:02 inflate returns -5; thisRead = 0, avail_in = 0, numOut = 0
2017-06-05 06:45:02 bpc_attrib_dirRead(/var/lib/backuppc/cpool/a4/e4/a4e4f3a0960d98eb76dab41e493bed4d): Got file rxvt-16color: type = 0, mode = 0644, uid/gid = 0/0, size = 2352

.... snipped for brevity . . .

2017-06-05 06:45:02 bpc_attrib_dirRefCount: attrib digest a4e4f3a0960d98eb76dab41e493bed4d delta = 1
2017-06-05 06:45:02 bpc_poolRefDeltaUpdate(a4e4f3a0960d98eb76dab41e493bed4d, 1), count now 1
2017-06-05 06:45:02 bpc_path_refCountAll(/var/lib/backuppc/pc/192.168.16.55/12/f%2f/fusr/fshare/fterminfo/fl)
2017-06-05 06:45:02 bpc_path_refCountAll: got /var/lib/backuppc/pc/192.168.16.55/12/f%2f/fusr/fshare/fterminfo/fl/attrib_ced70f11f8178a5b1d805ce81d62ec4e
2017-06-05 06:45:02 bpc_attrib_dirRead(/var/lib/backuppc/pc/192.168.16.55/12/f%2f/fusr/fshare/fterminfo/fl/attrib_ced70f11f8178a5b1d805ce81d62ec4e); dirPath = /var/lib/backuppc/pc/192.168.16.55/12/f%2f/fusr/fshare/fterminfo/fl, attribFilePath = attrib_ced70f11f8178a5b1d805ce81d62ec4e, attribFileName = attrib_ced70f11f8178a5b1d805ce81d62ec4e
2017-06-05 06:45:02 bpc_attrib_dirRead: called with attrib file /var/lib/backuppc/pc/192.168.16.55/12/f%2f/fusr/fshare/fterminfo/fl/attrib_ced70f11f8178a5b1d805ce81d62ec4e: digest = ced70f11f8178a5b1d805ce81d62ec4e, len = 16
2017-06-05 06:45:02 bpc_fileZIO_open(/var/lib/backuppc/cpool/ce/d6/ced70f11f8178a5b1d805ce81d62ec4e, 0, 3) -> 6
2017-06-05 06:45:02 inflate returns 1; thisRead = 843, avail_in = 0, numOut = 1175
2017-06-05 06:45:02 inflate returns -5; thisRead = 843, avail_in = 0, numOut = 0
2017-06-05 06:45:02 inflate returns -5; thisRead = 0, avail_in = 0, numOut = 0
2017-06-05 06:45:02 bpc_attrib_dirRead(/var/lib/backuppc/cpool/ce/d6/ced70f11f8178a5b1d805ce81d62ec4e): Got file linux-c: type = 0, mode = 0644, uid/gid = 0/0, size = 2120

.... snipped for brevity . . .

2017-06-05 06:45:02 bpc_attrib_dirRefCount: attrib digest ced70f11f8178a5b1d805ce81d62ec4e delta = 1
2017-06-05 06:45:02 bpc_poolRefDeltaUpdate(ced70f11f8178a5b1d805ce81d62ec4e, 1), count now 1
2017-06-05 06:45:02 bpc_path_refCountAll(/var/lib/backuppc/pc/192.168.16.55/12/f%2f/fusr/fshare/fterminfo/fP)
2017-06-05 06:45:02 bpc_path_refCountAll: got /var/lib/backuppc/pc/192.168.16.55/12/f%2f/fusr/fshare/fterminfo/fP/attrib_53eb669a2b2d24ca59318a7d73b1529d
2017-06-05 06:45:02 bpc_attrib_dirRead(/var/lib/backuppc/pc/192.168.16.55/12/f%2f/fusr/fshare/fterminfo/fP/attrib_53eb669a2b2d24ca59318a7d73b1529d); dirPath = /var/lib/backuppc/pc/192.168.16.55/12/f%2f/fusr/fshare/fterminfo/fP, attribFilePath = attrib_53eb669a2b2d24ca59318a7d73b1529d, attribFileName = attrib_53eb669a2b2d24ca59318a7d73b1529d
2017-06-05 06:45:02 bpc_attrib_dirRead: called with attrib file /var/lib/backuppc/pc/192.168.16.55/12/f%2f/fusr/fshare/fterminfo/fP/attrib_53eb669a2b2d24ca59318a7d73b1529d: digest = 53eb669a2b2d24ca59318a7d73b1529d, len = 16
2017-06-05 06:45:02 bpc_fileZIO_open(/var/lib/backuppc/cpool/52/ea/53eb669a2b2d24ca59318a7d73b1529d, 0, 3) -> 6
2017-06-05 06:45:02 inflate returns 1; thisRead = 473, avail_in = 0, numOut = 667
2017-06-05 06:45:02 inflate returns -5; thisRead = 473, avail_in = 0, numOut = 0

.... snipped for brevity . . .

2017-06-05 06:45:02 bpc_attrib_dirRefCount: attrib digest 53eb669a2b2d24ca59318a7d73b1529d delta = 1
2017-06-05 06:45:02 bpc_poolRefDeltaUpdate(53eb669a2b2d24ca59318a7d73b1529d, 1), count now 1
2017-06-05 06:45:02 bpc_path_refCountAll(/var/lib/backuppc/pc/192.168.16.55/12/f%2f/fusr/fshare/fterminfo/fX)
2017-06-05 06:45:02 bpc_path_refCountAll: got /var/lib/backuppc/pc/192.168.16.55/12/f%2f/fusr/fshare/fterminfo/fX/attrib_0cbd91011239aba036bb641609b7d3f1
2017-06-05 06:45:02 bpc_attrib_dirRead(/var/lib/backuppc/pc/192.168.16.55/12/f%2f/fusr/fshare/fterminfo/fX/attrib_0cbd91011239aba036bb641609b7d3f1); dirPath = /var/lib/backuppc/pc/192.168.16.55/12/f%2f/fusr/fshare/fterminfo/fX, attribFilePath = attrib_0cbd91011239aba036bb641609b7d3f1, attribFileName = attrib_0cbd91011239aba036bb641609b7d3f1
2017-06-05 06:45:02 bpc_attrib_dirRead: called with attrib file /var/lib/backuppc/pc/192.168.16.55/12/f%2f/fusr/fshare/fterminfo/fX/attrib_0cbd91011239aba036bb641609b7d3f1: digest = 0cbd91011239aba036bb641609b7d3f1, len = 16
2017-06-05 06:45:02 bpc_fileZIO_open(/var/lib/backuppc/cpool/0c/bc/0cbd91011239aba036bb641609b7d3f1, 0, 3) -> 6
2017-06-05 06:45:02 inflate returns 1; thisRead = 56, avail_in = 0, numOut = 47
2017-06-05 06:45:02 inflate returns -5; thisRead = 56, avail_in = 0, numOut = 0
2017-06-05 06:45:02 inflate returns -5; thisRead = 0, avail_in = 0, numOut = 0
2017-06-05 06:45:02 bpc_attrib_dirRead(/var/lib/backuppc/cpool/0c/bc/0cbd91011239aba036bb641609b7d3f1): Got file X-hpterm: type = 2, mode = 0777, uid/gid = 0/0, size = 11
2017-06-05 06:45:02 bpc_fileZIO_close(6)
2017-06-05 06:45:02 bpc_path_refCountAll: adjusting ref counts from attrib file /var/lib/backuppc/pc/192.168.16.55/12/f%2f/fusr/fshare/fterminfo/fX/attrib_0cbd91011239aba036bb641609b7d3f1
2017-06-05 06:45:02 bpc_attrib_fileRefCount: file X-hpterm digest 37226e25d45a284c60841d5b69750cbf delta 1
2017-06-05 06:45:02 bpc_poolRefDeltaUpdate(37226e25d45a284c60841d5b69750cbf, 1), count now 1
2017-06-05 06:45:02 bpc_attrib_dirRefCount: attrib digest 0cbd91011239aba036bb641609b7d3f1 delta = 1
2017-06-05 06:45:02 bpc_poolRefDeltaUpdate(0cbd91011239aba036bb641609b7d3f1, 1), count now 1
2017-06-05 06:45:02 bpc_path_refCountAll(/var/lib/backuppc/pc/192.168.16.55/12/f%2f/fusr/fshare/fterminfo/fe)
2017-06-05 06:45:02 bpc_path_refCountAll: got /var/lib/backuppc/pc/192.168.16.55/12/f%2f/fusr/fshare/fterminfo/fe/attrib_76a989fb8c3a1a344f5e3a10e0938c58
2017-06-05 06:45:02 bpc_attrib_dirRead(/var/lib/backuppc/pc/192.168.16.55/12/f%2f/fusr/fshare/fterminfo/fe/attrib_76a989fb8c3a1a344f5e3a10e0938c58); dirPath = /var/lib/backuppc/pc/192.168.16.55/12/f%2f/fusr/fshare/fterminfo/fe, attribFilePath = attrib_76a989fb8c3a1a344f5e3a10e0938c58, attribFileName = attrib_76a989fb8c3a1a344f5e3a10e0938c58
2017-06-05 06:45:02 bpc_attrib_dirRead: called with attrib file /var/lib/backuppc/pc/192.168.16.55/12/f%2f/fusr/fshare/fterminfo/fe/attrib_76a989fb8c3a1a344f5e3a10e0938c58: digest = 76a989fb8c3a1a344f5e3a10e0938c58, len = 16
2017-06-05 06:45:02 bpc_fileZIO_open(/var/lib/backuppc/cpool/76/a8/76a989fb8c3a1a344f5e3a10e0938c58, 0, 3) -> 6
2017-06-05 06:45:02 inflate returns 1; thisRead = 923, avail_in = 0, numOut = 1255
2017-06-05 06:45:02 inflate returns -5; thisRead = 923, avail_in = 0, numOut = 0

.... snipped for brevity . . .

2017-06-05 06:45:02 bpc_attrib_dirRead(/var/lib/backuppc/cpool/a0/84/a085cfbddd1fb151c7c3caebb1ced4f5): Got file 605x: type = 2, mode = 0777, uid/gid = 0/0, size = 11
2017-06-05 06:45:02 bpc_attrib_dirRead(/var/lib/backuppc/cpool/a0/84/a085cfbddd1fb151c7c3caebb1ced4f5): Got file 6053: type = 2, mode = 0777, uid/gid = 0/0, size = 11
2017-06-05 06:45:02 bpc_fileZIO_close(6)
2017-06-05 06:45:02 bpc_path_refCountAll: adjusting ref counts from attrib file /var/lib/backuppc/pc/192.168.16.55/12/f%2f/fusr/fshare/fterminfo/f6/attrib_a085cfbddd1fb151c7c3caebb1ced4f5
2017-06-05 06:45:02 bpc_attrib_fileRefCount: file 630-lm digest 06e3cb430dd823fdd06ca66f45a1ca67 delta 1
2017-06-05 06:45:02 bpc_poolRefDeltaUpdate(06e3cb430dd823fdd06ca66f45a1ca67, 1), count now 2
2017-06-05 06:45:02 bpc_attrib_fileRefCount: file 6053-dg digest 300447036933bdeb63a60e19cff4ab23 delta 1
2017-06-05 06:45:02 bpc_poolRefDeltaUpdate(300447036933bdeb63a60e19cff4ab23, 1), count now 1
2017-06-05 06:45:02 bpc_attrib_fileRefCount: file 605x-dg digest 300447036933bdeb63a60e19cff4ab23 delta 1
2017-06-05 06:45:02 bpc_poolRefDeltaUpdate(300447036933bdeb63a60e19cff4ab23, 1), count now 2
2017-06-05 06:45:02 bpc_attrib_fileRefCount: file 630MTG-24 digest 794ae7a43598b541dd1b2af71f4c92f6 delta 1
2017-06-05 06:45:02 bpc_poolRefDeltaUpdate(794ae7a43598b541dd1b2af71f4c92f6, 1), count now 3
2017-06-05 06:45:02 bpc_attrib_fileRefCount: file 605x digest 300447036933bdeb63a60e19cff4ab23 delta 1
2017-06-05 06:45:02 bpc_poolRefDeltaUpdate(300447036933bdeb63a60e19cff4ab23, 1), count now 3
2017-06-05 06:45:02 bpc_attrib_fileRefCount: file 6053 digest 300447036933bdeb63a60e19cff4ab23 delta 1
2017-06-05 06:45:02 bpc_poolRefDeltaUpdate(300447036933bdeb63a60e19cff4ab23, 1), count now 4
2017-06-05 06:45:02 bpc_attrib_dirRefCount: attrib digest a085cfbddd1fb151c7c3caebb1ced4f5 delta = 1
2017-06-05 06:45:02 bpc_poolRefDeltaUpdate(a085cfbddd1fb151c7c3caebb1ced4f5, 1), count now 1
2017-06-05 06:45:02 bpc_path_refCountAll(/var/lib/backuppc/pc/192.168.16.55/12/f%2f/fusr/fshare/fterminfo/fd)
2017-06-05 06:45:02 bpc_path_refCountAll: got /var/lib/backuppc/pc/192.168.16.55/12/f%2f/fusr/fshare/fterminfo/fd/attrib_857558efce59180f6612cdcd45b856f0
2017-06-05 06:45:02 bpc_attrib_dirRead(/var/lib/backuppc/pc/192.168.16.55/12/f%2f/fusr/fshare/fterminfo/fd/attrib_857558efce59180f6612cdcd45b856f0); dirPath = /var/lib/backuppc/pc/192.168.16.55/12/f%2f/fusr/fshare/fterminfo/fd, attribFilePath = attrib_857558efce59180f6612cdcd45b856f0, attribFileName = attrib_857558efce59180f6612cdcd45b856f0
2017-06-05 06:45:02 bpc_attrib_dirRead: called with attrib file /var/lib/backuppc/pc/192.168.16.55/12/f%2f/fusr/fshare/fterminfo/fd/attrib_857558efce59180f6612cdcd45b856f0: digest = 857558efce59180f6612cdcd45b856f0, len = 16
2017-06-05 06:45:02 bpc_fileZIO_open(/var/lib/backuppc/cpool/84/74/857558efce59180f6612cdcd45b856f0, 0, 3) -> 6
2017-06-05 06:45:02 inflate returns 1; thisRead = 7360, avail_in = 0, numOut = 12654
2017-06-05 06:45:02 inflate returns -5; thisRead = 7360, avail_in = 0, numOut = 0
2017-06-05 06:45:02 inflate returns -5; thisRead = 0, avail_in = 0, numOut = 0
2017-06-05 06:45:02 bpc_attrib_dirRead(/var/lib/backuppc/cpool/84/74/857558efce59180f6612cdcd45b856f0): Got file dw2: type = 0, mode = 0644, uid/gid = 0/0, size = 354
2017-06-05 06:45:02 bpc_attrib_dirRead(/var/lib/backuppc/cpool/84/74/857558efce59180f6612cdcd45b856f0): Got file dg6053: type = 0, mode = 0644, uid/gid = 0/0, size = 816

.... snipped for brevity . . .




Again, suggestions for troubleshooting this issue would be greatly appreciated?

On Mon, Jun 5, 2017 at 6:35 AM, Robert Wooden <bob AT donelsontrophy DOT com> wrote:
I have changed email addresses and my original message (from last week) is here.

Over two years ago I discovered that BackupPC v3 will not backup acl and xattr file attributes. At that time, it was suggested to try v4 (had just been released as beta(?), I think) and I did get an OS to run v4.0. It (v4.0) backups failed when "acls" and "xattrs" RsyncArgsExtra where activated. So, I worked out a simple alternative for the time being with rsync.

Now, let me explain my need. I have a Samba4 active directory setup with one machine acting as a member server that carries the redirected files from all the W workstations. This active directory requires the use of acls and xattrs file attributes.

Enter BackupPC v4.1.2 (now.) I have created a test rig to test bpc4 and it is backing up the active directory setup. Both domain controllers (these machines do NOT incorporate the use of "acls" and "xattrs" attributes) backup just fine. The member server (a file server), on the other hand, has acls and xattrs attributes activated on the /home directory but, will not backup the /home directory. All other directories are being backed up from the member server.

When I set "RsyncArgsExtra" to include "acls" and "xattrs" the machine backups up but the /home backup is empty. I have disabled one, then the other and finally both to see if BackupPC will backup the /home in any fashion, the /home directory remains empty.

A brief explanation of "acls" and "xattrs" settings on a member server. Only directories under /home have had any adjustments to these file attributes by the domain administrators. User files with in the subdirectories are adjusted to meet the needs of users on the workstations.

Therefore, it is my belief that this is the reason BackupPC v4.1.2 will not back up anything under the /home directory.

I have checked Rsync backups and they include these file attribute settings. So my question (finally) is this, if Rsync (on Ubuntu 16.04LTS uses Rsync 3.1.1-3ubuntu1) works with "acls" and "xattrs", why doesn't Rsync_bpc?

(Sorry for the lengthy explanation.)


Since posting this original message I have been increasing my log level and reviewing those logs. Level "6" yields no additional information. This morning I have increased the level again, now to "10". (Should like to know what the max setting I can use is?)

The need for "acls" and "xattrs" attributes relates to backing up active directory file servers.

I am not sure how to troubleshoot this other than log files.

Any suggestions for troubleshooting?


-- 
Thank you,

Bob Wooden



-- 
Thank you,

Bob Wooden

------------------------------------------------------------------------------
Check out the vibrant tech community on one of the world's most
engaging tech sites, Slashdot.org! http://sdm.link/slashdot
_______________________________________________
BackupPC-users mailing list
[email protected]ge.net
List:    https://lists.sourceforge.net/lists/listinfo/backuppc-users
Wiki:    http://backuppc.wiki.sourceforge.net
Project: http://backuppc.sourceforge.net/



------------------------------------------------------------------------------
Check out the vibrant tech community on one of the world's most
engaging tech sites, Slashdot.org! http://sdm.link/slashdot
_______________________________________________
BackupPC-users mailing list
[email protected]ge.net
List:    https://lists.sourceforge.net/lists/listinfo/backuppc-users
Wiki:    http://backuppc.wiki.sourceforge.net
Project: http://backuppc.sourceforge.net/




-- 
Thank you,

Bob Wooden
------------------------------------------------------------------------------
Check out the vibrant tech community on one of the world's most
engaging tech sites, Slashdot.org! http://sdm.link/slashdot
_______________________________________________
BackupPC-users mailing list
BackupPC-users AT lists.sourceforge DOT net
List:    https://lists.sourceforge.net/lists/listinfo/backuppc-users
Wiki:    http://backuppc.wiki.sourceforge.net
Project: http://backuppc.sourceforge.net/
[More with this subject...]
<Prev in Thread] Current Thread [Next in Thread>
Previous by Date:  Re: [BackupPC-users] status graph, Craig Barratt via BackupPC-users
Next by Date:  Re: [BackupPC-users] Unexplained Error Code 255 - BackupPC, Akibu Flash
Previous by Thread:  Re: [BackupPC-users] acls and xattrs attributes, Craig Barratt via BackupPC-users
Next by Thread:  Re: [BackupPC-users] acls and xattrs attributes, Craig Barratt via BackupPC-users
Indexes:  [Date] [Thread] [Top] [All Lists]
ADSM.ORG Privacy and Data Security by KimLaw, PLLC