Networker

[Networker] Networker (72/74) and Hardware links ...

2008-05-20 06:43:24
Subject: [Networker] Networker (72/74) and Hardware links ...
From: Thierry FAIDHERBE <thierry.faidherbe AT FOREM DOT BE>
To: NETWORKER AT LISTSERV.TEMPLE DOT EDU
Date: Tue, 20 May 2008 12:33:05 +0200
Hello Guys !

Back in town !!!

As long as I am working with Networker (started 12 years from now)
I always found funny things with links (software and hardware ones)
This one is another one ...

I am troubleshooting a recover problem where full recovers are
always OK but failing when dealing with Differentials or incrementals
thru file recovery (using index, not saveset recover) :

Marking files are ok, recover start then stop with ...
recover: recover of rsid 74101 failed: 
        Error receiving files from NSR server `ntnetworker'

No other error msg nor entry in log files.

I have hacked CFI Index and found file processed to be an
hardware link ...

Tested lot of things, including relocation directory to be
in same FS than the original file (for hardware link target inode)
but no way.

Then I started following simulation that ends up with 
missing hardware links from recovered data although files
to be marked for recovery !

Test is based on NSR74 on Windows 2000 with Client 74 on Solaris 10.

Any idea about above failure or following test ?

Thanks

Thierry


############################################################################
################
Starting from /, creating TFD2 test dir with FILE and LINK FOLDERS
LINK/SWLINK1 is Software link to FILE/FILE1
LINK/HWLINK1 is Hardware link to FILE/FILE1
############################################################################
################
root@client #
root@client # mkdir TFD2
root@client # cd TFD2
root@client # mkdir FILE
root@client # mkdir LINK
root@client # cd FILE
root@client # touch FILE1
root@client # cd ../LINK
root@client # ln -s ../FILE/FILE1 SWFILE1
root@client # ln ../FILE/FILE1 HWFILE1
root@client # cd ..
root@client # ls -ltR
.:
total 4
drwxr-xr-x   2 root     other        512 mai  20 11:48 LINK
drwxr-xr-x   2 root     other        512 mai  20 11:48 FILE

./LINK:
total 2
lrwxrwxrwx   1 root     other         13 mai  20 11:48 SWFILE1 ->
../FILE/FILE1
-rw-r--r--   2 root     other          0 mai  20 11:48 HWFILE1

./FILE:
total 0
-rw-r--r--   2 root     other          0 mai  20 11:48 FILE1

############################################################################
################
Saving /TFD2 to AdvFile device ...
############################################################################
################

root@client # save -s server -b DISK01 -l full /TFD2
/TFD2/FILE/FILE1
/TFD2/FILE/
/TFD2/LINK/SWFILE1
/TFD2/LINK/HWFILE1
/TFD2/LINK/
/TFD2/
/
save: /TFD2 level=full, 3 KB 00:00:01      7 files

############################################################################
################
Testing Recover : 
Creating /TFD3 and relocate recovering of /TFD2 to /TFD3
############################################################################
################

root@client # cd /
root@client # mkdir TFD3
root@client # cd /TFD3
root@client # ls
root@client # recover
/TFD3/ not in index
<return> will exit.
Enter directory to browse: /TFD2
recover: Current working directory is /TFD2/
recover> ls
 FILE   LINK
recover> add FILE LINK
/TFD2/FILE
/TFD2/LINK
5 file(s) marked for recovery
recover> relocate /TFD3
recover> recover
recover: Total estimated disk space needed for recover is 3 KB.
Recovering 5 files within /TFD2/ into /TFD3
Volumes needed (all on-line):
        DISK01.RO at G:\Disk01\_AF_readonly
Requesting 5 file(s), this may take a while...
./FILE/FILE1
./LINK/HWFILE1
./FILE/
./LINK/SWFILE1
./LINK/
Received 5 file(s) from NSR server `server'
Recover completion time: Tue May 20 11:49:51 2008
recover> exit

############################################################################
################
ALL IS OK AT THIS STAGE
############################################################################
################




############################################################################
################
/TFD2 Folder has a new file : FILE2
LINK/SWLINK2 is Software link to FILE/FILE2
LINK/HWLINK2 is Hardware link to FILE/FILE2
############################################################################
################

root@client # cd /TFD2
root@client # ls
FILE  LINK
root@client # cd FILE
root@client # ls
FILE1
root@client # touch FILE2
root@client # cd ../LINK
root@client # ln ../FILE/FILE2 HWFILE2
root@client # ln -s ../FILE/FILE2 SWFILE2

############################################################################
################
Saving /TFD2 to AdvFile device ... (Differential backup)
############################################################################
################

root@client # mminfo -q name=/TFD2 -r nsavetime,sscreate,level -s server -o
t
  save time created   lvl
 1211276939 20.05.2008 full

root@client # save -s server -b DISK01 -l 1 -t 1211276939 -v /TFD2
save: got prototype for /
save: got prototype for /dev/
save: got prototype for /
save: got prototype for /var/
save: got prototype for /
save: got prototype for /export/
save: got prototype for /usr/
save: got prototype for /
save: got prototype for /
save: got prototype for /
save: got prototype for /
save: Saving files modified since Tue May 20 11:48:59 2008.
chdir(/TFD2)
Name=`/TFD2/', name=`/TFD2/', fname=`./'
save: found protofile spec for /:
  mntasm : mailstore
walk(/TFD2/, ./)
walk(/TFD2/FILE, FILE)
chdir(FILE/) [/TFD2/FILE/ /TFD2/FILE/]
walk(/TFD2/FILE/FILE1, FILE1)
uasm: /TFD2/FILE/FILE1 change time not new enough: Tue May 20 11:48:27 2008
walk(/TFD2/FILE/FILE2, FILE2)
uasm -s /TFD2/FILE/FILE2
uasm -s /TFD2/FILE/
walk(/TFD2/LINK, LINK)
chdir(LINK/) [/TFD2/LINK/ /TFD2/LINK/]
walk(/TFD2/LINK/SWFILE1, SWFILE1)
uasm: /TFD2/LINK/SWFILE1 change time not new enough: Tue May 20 11:48:12
2008
walk(/TFD2/LINK/HWFILE1, HWFILE1)
uasm: /TFD2/LINK/HWFILE1 change time not new enough: Tue May 20 11:48:27
2008
walk(/TFD2/LINK/HWFILE2, HWFILE2)
uasm -s /TFD2/LINK/HWFILE2
save: /TFD2/LINK/HWFILE2 is a link to /TFD2/FILE/FILE2
walk(/TFD2/LINK/SWFILE2, SWFILE2)
uasm -s /TFD2/LINK/SWFILE2
save: /TFD2/LINK/SWFILE2 is a symlink to ../FILE/FILE2
uasm -s /TFD2/LINK/
uasm -s /TFD2/
Connecting directories...
save: found protofile spec for /:
  mntasm : mailstore
matched internal `mntasm' on `var' for `/'
matched internal `mntasm' on `proc' for `/'
matched internal `mntasm' on `tmp' for `/'
matched internal `mntasm' on `net' for `/'
matched internal `mntasm' on `home' for `/'
matched internal `mntasm' on `xfn' for `/'
matched internal `mntasm' on `mailstore' for `/'
uasm -s /

save: /TFD2 level=1, 3 KB 00:00:01      7 files

############################################################################
################
Testing Recover : 
Creating /TFD4 and relocate recovering of /TFD2 to /TFD4
############################################################################
################

root@client # cd /
root@client # mkdir TFD4
root@client # cd TFD4
root@client # recover
recover: Current working directory is /TFD4/
recover> cd /TFD2
recover> ls
 FILE   LINK
recover> add FILE LINK
/TFD2/FILE
/TFD2/LINK
8 file(s) marked for recovery
recover> list
/TFD2/FILE/ @ Tue May 20 11:51:42 2008
/TFD2/LINK/ @ Tue May 20 11:51:42 2008
/TFD2/FILE/FILE1 @ Tue May 20 11:48:59 2008
/TFD2/FILE/FILE2 @ Tue May 20 11:51:42 2008
/TFD2/LINK/HWFILE1 @ Tue May 20 11:48:59 2008
/TFD2/LINK/HWFILE2 @ Tue May 20 11:51:42 2008
/TFD2/LINK/SWFILE1 @ Tue May 20 11:48:59 2008
/TFD2/LINK/SWFILE2 @ Tue May 20 11:51:42 2008
8 file(s) marked for recovery
recover> relocate /TFD4
recover> recover
recover: Total estimated disk space needed for recover is 4 KB.
Recovering 8 files within /TFD2/ into /TFD4
Volumes needed (all on-line):
        DISK01.RO at G:\Disk01\_AF_readonly
Requesting 8 file(s), this may take a while...
./FILE/FILE2
./LINK/HWFILE2
./FILE/FILE1
./LINK/SWFILE1
./FILE/
./LINK/SWFILE2
./LINK/
Received 7 file(s) from NSR server `server'
Recover completion time: Tue May 20 11:52:32 2008
recover> exit

############################################################################
################
8 FILES ARE MARKED FOR RECOVERY,
7 FILES ARE RECOVERED
############################################################################
################
root@client # pwd
/TFD4
root@client # find . -print
.
./FILE
./FILE/FILE2
./FILE/FILE1
./LINK
./LINK/HWFILE2
./LINK/SWFILE1
./LINK/SWFILE2

############################################################################
################
DATA LOST : ./LINK/HWFILE is missing
############################################################################
################



############################################################################
################
/TFD2 Folder has a new file : FILE3
LINK/SWLINK3 is Software link to FILE/FILE3
LINK/HWLINK3 is Hardware link to FILE/FILE3
############################################################################
################

root@client # cd /TFD2
root@client # cd FILE
root@client # ls
FILE1  FILE2
root@client # touch FILE3
root@client # cd ../LINK
root@client # ln ../FILE/FILE3 HWFILE3
root@client # ln -s ../FILE/FILE3 SWFILE3

############################################################################
################
Saving /TFD2 to AdvFile device ... (Differential backup)
############################################################################
################

root@client # mminfo -q name=/TFD2 -r nsavetime,sscreate,level -s server -o
t
  save time created   lvl
 1211276939 20.05.2008 full
 1211277102 20.05.2008  1

root@client # save -s server -b DISK01 -l 1 -t 1211277102 /TFD2
save: Saving files modified since Tue May 20 11:51:42 2008.
/TFD2/FILE/FILE3
/TFD2/FILE/
/TFD2/LINK/HWFILE3
/TFD2/LINK/SWFILE3
/TFD2/LINK/
/TFD2/
/

save: /TFD2 level=1, 3 KB 00:00:00      7 files

############################################################################
################
Testing Recover : 
Creating /TFD5 and relocate recovering of /TFD2 to /TFD5
############################################################################
################

root@client # cd /
root@client # mkdir TFD5
root@client # cd TFD5
root@client # recover
/TFD5/ not in index
<return> will exit.
Enter directory to browse: /TFD2
recover: Current working directory is /TFD2/
recover> ls
 FILE   LINK
recover> add FILE LINK
/TFD2/FILE
/TFD2/LINK
11 file(s) marked for recovery
recover> list
/TFD2/FILE/ @ Tue May 20 11:55:34 2008
/TFD2/LINK/ @ Tue May 20 11:55:34 2008
/TFD2/FILE/FILE1 @ Tue May 20 11:48:59 2008
/TFD2/FILE/FILE2 @ Tue May 20 11:51:42 2008
/TFD2/FILE/FILE3 @ Tue May 20 11:55:34 2008
/TFD2/LINK/HWFILE1 @ Tue May 20 11:48:59 2008
/TFD2/LINK/HWFILE2 @ Tue May 20 11:51:42 2008
/TFD2/LINK/HWFILE3 @ Tue May 20 11:55:34 2008
/TFD2/LINK/SWFILE1 @ Tue May 20 11:48:59 2008
/TFD2/LINK/SWFILE2 @ Tue May 20 11:51:42 2008
/TFD2/LINK/SWFILE3 @ Tue May 20 11:55:34 2008
11 file(s) marked for recovery
recover> relocate /TFD5
recover> recover
recover: Total estimated disk space needed for recover is 5 KB.
Recovering 11 files within /TFD2/ into /TFD5
Volumes needed (all on-line):
        DISK01.RO at G:\Disk01\_AF_readonly
Requesting 11 file(s), this may take a while...
./FILE/FILE3
./FILE/FILE2
./LINK/HWFILE3
./LINK/HWFILE2
./FILE/FILE1
./LINK/SWFILE2
./FILE/
./LINK/SWFILE3
./LINK/SWFILE1
./LINK/
Received 10 file(s) from NSR server `server'
Recover completion time: Tue May 20 11:56:14 2008
recover> exit

############################################################################
################
11 FILES ARE MARKED FOR RECOVERY,
10 FILES ARE RECOVERED
############################################################################
################

root@client # find /TFD5 -print
/TFD5
/TFD5/FILE
/TFD5/FILE/FILE3
/TFD5/FILE/FILE2
/TFD5/FILE/FILE1
/TFD5/LINK
/TFD5/LINK/HWFILE3
/TFD5/LINK/HWFILE2
/TFD5/LINK/SWFILE2
/TFD5/LINK/SWFILE3
/TFD5/LINK/SWFILE1

############################################################################
################
DATA LOST : ./LINK/HWFILE is missing
############################################################################
################




Thierry FAIDHERBE
Backup/Storage & System Management

LE FOREM - Administration Centrale 
Département des Systèmes d'Information 
Boulevard Tirou, 104 
B-6000 CHARLEROI 
BELGIUM 

To sign off this list, send email to listserv AT listserv.temple DOT edu and 
type "signoff networker" in the body of the email. Please write to 
networker-request AT listserv.temple DOT edu if you have any problems with this 
list. You can access the archives at 
http://listserv.temple.edu/archives/networker.html or
via RSS at http://listserv.temple.edu/cgi-bin/wa?RSS&L=NETWORKER

<Prev in Thread] Current Thread [Next in Thread>