Networker

[Networker] Networker (72/74) and Hardware links ...

2008-05-20 06:43:24
Subject: [Networker] Networker (72/74) and Hardware links ...
From: Thierry FAIDHERBE <thierry.faidherbe AT FOREM DOT BE>
To: NETWORKER AT LISTSERV.TEMPLE DOT EDU
Date: Tue, 20 May 2008 12:33:05 +0200
Hello Guys !

Back in town !!!

As long as I am working with Networker (started 12 years from now)
I always found funny things with links (software and hardware ones)
This one is another one ...

I am troubleshooting a recover problem where full recovers are
always OK but failing when dealing with Differentials or incrementals
thru file recovery (using index, not saveset recover) :

Marking files are ok, recover start then stop with ...
recover: recover of rsid 74101 failed: 
        Error receiving files from NSR server `ntnetworker'

No other error msg nor entry in log files.

I have hacked CFI Index and found file processed to be an
hardware link ...

Tested lot of things, including relocation directory to be
in same FS than the original file (for hardware link target inode)
but no way.

Then I started following simulation that ends up with 
missing hardware links from recovered data although files
to be marked for recovery !

Test is based on NSR74 on Windows 2000 with Client 74 on Solaris 10.

Any idea about above failure or following test ?

Thanks

Thierry


############################################################################
################
Starting from /, creating TFD2 test dir with FILE and LINK FOLDERS
LINK/SWLINK1 is Software link to FILE/FILE1
LINK/HWLINK1 is Hardware link to FILE/FILE1
############################################################################
################
[email protected] #
[email protected] # mkdir TFD2
[email protected] # cd TFD2
[email protected] # mkdir FILE
[email protected] # mkdir LINK
[email protected] # cd FILE
[email protected] # touch FILE1
[email protected] # cd ../LINK
[email protected] # ln -s ../FILE/FILE1 SWFILE1
[email protected] # ln ../FILE/FILE1 HWFILE1
[email protected] # cd ..
[email protected] # ls -ltR
.:
total 4
drwxr-xr-x   2 root     other        512 mai  20 11:48 LINK
drwxr-xr-x   2 root     other        512 mai  20 11:48 FILE

./LINK:
total 2
lrwxrwxrwx   1 root     other         13 mai  20 11:48 SWFILE1 ->
../FILE/FILE1
-rw-r--r--   2 root     other          0 mai  20 11:48 HWFILE1

./FILE:
total 0
-rw-r--r--   2 root     other          0 mai  20 11:48 FILE1

############################################################################
################
Saving /TFD2 to AdvFile device ...
############################################################################
################

[email protected] # save -s server -b DISK01 -l full /TFD2
/TFD2/FILE/FILE1
/TFD2/FILE/
/TFD2/LINK/SWFILE1
/TFD2/LINK/HWFILE1
/TFD2/LINK/
/TFD2/
/
save: /TFD2 level=full, 3 KB 00:00:01      7 files

############################################################################
################
Testing Recover : 
Creating /TFD3 and relocate recovering of /TFD2 to /TFD3
############################################################################
################

[email protected] # cd /
[email protected] # mkdir TFD3
[email protected] # cd /TFD3
[email protected] # ls
[email protected] # recover
/TFD3/ not in index
<return> will exit.
Enter directory to browse: /TFD2
recover: Current working directory is /TFD2/
recover> ls
 FILE   LINK
recover> add FILE LINK
/TFD2/FILE
/TFD2/LINK
5 file(s) marked for recovery
recover> relocate /TFD3
recover> recover
recover: Total estimated disk space needed for recover is 3 KB.
Recovering 5 files within /TFD2/ into /TFD3
Volumes needed (all on-line):
        DISK01.RO at G:\Disk01\_AF_readonly
Requesting 5 file(s), this may take a while...
./FILE/FILE1
./LINK/HWFILE1
./FILE/
./LINK/SWFILE1
./LINK/
Received 5 file(s) from NSR server `server'
Recover completion time: Tue May 20 11:49:51 2008
recover> exit

############################################################################
################
ALL IS OK AT THIS STAGE
############################################################################
################




############################################################################
################
/TFD2 Folder has a new file : FILE2
LINK/SWLINK2 is Software link to FILE/FILE2
LINK/HWLINK2 is Hardware link to FILE/FILE2
############################################################################
################

[email protected] # cd /TFD2
[email protected] # ls
FILE  LINK
[email protected] # cd FILE
[email protected] # ls
FILE1
[email protected] # touch FILE2
[email protected] # cd ../LINK
[email protected] # ln ../FILE/FILE2 HWFILE2
[email protected] # ln -s ../FILE/FILE2 SWFILE2

############################################################################
################
Saving /TFD2 to AdvFile device ... (Differential backup)
############################################################################
################

[email protected] # mminfo -q name=/TFD2 -r nsavetime,sscreate,level -s server -o
t
  save time created   lvl
 1211276939 20.05.2008 full

[email protected] # save -s server -b DISK01 -l 1 -t 1211276939 -v /TFD2
save: got prototype for /
save: got prototype for /dev/
save: got prototype for /
save: got prototype for /var/
save: got prototype for /
save: got prototype for /export/
save: got prototype for /usr/
save: got prototype for /
save: got prototype for /
save: got prototype for /
save: got prototype for /
save: Saving files modified since Tue May 20 11:48:59 2008.
chdir(/TFD2)
Name=`/TFD2/', name=`/TFD2/', fname=`./'
save: found protofile spec for /:
  mntasm : mailstore
walk(/TFD2/, ./)
walk(/TFD2/FILE, FILE)
chdir(FILE/) [/TFD2/FILE/ /TFD2/FILE/]
walk(/TFD2/FILE/FILE1, FILE1)
uasm: /TFD2/FILE/FILE1 change time not new enough: Tue May 20 11:48:27 2008
walk(/TFD2/FILE/FILE2, FILE2)
uasm -s /TFD2/FILE/FILE2
uasm -s /TFD2/FILE/
walk(/TFD2/LINK, LINK)
chdir(LINK/) [/TFD2/LINK/ /TFD2/LINK/]
walk(/TFD2/LINK/SWFILE1, SWFILE1)
uasm: /TFD2/LINK/SWFILE1 change time not new enough: Tue May 20 11:48:12
2008
walk(/TFD2/LINK/HWFILE1, HWFILE1)
uasm: /TFD2/LINK/HWFILE1 change time not new enough: Tue May 20 11:48:27
2008
walk(/TFD2/LINK/HWFILE2, HWFILE2)
uasm -s /TFD2/LINK/HWFILE2
save: /TFD2/LINK/HWFILE2 is a link to /TFD2/FILE/FILE2
walk(/TFD2/LINK/SWFILE2, SWFILE2)
uasm -s /TFD2/LINK/SWFILE2
save: /TFD2/LINK/SWFILE2 is a symlink to ../FILE/FILE2
uasm -s /TFD2/LINK/
uasm -s /TFD2/
Connecting directories...
save: found protofile spec for /:
  mntasm : mailstore
matched internal `mntasm' on `var' for `/'
matched internal `mntasm' on `proc' for `/'
matched internal `mntasm' on `tmp' for `/'
matched internal `mntasm' on `net' for `/'
matched internal `mntasm' on `home' for `/'
matched internal `mntasm' on `xfn' for `/'
matched internal `mntasm' on `mailstore' for `/'
uasm -s /

save: /TFD2 level=1, 3 KB 00:00:01      7 files

############################################################################
################
Testing Recover : 
Creating /TFD4 and relocate recovering of /TFD2 to /TFD4
############################################################################
################

[email protected] # cd /
[email protected] # mkdir TFD4
[email protected] # cd TFD4
[email protected] # recover
recover: Current working directory is /TFD4/
recover> cd /TFD2
recover> ls
 FILE   LINK
recover> add FILE LINK
/TFD2/FILE
/TFD2/LINK
8 file(s) marked for recovery
recover> list
/TFD2/FILE/ @ Tue May 20 11:51:42 2008
/TFD2/LINK/ @ Tue May 20 11:51:42 2008
/TFD2/FILE/FILE1 @ Tue May 20 11:48:59 2008
/TFD2/FILE/FILE2 @ Tue May 20 11:51:42 2008
/TFD2/LINK/HWFILE1 @ Tue May 20 11:48:59 2008
/TFD2/LINK/HWFILE2 @ Tue May 20 11:51:42 2008
/TFD2/LINK/SWFILE1 @ Tue May 20 11:48:59 2008
/TFD2/LINK/SWFILE2 @ Tue May 20 11:51:42 2008
8 file(s) marked for recovery
recover> relocate /TFD4
recover> recover
recover: Total estimated disk space needed for recover is 4 KB.
Recovering 8 files within /TFD2/ into /TFD4
Volumes needed (all on-line):
        DISK01.RO at G:\Disk01\_AF_readonly
Requesting 8 file(s), this may take a while...
./FILE/FILE2
./LINK/HWFILE2
./FILE/FILE1
./LINK/SWFILE1
./FILE/
./LINK/SWFILE2
./LINK/
Received 7 file(s) from NSR server `server'
Recover completion time: Tue May 20 11:52:32 2008
recover> exit

############################################################################
################
8 FILES ARE MARKED FOR RECOVERY,
7 FILES ARE RECOVERED
############################################################################
################
[email protected] # pwd
/TFD4
[email protected] # find . -print
.
./FILE
./FILE/FILE2
./FILE/FILE1
./LINK
./LINK/HWFILE2
./LINK/SWFILE1
./LINK/SWFILE2

############################################################################
################
DATA LOST : ./LINK/HWFILE is missing
############################################################################
################



############################################################################
################
/TFD2 Folder has a new file : FILE3
LINK/SWLINK3 is Software link to FILE/FILE3
LINK/HWLINK3 is Hardware link to FILE/FILE3
############################################################################
################

[email protected] # cd /TFD2
[email protected] # cd FILE
[email protected] # ls
FILE1  FILE2
[email protected] # touch FILE3
[email protected] # cd ../LINK
[email protected] # ln ../FILE/FILE3 HWFILE3
[email protected] # ln -s ../FILE/FILE3 SWFILE3

############################################################################
################
Saving /TFD2 to AdvFile device ... (Differential backup)
############################################################################
################

[email protected] # mminfo -q name=/TFD2 -r nsavetime,sscreate,level -s server -o
t
  save time created   lvl
 1211276939 20.05.2008 full
 1211277102 20.05.2008  1

[email protected] # save -s server -b DISK01 -l 1 -t 1211277102 /TFD2
save: Saving files modified since Tue May 20 11:51:42 2008.
/TFD2/FILE/FILE3
/TFD2/FILE/
/TFD2/LINK/HWFILE3
/TFD2/LINK/SWFILE3
/TFD2/LINK/
/TFD2/
/

save: /TFD2 level=1, 3 KB 00:00:00      7 files

############################################################################
################
Testing Recover : 
Creating /TFD5 and relocate recovering of /TFD2 to /TFD5
############################################################################
################

[email protected] # cd /
[email protected] # mkdir TFD5
[email protected] # cd TFD5
[email protected] # recover
/TFD5/ not in index
<return> will exit.
Enter directory to browse: /TFD2
recover: Current working directory is /TFD2/
recover> ls
 FILE   LINK
recover> add FILE LINK
/TFD2/FILE
/TFD2/LINK
11 file(s) marked for recovery
recover> list
/TFD2/FILE/ @ Tue May 20 11:55:34 2008
/TFD2/LINK/ @ Tue May 20 11:55:34 2008
/TFD2/FILE/FILE1 @ Tue May 20 11:48:59 2008
/TFD2/FILE/FILE2 @ Tue May 20 11:51:42 2008
/TFD2/FILE/FILE3 @ Tue May 20 11:55:34 2008
/TFD2/LINK/HWFILE1 @ Tue May 20 11:48:59 2008
/TFD2/LINK/HWFILE2 @ Tue May 20 11:51:42 2008
/TFD2/LINK/HWFILE3 @ Tue May 20 11:55:34 2008
/TFD2/LINK/SWFILE1 @ Tue May 20 11:48:59 2008
/TFD2/LINK/SWFILE2 @ Tue May 20 11:51:42 2008
/TFD2/LINK/SWFILE3 @ Tue May 20 11:55:34 2008
11 file(s) marked for recovery
recover> relocate /TFD5
recover> recover
recover: Total estimated disk space needed for recover is 5 KB.
Recovering 11 files within /TFD2/ into /TFD5
Volumes needed (all on-line):
        DISK01.RO at G:\Disk01\_AF_readonly
Requesting 11 file(s), this may take a while...
./FILE/FILE3
./FILE/FILE2
./LINK/HWFILE3
./LINK/HWFILE2
./FILE/FILE1
./LINK/SWFILE2
./FILE/
./LINK/SWFILE3
./LINK/SWFILE1
./LINK/
Received 10 file(s) from NSR server `server'
Recover completion time: Tue May 20 11:56:14 2008
recover> exit

############################################################################
################
11 FILES ARE MARKED FOR RECOVERY,
10 FILES ARE RECOVERED
############################################################################
################

[email protected] # find /TFD5 -print
/TFD5
/TFD5/FILE
/TFD5/FILE/FILE3
/TFD5/FILE/FILE2
/TFD5/FILE/FILE1
/TFD5/LINK
/TFD5/LINK/HWFILE3
/TFD5/LINK/HWFILE2
/TFD5/LINK/SWFILE2
/TFD5/LINK/SWFILE3
/TFD5/LINK/SWFILE1

############################################################################
################
DATA LOST : ./LINK/HWFILE is missing
############################################################################
################




Thierry FAIDHERBE
Backup/Storage & System Management

LE FOREM - Administration Centrale 
Département des Systèmes d'Information 
Boulevard Tirou, 104 
B-6000 CHARLEROI 
BELGIUM 

To sign off this list, send email to listserv AT listserv.temple DOT edu and 
type "signoff networker" in the body of the email. Please write to 
networker-request AT listserv.temple DOT edu if you have any problems with this 
list. You can access the archives at 
http://listserv.temple.edu/archives/networker.html or
via RSS at http://listserv.temple.edu/cgi-bin/wa?RSS&L=NETWORKER

<Prev in Thread] Current Thread [Next in Thread>