Veritas-bu

[Veritas-bu] netbackup "Full" backups stopping

2003-12-30 08:37:04
Subject: [Veritas-bu] netbackup "Full" backups stopping
From: ckstehman AT pepco DOT com (ckstehman AT pepco DOT com)
Date: Tue, 30 Dec 2003 08:37:04 -0500
This is a multipart message in MIME format.
--=_alternative 004ACE4C85256E0C_=
Content-Type: text/plain; charset="us-ascii"

We have seen similar issues to this caused by a "hung" NFS mount.  You 
could check to
be sure all of your NFS mounts are good.

=============================
Carl Stehman
PHI Services Company
202-331-6619
Pager 301-765-2703
ckstehman AT pepco DOT com





Neil Hunt <grover AT huntcorp.com DOT au>
Sent by: veritas-bu-admin AT mailman.eng.auburn DOT edu
12/29/2003 11:11 PM

 
        To:     veritas-bu AT mailman.eng.auburn DOT edu
        cc: 
        Subject:        [Veritas-bu] netbackup "Full" backups stopping


G'day,
Over the last few weeks, we have been having major problems with NBU
full backups.  Basically the backups fire off, but after about 30
seconds they just stop and sit there.  (I have copied the log file from
one at the bottom).
The only change that has been made is the addition of 4.5MP5, but this
was only done on the 24th (well after the problems started).

Unusually, when MPX is set, bpsched will fire up the initial number of
jobs, and then, when one is done, it will fire up another set of jobs
(the same number as the MPX level).  I can get maybe one or two jobs to
complete out of the 9 that are supposed to run. 
Also, it seems that the incremental jobs are running properly, and these
are set up the same way.

Product: NBU 4.5 MP5
OS: Solaris (all Solaris client, but one (Win2k) (no difference)
Hardware: L9 with DLT8000

There hasn't been a proper full backup in about a month, and this is
getting to the desparate stage, so some help would be mightily
appreciated.

Neil



bpbkar logfile 

11:55:36.534 [2373] **LOCALE ERROR** locale <en_AU.ISO8859-1> not found
in file </usr/openv/msg/.conf>
11:55:36.543 [2373] <4> bpbkar main: real locales
</C/en_AU.ISO8859-1/en_AU.ISO8859-1/en_AU.ISO8859-1/C/C>
11:55:36.543 [2373] <4> bpbkar main: standardized locales - lc_messages
<C> lc_ctype <C> lc_time <C> lc_collate <C> lc_numeric <C>
11:55:36.553 [2373] <2> logparams: bpbkar -r 1129032 -ru root -dt 0 -to
0 -clnt aufin2 -class AFG -sched Full -st FULL -bpstart_to 300 -bpend_to
300 -read_to 600 -fso -Z -b aufin2_1072756532 -kl 28 -shm 
11:55:36.557 [2373] <2> mount build_mount_list: INF - Processing (ufs)
/dev/md/dsk/d100 on /
11:55:36.558 [2373] <2> mount build_mount_list: INF - Processing (proc)
/proc on /proc
11:55:36.558 [2373] <2> mount build_mount_list: INF - Processing (fd) fd
on /dev/fd
11:55:36.558 [2373] <2> mount build_mount_list: INF - Processing (mntfs)
mnttab on /etc/mnttab
11:55:36.558 [2373] <2> mount build_mount_list: INF - Processing (ufs)
/dev/md/dsk/d110 on /var
11:55:36.558 [2373] <2> mount build_mount_list: INF - Processing (tmpfs)
swap on /var/run
11:55:36.558 [2373] <2> mount build_mount_list: INF - Processing (tmpfs)
swap on /tmp
11:55:36.558 [2373] <2> mount build_mount_list: INF - Processing (ufs)
/dev/md/dsk/d6 on /u06
11:55:36.558 [2373] <2> mount build_mount_list: INF - Processing (ufs)
/dev/md/dsk/d20 on /u04
11:55:36.558 [2373] <2> mount build_mount_list: INF - Processing (ufs)
/dev/md/dsk/d70 on /u01
11:55:36.558 [2373] <2> mount build_mount_list: INF - Processing (ufs)
/dev/md/dsk/d10 on /u03
11:55:36.558 [2373] <2> mount build_mount_list: INF - Processing (ufs)
/dev/md/dsk/d30 on /u05
11:55:36.558 [2373] <2> mount build_mount_list: INF - Processing (ufs)
/dev/md/dsk/d40 on /u08
11:55:36.564 [2373] <2> mount build_mount_list: INF - Processing (ufs)
/dev/md/dsk/d60 on /u07
11:55:36.565 [2373] <2> mount build_mount_list: INF - Processing (ufs)
/dev/md/dsk/d120 on /u02
11:55:36.565 [2373] <2> mount build_mount_list: INF - Processing (ufs)
/dev/md/dsk/d84 on /export
11:55:36.565 [2373] <2> mount build_mount_list: INF - Processing (NFS)
aufin3:/u01/staging on /staging
11:55:36.565 [2373] <2> mount build_mount_list: INF - Processing
(autofs) -hosts on /net
11:55:36.565 [2373] <2> mount build_mount_list: INF - Processing
(autofs) auto_home on /home
11:55:36.565 [2373] <2> mount build_mount_list: INF - Processing
(autofs) -xfn on /xfn
11:55:36.573 [2373] <2> bpbkar initialize: INF - Selecting ALL files
11:55:36.573 [2373] <4> bpbkar main: INF - setenv KEYWORD=NONE
11:55:36.573 [2373] <4> bpbkar main: INF - setenv STREAM_PID=2373
11:55:36.573 [2373] <4> bpbkar main: INF - setenv STREAM_NUMBER=0
11:55:36.573 [2373] <4> bpbkar main: INF - setenv STREAM_COUNT=0
11:55:36.573 [2373] <4> bpbkar main: INF - setenv STREAMS=0
11:55:36.573 [2373] <4> bpbkar main: INF - setenv BPSTART_TIMEOUT=300
11:55:36.574 [2373] <4> bpbkar main: INF - setenv BPEND_TIMEOUT=300
11:55:36.574 [2373] <4> bpbkar main: INF - setenv
BACKUPID=aufin2_1072756532
11:55:36.574 [2373] <4> bpbkar main: INF - setenv
UNIXBACKUPTIME=1072756532
11:55:36.574 [2373] <4> bpbkar main: INF - setenv BACKUPTIME=Tue Dec 30
11:55:32 2003

11:55:36.595 [2373] <4> bpbkar main: INF - BACKUP START
11:55:36.596 [2373] <4> bpbkar main: INF - Estimate:-1 -1
11:55:36.597 [2373] <2> bpbkar main: INF - CONTINUE BACKUP message
received
11:55:38.616 [2373] <2> bpbkar setup_shm: INF - media_shm_info = 8 32768
51112 2374 0 0 0 0 1
11:55:38.616 [2373] <2> bpbkar setup_shm: INF - SHMID = 51112, BUF_PTR =
0xff0c0000, BUF_CONTROL = 0xff100000, readyptr = 0xff1000c0
11:55:38.626 [2373] <4> bpbkar expand_wildcards: INF - Processing
/u01/finprod
11:55:38.662 [2373] <8> bpbkar validate_argument: WRN - Cannot process
path /u01/finprod: No such file or directory. Skipping.
11:55:38.662 [2373] <4> bpbkar expand_wildcards: INF - Processing /
11:55:38.684 [2373] <2> mount build_mount_list: INF - Processing (ufs)
/dev/md/dsk/d100 on /
11:55:38.684 [2373] <2> mount build_mount_list: INF - Processing (proc)
/proc on /proc
11:55:38.684 [2373] <2> mount build_mount_list: INF - Processing (fd) fd
on /dev/fd
11:55:38.684 [2373] <2> mount build_mount_list: INF - Processing (mntfs)
mnttab on /etc/mnttab
11:55:38.684 [2373] <2> mount build_mount_list: INF - Processing (ufs)
/dev/md/dsk/d110 on /var
11:55:38.684 [2373] <2> mount build_mount_list: INF - Processing (tmpfs)
swap on /var/run
11:55:38.684 [2373] <2> mount build_mount_list: INF - Processing (tmpfs)
swap on /tmp
11:55:38.684 [2373] <2> mount build_mount_list: INF - Processing (ufs)
/dev/md/dsk/d6 on /u06
11:55:38.684 [2373] <2> mount build_mount_list: INF - Processing (ufs)
/dev/md/dsk/d20 on /u04
11:55:38.684 [2373] <2> mount build_mount_list: INF - Processing (ufs)
/dev/md/dsk/d70 on /u01
11:55:38.684 [2373] <2> mount build_mount_list: INF - Processing (ufs)
/dev/md/dsk/d10 on /u03
11:55:38.685 [2373] <2> mount build_mount_list: INF - Processing (ufs)
/dev/md/dsk/d30 on /u05
11:55:38.685 [2373] <2> mount build_mount_list: INF - Processing (ufs)
/dev/md/dsk/d40 on /u08
11:55:38.685 [2373] <2> mount build_mount_list: INF - Processing (ufs)
/dev/md/dsk/d60 on /u07
11:55:38.685 [2373] <2> mount build_mount_list: INF - Processing (ufs)
/dev/md/dsk/d120 on /u02
11:55:38.685 [2373] <2> mount build_mount_list: INF - Processing (ufs)
/dev/md/dsk/d84 on /export
11:55:38.685 [2373] <2> mount build_mount_list: INF - Processing (NFS)
aufin3:/u01/staging on /staging
11:55:38.685 [2373] <2> mount build_mount_list: INF - Processing
(autofs) -hosts on /net
11:55:38.685 [2373] <2> mount build_mount_list: INF - Processing
(autofs) auto_home on /home
11:55:38.685 [2373] <2> mount build_mount_list: INF - Processing
(autofs) -xfn on /xfn
11:55:38.686 [2373] <2> bpbkar SelectFile: INF - Resolved_path = /
11:55:38.686 [2373] <2> bpbkar resolve_path: INF - Actual mount point of
/ is /
11:55:38.691 [2373] <4> bpbkar PrintFile: /
11:55:38.697 [2373] <4> bpbkar PrintFile: /bin
11:55:38.703 [2373] <4> bpbkar PrintFile: /lib
11:55:38.708 [2373] <4> bpbkar compress_file: INF - Compression:  44.94%
/.sh_history
11:55:38.709 [2373] <4> bpbkar PrintFile: /.sh_history
11:55:38.715 [2373] <4> bpbkar compress_file: INF - Compression:  50.85%
/.profile
11:55:38.715 [2373] <4> bpbkar PrintFile: /.profile
11:55:38.718 [2373] <4> bpbkar compress_file: INF - Compression:  53.00%
/.dtprofile
11:55:38.719 [2373] <4> bpbkar PrintFile: /.dtprofile

_______________________________________________
Veritas-bu maillist  -  Veritas-bu AT mailman.eng.auburn DOT edu
http://mailman.eng.auburn.edu/mailman/listinfo/veritas-bu




--=_alternative 004ACE4C85256E0C_=
Content-Type: text/html; charset="us-ascii"


<br><font size=2 face="sans-serif">We have seen similar issues to this caused 
by a &quot;hung&quot; NFS mount. &nbsp;You could check to</font>
<br><font size=2 face="sans-serif">be sure all of your NFS mounts are 
good.</font>
<br><font size=2 face="sans-serif"><br>
=============================<br>
Carl Stehman<br>
PHI Services Company<br>
202-331-6619<br>
Pager 301-765-2703<br>
ckstehman AT pepco DOT com</font>
<br>
<br>
<br>
<br>
<table width=100%>
<tr valign=top>
<td>
<td><font size=1 face="sans-serif"><b>Neil Hunt &lt;grover AT huntcorp.com DOT 
au&gt;</b></font>
<br><font size=1 face="sans-serif">Sent by: veritas-bu-admin AT 
mailman.eng.auburn DOT edu</font>
<p><font size=1 face="sans-serif">12/29/2003 11:11 PM</font>
<br>
<td><font size=1 face="Arial">&nbsp; &nbsp; &nbsp; &nbsp; </font>
<br><font size=1 face="sans-serif">&nbsp; &nbsp; &nbsp; &nbsp; To: &nbsp; 
&nbsp; &nbsp; &nbsp;veritas-bu AT mailman.eng.auburn DOT edu</font>
<br><font size=1 face="sans-serif">&nbsp; &nbsp; &nbsp; &nbsp; cc: &nbsp; 
&nbsp; &nbsp; &nbsp;</font>
<br><font size=1 face="sans-serif">&nbsp; &nbsp; &nbsp; &nbsp; Subject: &nbsp; 
&nbsp; &nbsp; &nbsp;[Veritas-bu] netbackup &quot;Full&quot; backups 
stopping</font></table>
<br>
<br>
<br><font size=2 face="Courier New">G'day,<br>
Over the last few weeks, we have been having major problems with NBU<br>
full backups. &nbsp;Basically the backups fire off, but after about 30<br>
seconds they just stop and sit there. &nbsp;(I have copied the log file from<br>
one at the bottom).<br>
The only change that has been made is the addition of 4.5MP5, but this<br>
was only done on the 24th (well after the problems started).<br>
<br>
Unusually, when MPX is set, bpsched will fire up the initial number of<br>
jobs, and then, when one is done, it will fire up another set of jobs<br>
(the same number as the MPX level). &nbsp;I can get maybe one or two jobs to<br>
complete out of the 9 that are supposed to run. &nbsp;<br>
Also, it seems that the incremental jobs are running properly, and these<br>
are set up the same way.<br>
<br>
Product: NBU 4.5 MP5<br>
OS: Solaris (all Solaris client, but one (Win2k) (no difference)<br>
Hardware: L9 with DLT8000<br>
<br>
There hasn't been a proper full backup in about a month, and this is<br>
getting to the desparate stage, so some help would be mightily<br>
appreciated.<br>
<br>
Neil<br>
<br>
<br>
<br>
bpbkar logfile <br>
<br>
11:55:36.534 [2373] **LOCALE ERROR** locale &lt;en_AU.ISO8859-1&gt; not 
found<br>
in file &lt;/usr/openv/msg/.conf&gt;<br>
11:55:36.543 [2373] &lt;4&gt; bpbkar main: real locales<br>
&lt;/C/en_AU.ISO8859-1/en_AU.ISO8859-1/en_AU.ISO8859-1/C/C&gt;<br>
11:55:36.543 [2373] &lt;4&gt; bpbkar main: standardized locales - 
lc_messages<br>
&lt;C&gt; lc_ctype &lt;C&gt; lc_time &lt;C&gt; lc_collate &lt;C&gt; lc_numeric 
&lt;C&gt;<br>
11:55:36.553 [2373] &lt;2&gt; logparams: bpbkar -r 1129032 -ru root -dt 0 
-to<br>
0 -clnt aufin2 -class AFG -sched Full -st FULL -bpstart_to 300 -bpend_to<br>
300 -read_to 600 -fso -Z -b aufin2_1072756532 -kl 28 -shm <br>
11:55:36.557 [2373] &lt;2&gt; mount build_mount_list: INF - Processing (ufs)<br>
/dev/md/dsk/d100 on /<br>
11:55:36.558 [2373] &lt;2&gt; mount build_mount_list: INF - Processing 
(proc)<br>
/proc on /proc<br>
11:55:36.558 [2373] &lt;2&gt; mount build_mount_list: INF - Processing (fd) 
fd<br>
on /dev/fd<br>
11:55:36.558 [2373] &lt;2&gt; mount build_mount_list: INF - Processing 
(mntfs)<br>
mnttab on /etc/mnttab<br>
11:55:36.558 [2373] &lt;2&gt; mount build_mount_list: INF - Processing (ufs)<br>
/dev/md/dsk/d110 on /var<br>
11:55:36.558 [2373] &lt;2&gt; mount build_mount_list: INF - Processing 
(tmpfs)<br>
swap on /var/run<br>
11:55:36.558 [2373] &lt;2&gt; mount build_mount_list: INF - Processing 
(tmpfs)<br>
swap on /tmp<br>
11:55:36.558 [2373] &lt;2&gt; mount build_mount_list: INF - Processing (ufs)<br>
/dev/md/dsk/d6 on /u06<br>
11:55:36.558 [2373] &lt;2&gt; mount build_mount_list: INF - Processing (ufs)<br>
/dev/md/dsk/d20 on /u04<br>
11:55:36.558 [2373] &lt;2&gt; mount build_mount_list: INF - Processing (ufs)<br>
/dev/md/dsk/d70 on /u01<br>
11:55:36.558 [2373] &lt;2&gt; mount build_mount_list: INF - Processing (ufs)<br>
/dev/md/dsk/d10 on /u03<br>
11:55:36.558 [2373] &lt;2&gt; mount build_mount_list: INF - Processing (ufs)<br>
/dev/md/dsk/d30 on /u05<br>
11:55:36.558 [2373] &lt;2&gt; mount build_mount_list: INF - Processing 
(ufs)</font>
<br><font size=2 face="Courier New">/dev/md/dsk/d40 on /u08<br>
11:55:36.564 [2373] &lt;2&gt; mount build_mount_list: INF - Processing (ufs)<br>
/dev/md/dsk/d60 on /u07<br>
11:55:36.565 [2373] &lt;2&gt; mount build_mount_list: INF - Processing (ufs)<br>
/dev/md/dsk/d120 on /u02<br>
11:55:36.565 [2373] &lt;2&gt; mount build_mount_list: INF - Processing (ufs)<br>
/dev/md/dsk/d84 on /export<br>
11:55:36.565 [2373] &lt;2&gt; mount build_mount_list: INF - Processing (NFS)<br>
aufin3:/u01/staging on /staging<br>
11:55:36.565 [2373] &lt;2&gt; mount build_mount_list: INF - Processing<br>
(autofs) -hosts on /net<br>
11:55:36.565 [2373] &lt;2&gt; mount build_mount_list: INF - Processing<br>
(autofs) auto_home on /home<br>
11:55:36.565 [2373] &lt;2&gt; mount build_mount_list: INF - Processing<br>
(autofs) -xfn on /xfn<br>
11:55:36.573 [2373] &lt;2&gt; bpbkar initialize: INF - Selecting ALL files<br>
11:55:36.573 [2373] &lt;4&gt; bpbkar main: INF - setenv KEYWORD=NONE<br>
11:55:36.573 [2373] &lt;4&gt; bpbkar main: INF - setenv STREAM_PID=2373<br>
11:55:36.573 [2373] &lt;4&gt; bpbkar main: INF - setenv STREAM_NUMBER=0<br>
11:55:36.573 [2373] &lt;4&gt; bpbkar main: INF - setenv STREAM_COUNT=0<br>
11:55:36.573 [2373] &lt;4&gt; bpbkar main: INF - setenv STREAMS=0<br>
11:55:36.573 [2373] &lt;4&gt; bpbkar main: INF - setenv BPSTART_TIMEOUT=300<br>
11:55:36.574 [2373] &lt;4&gt; bpbkar main: INF - setenv BPEND_TIMEOUT=300<br>
11:55:36.574 [2373] &lt;4&gt; bpbkar main: INF - setenv<br>
BACKUPID=aufin2_1072756532<br>
11:55:36.574 [2373] &lt;4&gt; bpbkar main: INF - setenv<br>
UNIXBACKUPTIME=1072756532<br>
11:55:36.574 [2373] &lt;4&gt; bpbkar main: INF - setenv BACKUPTIME=Tue Dec 
30<br>
11:55:32 2003<br>
<br>
11:55:36.595 [2373] &lt;4&gt; bpbkar main: INF - BACKUP START<br>
11:55:36.596 [2373] &lt;4&gt; bpbkar main: INF - Estimate:-1 -1<br>
11:55:36.597 [2373] &lt;2&gt; bpbkar main: INF - CONTINUE BACKUP message<br>
received<br>
11:55:38.616 [2373] &lt;2&gt; bpbkar setup_shm: INF - media_shm_info = 8 
32768<br>
51112 2374 0 0 0 0 1<br>
11:55:38.616 [2373] &lt;2&gt; bpbkar setup_shm: INF - SHMID = 51112, BUF_PTR 
=<br>
0xff0c0000, BUF_CONTROL = 0xff100000, readyptr = 0xff1000c0<br>
11:55:38.626 [2373] &lt;4&gt; bpbkar expand_wildcards: INF - Processing<br>
/u01/finprod<br>
11:55:38.662 [2373] &lt;8&gt; bpbkar validate_argument: WRN - Cannot process<br>
path /u01/finprod: No such file or directory. Skipping.<br>
11:55:38.662 [2373] &lt;4&gt; bpbkar expand_wildcards: INF - Processing /<br>
11:55:38.684 [2373] &lt;2&gt; mount build_mount_list: INF - Processing (ufs)<br>
/dev/md/dsk/d100 on /<br>
11:55:38.684 [2373] &lt;2&gt; mount build_mount_list: INF - Processing 
(proc)<br>
/proc on /proc<br>
11:55:38.684 [2373] &lt;2&gt; mount build_mount_list: INF - Processing (fd) 
fd<br>
on /dev/fd<br>
11:55:38.684 [2373] &lt;2&gt; mount build_mount_list: INF - Processing 
(mntfs)<br>
mnttab on /etc/mnttab<br>
11:55:38.684 [2373] &lt;2&gt; mount build_mount_list: INF - Processing (ufs)<br>
/dev/md/dsk/d110 on /var<br>
11:55:38.684 [2373] &lt;2&gt; mount build_mount_list: INF - Processing 
(tmpfs)<br>
swap on /var/run<br>
11:55:38.684 [2373] &lt;2&gt; mount build_mount_list: INF - Processing 
(tmpfs)<br>
swap on /tmp<br>
11:55:38.684 [2373] &lt;2&gt; mount build_mount_list: INF - Processing (ufs)<br>
/dev/md/dsk/d6 on /u06<br>
11:55:38.684 [2373] &lt;2&gt; mount build_mount_list: INF - Processing (ufs)<br>
/dev/md/dsk/d20 on /u04<br>
11:55:38.684 [2373] &lt;2&gt; mount build_mount_list: INF - Processing (ufs)<br>
/dev/md/dsk/d70 on /u01<br>
11:55:38.684 [2373] &lt;2&gt; mount build_mount_list: INF - Processing (ufs)<br>
/dev/md/dsk/d10 on /u03<br>
11:55:38.685 [2373] &lt;2&gt; mount build_mount_list: INF - Processing (ufs)<br>
/dev/md/dsk/d30 on /u05<br>
11:55:38.685 [2373] &lt;2&gt; mount build_mount_list: INF - Processing (ufs)<br>
/dev/md/dsk/d40 on /u08<br>
11:55:38.685 [2373] &lt;2&gt; mount build_mount_list: INF - Processing (ufs)<br>
/dev/md/dsk/d60 on /u07<br>
11:55:38.685 [2373] &lt;2&gt; mount build_mount_list: INF - Processing (ufs)<br>
/dev/md/dsk/d120 on /u02<br>
11:55:38.685 [2373] &lt;2&gt; mount build_mount_list: INF - Processing (ufs)<br>
/dev/md/dsk/d84 on /export<br>
11:55:38.685 [2373] &lt;2&gt; mount build_mount_list: INF - Processing (NFS)<br>
aufin3:/u01/staging on /staging<br>
11:55:38.685 [2373] &lt;2&gt; mount build_mount_list: INF - Processing<br>
(autofs) -hosts on /net<br>
11:55:38.685 [2373] &lt;2&gt; mount build_mount_list: INF - Processing<br>
(autofs) auto_home on /home<br>
11:55:38.685 [2373] &lt;2&gt; mount build_mount_list: INF - Processing<br>
(autofs) -xfn on /xfn<br>
11:55:38.686 [2373] &lt;2&gt; bpbkar SelectFile: INF - Resolved_path = /<br>
11:55:38.686 [2373] &lt;2&gt; bpbkar resolve_path: INF - Actual mount point 
of<br>
/ is /<br>
11:55:38.691 [2373] &lt;4&gt; bpbkar PrintFile: /<br>
11:55:38.697 [2373] &lt;4&gt; bpbkar PrintFile: /bin<br>
11:55:38.703 [2373] &lt;4&gt; bpbkar PrintFile: /lib<br>
11:55:38.708 [2373] &lt;4&gt; bpbkar compress_file: INF - Compression: 
&nbsp;44.94%<br>
/.sh_history<br>
11:55:38.709 [2373] &lt;4&gt; bpbkar PrintFile: /.sh_history<br>
11:55:38.715 [2373] &lt;4&gt; bpbkar compress_file: INF - Compression: 
&nbsp;50.85%<br>
/.profile<br>
11:55:38.715 [2373] &lt;4&gt; bpbkar PrintFile: /.profile<br>
11:55:38.718 [2373] &lt;4&gt; bpbkar compress_file: INF - Compression: 
&nbsp;53.00%<br>
/.dtprofile<br>
11:55:38.719 [2373] &lt;4&gt; bpbkar PrintFile: /.dtprofile<br>
<br>
_______________________________________________<br>
Veritas-bu maillist &nbsp;- &nbsp;Veritas-bu AT mailman.eng.auburn DOT edu<br>
http://mailman.eng.auburn.edu/mailman/listinfo/veritas-bu<br>
</font>
<br>
<br>
<br>
--=_alternative 004ACE4C85256E0C_=--

<Prev in Thread] Current Thread [Next in Thread>