Veritas-bu

[Veritas-bu] /dev/rmt wierdness

2003-08-18 03:03:43
Subject: [Veritas-bu] /dev/rmt wierdness
From: jerry.vochteloo AT veritas DOT com (Jerry Vochteloo)
Date: Mon, 18 Aug 2003 17:03:43 +1000
This message is in MIME format. Since your mail reader does not understand
this format, some or all of this message may not be legible.

------_=_NextPart_001_01C36556.AD8BEE0C
Content-Type: text/plain;
        charset="iso-8859-1"

Would seem to me that your bottleneck is somewhere else, maybe the file
system (are you backing up lots of small files, slow disk ??)
looks like you get about the same throughput from one drive as two, maybe
the delivery cannot get faster....
 
cheers
 

--
Dr Jerry Vochteloo
Senior Education Consultant
Veritas Software
Level 14, 207 Kent Street
Sydney, NSW, 2000
w: +61-2-8220-7043, m: 0408 206 748

The opinions stated here are mine and do not necessarily represent those of
VERITAS Software Corp


-----Original Message-----
From: Karl.Rossing AT Federated DOT CA [mailto:Karl.Rossing AT Federated DOT CA]
Sent: Friday, 1 August 2003 10:16 AM
To: veritas-bu AT mailman.eng.auburn DOT edu
Subject: [Veritas-bu] /dev/rmt wierdness



I have a problem with my two Mammoth drives. I think this may have something
to do with MP4 being installed. 

E450 
2GB of RAM 
Two Mammoth Drives 

All our databases are down 

I'm using iostat to watch /dev/rmt/1 and /dev/rmt/0. Now if netbackup is
only writting to one drive is get about 3400-3900KB/Sec. Now if both drives
are being written to i get something like 2009KB/Sec on one drive and
1984KB/Sec on the other. Then if i go back to writting to a single drive is
get 3400-3900KB/Sec again on the sigle drive. 

It doesn't seem to matter which drive it is. To me, this seems to be a
NUMBER_OF_BUFFERS issue, but I have doubled that from 32 to 64 and there did
not seem to be that much of a gain. 

SIZE_OF_BUFFERS is set to 64K. Which hasn't caused me problems. 

/etc/system has the Veritas shared memory settings combined with our
Progress DB shared mem settings. 

here is the output of ipcs -a 

IPC status from <running system> as of Thu Jul 31 19:13:30 CDT 2003 
T         ID      KEY        MODE        OWNER    GROUP  CREATOR   CGROUP
CBYTES  QNUM QBYTES LSPID LRPID   STIME    RTIME    CTIME 
Message Queues: 
q        250   0x4c544952 -Rrw-rw-rw-     root    other     root    other
0     0  65536 11126 11105 19:13:27 19:13:27 18:45:39 
q          1   0x2        -Rrw-rw-rw-     root     root     root     root
0     0  65536   474   390 19:12:48 19:12:48 13:53:21 
T         ID      KEY        MODE        OWNER    GROUP  CREATOR   CGROUP
NATTCH      SEGSZ  CPID  LPID   ATIME    DTIME    CTIME 
Shared Memory: 
m       1540   0x5643     --rw-rw-rw-     root    other     root    other
1       1024 11116 13874 18:45:36 19:13:19 18:45:36 
m       1101   0x5654     --rw-rw-rw-     root    other     root    other
1       1024 11116 13874 18:45:36 19:13:19 18:45:36 
m       1102   0x4d4e5251 --rw-r--r--     root    other     root    other
3     139264 11105 11341 18:47:37 18:47:37 18:45:39 
m       1103   0x55315352 --rw-rw-rw-     root    other     root    other
1       4096 11105 11415 18:48:11 18:49:13 18:45:39 
m       1104   0x44525354 --rw-r--r--     root    other     root    other
4     393216 11105 13830 19:12:17 19:12:17 18:45:39 
m       1105   0x53494152 --rw-r--r--     root    other     root    other
1       1024 11105 11126 18:45:39 18:45:41 18:45:39 
m          6   0          --rw-rw-rw-     root     root     root     root
1      32805   390   474 19:12:48 19:12:48 13:53:23 
m          7   0          --rw-rw-rw-     root     root     root     root
1      69666   474   474 13:53:26 no-entry 13:53:26 
T         ID      KEY        MODE        OWNER    GROUP  CREATOR   CGROUP
NSEMS   OTIME    CTIME 
Semaphores: 
s     327680   0x5653     --ra-ra-ra-     root    other     root    other
1 19:13:19 18:45:36 
s     327682   0x55535253 --ra-ra-ra-     root    other     root    other
1 18:48:11 18:45:39 
s          3   0x6312     --ra-ra-ra-     root     root     root     root
1 19:05:45 13:53:24 

Any sugestions? 

Thanks, 

Karl


------_=_NextPart_001_01C36556.AD8BEE0C
Content-Type: text/html;
        charset="iso-8859-1"

<!DOCTYPE HTML PUBLIC "-//W3C//DTD HTML 4.0 Transitional//EN">
<HTML><HEAD>
<META HTTP-EQUIV="Content-Type" CONTENT="text/html; charset=iso-8859-1">


<META content="MSHTML 6.00.2600.0" name=GENERATOR></HEAD>
<BODY>
<DIV><SPAN class=199300407-18082003><FONT face=Arial color=#0000ff size=2>Would 
seem to me that your bottleneck is somewhere else, maybe the file system (are 
you backing up lots of small files, slow disk ??)</FONT></SPAN></DIV>
<DIV><SPAN class=199300407-18082003><FONT face=Arial color=#0000ff size=2>looks 
like you get about the same throughput from one drive as two, maybe the 
delivery 
cannot get faster....</FONT></SPAN></DIV>
<DIV><SPAN class=199300407-18082003><FONT face=Arial color=#0000ff 
size=2></FONT></SPAN>&nbsp;</DIV>
<DIV><SPAN class=199300407-18082003><FONT face=Arial color=#0000ff 
size=2>cheers</FONT></SPAN></DIV>
<DIV>&nbsp;</DIV>
<P><FONT size=2>--<BR>Dr Jerry Vochteloo<BR>Senior Education 
Consultant<BR>Veritas Software<BR>Level 14, 207 Kent Street<BR>Sydney, NSW, 
2000<BR>w: +61-2-8220-7043, m: 0408 206 748<BR><BR>The opinions stated here are 
mine and do not necessarily represent those of VERITAS Software 
Corp<BR></FONT></P>
<BLOCKQUOTE 
style="PADDING-LEFT: 5px; MARGIN-LEFT: 5px; BORDER-LEFT: #0000ff 2px solid">
  <DIV class=OutlookMessageHeader dir=ltr align=left><FONT face=Tahoma 
  size=2>-----Original Message-----<BR><B>From:</B> Karl.Rossing AT Federated 
DOT CA 
  [mailto:Karl.Rossing AT Federated DOT CA]<BR><B>Sent:</B> Friday, 1 August 
2003 10:16 
  AM<BR><B>To:</B> veritas-bu AT mailman.eng.auburn DOT edu<BR><B>Subject:</B> 
  [Veritas-bu] /dev/rmt wierdness<BR><BR></FONT></DIV><BR><FONT size=3>I have a 
  problem with my two Mammoth drives. I think this may have something to do 
with 
  MP4 being installed.</FONT> <BR><BR><FONT size=3>E450</FONT> <BR><FONT 
  size=3>2GB of RAM</FONT> <BR><FONT size=3>Two Mammoth Drives</FONT> 
  <BR><BR><FONT size=3>All our databases are down</FONT> <BR><BR><FONT 
  size=3>I'm using iostat to watch /dev/rmt/1 and /dev/rmt/0. Now if netbackup 
  is only writting to one drive is get about 3400-3900KB/Sec. Now if both 
drives 
  are being written to i get something like 2009KB/Sec on one drive and 
  1984KB/Sec on the other. Then if i go back to writting to a single drive is 
  get 3400-3900KB/Sec again on the sigle drive.</FONT> <BR><BR><FONT size=3>It 
  doesn't seem to matter which drive it is. To me, this seems to be a 
  NUMBER_OF_BUFFERS issue, but I have doubled that from 32 to 64 and there did 
  not seem to be that much of a gain.</FONT> <BR><BR><FONT 
  size=3>SIZE_OF_BUFFERS is set to 64K. Which hasn't caused me problems.</FONT> 
  <BR><BR><FONT size=3>/etc/system has the Veritas shared memory settings 
  combined with our Progress DB shared mem settings.</FONT> <BR><BR><FONT 
  size=3>here is the output of ipcs -a</FONT> <BR><BR><FONT size=3>IPC status 
  from &lt;running system&gt; as of Thu Jul 31 19:13:30 CDT 2003</FONT> 
  <BR><FONT size=3>T &nbsp; &nbsp; &nbsp; &nbsp; ID &nbsp; &nbsp; &nbsp;KEY 
  &nbsp; &nbsp; &nbsp; &nbsp;MODE &nbsp; &nbsp; &nbsp; &nbsp;OWNER &nbsp; 
  &nbsp;GROUP &nbsp;CREATOR &nbsp; CGROUP CBYTES &nbsp;QNUM QBYTES LSPID LRPID 
  &nbsp; STIME &nbsp; &nbsp;RTIME &nbsp; &nbsp;CTIME</FONT> <BR><FONT 
  size=3>Message Queues:</FONT> <BR><FONT size=3>q &nbsp; &nbsp; &nbsp; 
  &nbsp;250 &nbsp; 0x4c544952 -Rrw-rw-rw- &nbsp; &nbsp; root &nbsp; &nbsp;other 
  &nbsp; &nbsp; root &nbsp; &nbsp;other &nbsp; &nbsp; &nbsp;0 &nbsp; &nbsp; 0 
  &nbsp;65536 11126 11105 19:13:27 19:13:27 18:45:39</FONT> <BR><FONT size=3>q 
  &nbsp; &nbsp; &nbsp; &nbsp; &nbsp;1 &nbsp; 0x2 &nbsp; &nbsp; &nbsp; 
  &nbsp;-Rrw-rw-rw- &nbsp; &nbsp; root &nbsp; &nbsp; root &nbsp; &nbsp; root 
  &nbsp; &nbsp; root &nbsp; &nbsp; &nbsp;0 &nbsp; &nbsp; 0 &nbsp;65536 &nbsp; 
  474 &nbsp; 390 19:12:48 19:12:48 13:53:21</FONT> <BR><FONT size=3>T &nbsp; 
  &nbsp; &nbsp; &nbsp; ID &nbsp; &nbsp; &nbsp;KEY &nbsp; &nbsp; &nbsp; 
  &nbsp;MODE &nbsp; &nbsp; &nbsp; &nbsp;OWNER &nbsp; &nbsp;GROUP &nbsp;CREATOR 
  &nbsp; CGROUP NATTCH &nbsp; &nbsp; &nbsp;SEGSZ &nbsp;CPID &nbsp;LPID &nbsp; 
  ATIME &nbsp; &nbsp;DTIME &nbsp; &nbsp;CTIME</FONT> <BR><FONT size=3>Shared 
  Memory:</FONT> <BR><FONT size=3>m &nbsp; &nbsp; &nbsp; 1540 &nbsp; 0x5643 
  &nbsp; &nbsp; --rw-rw-rw- &nbsp; &nbsp; root &nbsp; &nbsp;other &nbsp; &nbsp; 
  root &nbsp; &nbsp;other &nbsp; &nbsp; &nbsp;1 &nbsp; &nbsp; &nbsp; 1024 11116 
  13874 18:45:36 19:13:19 18:45:36</FONT> <BR><FONT size=3>m &nbsp; &nbsp; 
  &nbsp; 1101 &nbsp; 0x5654 &nbsp; &nbsp; --rw-rw-rw- &nbsp; &nbsp; root &nbsp; 
  &nbsp;other &nbsp; &nbsp; root &nbsp; &nbsp;other &nbsp; &nbsp; &nbsp;1 
&nbsp; 
  &nbsp; &nbsp; 1024 11116 13874 18:45:36 19:13:19 18:45:36</FONT> <BR><FONT 
  size=3>m &nbsp; &nbsp; &nbsp; 1102 &nbsp; 0x4d4e5251 --rw-r--r-- &nbsp; 
&nbsp; 
  root &nbsp; &nbsp;other &nbsp; &nbsp; root &nbsp; &nbsp;other &nbsp; &nbsp; 
  &nbsp;3 &nbsp; &nbsp; 139264 11105 11341 18:47:37 18:47:37 18:45:39</FONT> 
  <BR><FONT size=3>m &nbsp; &nbsp; &nbsp; 1103 &nbsp; 0x55315352 --rw-rw-rw- 
  &nbsp; &nbsp; root &nbsp; &nbsp;other &nbsp; &nbsp; root &nbsp; &nbsp;other 
  &nbsp; &nbsp; &nbsp;1 &nbsp; &nbsp; &nbsp; 4096 11105 11415 18:48:11 18:49:13 
  18:45:39</FONT> <BR><FONT size=3>m &nbsp; &nbsp; &nbsp; 1104 &nbsp; 
0x44525354 
  --rw-r--r-- &nbsp; &nbsp; root &nbsp; &nbsp;other &nbsp; &nbsp; root &nbsp; 
  &nbsp;other &nbsp; &nbsp; &nbsp;4 &nbsp; &nbsp; 393216 11105 13830 19:12:17 
  19:12:17 18:45:39</FONT> <BR><FONT size=3>m &nbsp; &nbsp; &nbsp; 1105 &nbsp; 
  0x53494152 --rw-r--r-- &nbsp; &nbsp; root &nbsp; &nbsp;other &nbsp; &nbsp; 
  root &nbsp; &nbsp;other &nbsp; &nbsp; &nbsp;1 &nbsp; &nbsp; &nbsp; 1024 11105 
  11126 18:45:39 18:45:41 18:45:39</FONT> <BR><FONT size=3>m &nbsp; &nbsp; 
  &nbsp; &nbsp; &nbsp;6 &nbsp; 0 &nbsp; &nbsp; &nbsp; &nbsp; &nbsp;--rw-rw-rw- 
  &nbsp; &nbsp; root &nbsp; &nbsp; root &nbsp; &nbsp; root &nbsp; &nbsp; root 
  &nbsp; &nbsp; &nbsp;1 &nbsp; &nbsp; &nbsp;32805 &nbsp; 390 &nbsp; 474 
19:12:48 
  19:12:48 13:53:23</FONT> <BR><FONT size=3>m &nbsp; &nbsp; &nbsp; &nbsp; 
  &nbsp;7 &nbsp; 0 &nbsp; &nbsp; &nbsp; &nbsp; &nbsp;--rw-rw-rw- &nbsp; &nbsp; 
  root &nbsp; &nbsp; root &nbsp; &nbsp; root &nbsp; &nbsp; root &nbsp; &nbsp; 
  &nbsp;1 &nbsp; &nbsp; &nbsp;69666 &nbsp; 474 &nbsp; 474 13:53:26 no-entry 
  13:53:26</FONT> <BR><FONT size=3>T &nbsp; &nbsp; &nbsp; &nbsp; ID &nbsp; 
  &nbsp; &nbsp;KEY &nbsp; &nbsp; &nbsp; &nbsp;MODE &nbsp; &nbsp; &nbsp; 
  &nbsp;OWNER &nbsp; &nbsp;GROUP &nbsp;CREATOR &nbsp; CGROUP NSEMS &nbsp; OTIME 
  &nbsp; &nbsp;CTIME</FONT> <BR><FONT size=3>Semaphores:</FONT> <BR><FONT 
  size=3>s &nbsp; &nbsp; 327680 &nbsp; 0x5653 &nbsp; &nbsp; --ra-ra-ra- &nbsp; 
  &nbsp; root &nbsp; &nbsp;other &nbsp; &nbsp; root &nbsp; &nbsp;other &nbsp; 
  &nbsp; 1 19:13:19 18:45:36</FONT> <BR><FONT size=3>s &nbsp; &nbsp; 327682 
  &nbsp; 0x55535253 --ra-ra-ra- &nbsp; &nbsp; root &nbsp; &nbsp;other &nbsp; 
  &nbsp; root &nbsp; &nbsp;other &nbsp; &nbsp; 1 18:48:11 18:45:39</FONT> 
  <BR><FONT size=3>s &nbsp; &nbsp; &nbsp; &nbsp; &nbsp;3 &nbsp; 0x6312 &nbsp; 
  &nbsp; --ra-ra-ra- &nbsp; &nbsp; root &nbsp; &nbsp; root &nbsp; &nbsp; root 
  &nbsp; &nbsp; root &nbsp; &nbsp; 1 19:05:45 13:53:24</FONT> <BR><BR><FONT 
  size=3>Any sugestions?</FONT> <BR><BR><FONT size=3>Thanks,</FONT> 
  <BR><BR><FONT size=3>Karl</FONT></BLOCKQUOTE></BODY></HTML>

------_=_NextPart_001_01C36556.AD8BEE0C--

<Prev in Thread] Current Thread [Next in Thread>
  • [Veritas-bu] /dev/rmt wierdness, Jerry Vochteloo <=