Veritas-bu

[Veritas-bu] Ethernet port aggregation for performance

2006-04-09 02:50:27
Subject: [Veritas-bu] Ethernet port aggregation for performance
From: Michael.F.Lavelle AT abbott DOT com (Michael F Lavelle)
Date: Sun, 9 Apr 2006 01:50:27 -0500
This is a multipart message in MIME format.
--=_alternative 002597848625714B_=
Content-Type: text/plain; charset="ISO-8859-1"
Content-Transfer-Encoding: quoted-printable

Paul,
        Under Solaris 9 and earlier, the Ethernet trunking software is a=20
priced item ($995 list).  Under Solaris 10, it is available as an unpriced =

(free) software add-on.
        Further, you may be using a Solaris 9 (or earlier) system as a=20
master server with some success.  However, SunOS 5.8 has serious known=20
defects in it's TCP/IP implementation, which SunOS 5.9 corrected to some=20
degree, but still has performance problems due to the STREAMS-based TCP/IP =

software stack.
        If you want to use a Solaris sparc/x86 NBU Media Server, upgrade=20
it to Solaris 10 before you do anything else.

        Solaris 10 GA implemented the first of 3 phases of the Solaris=20
Fire Engine rewrite of the TCP/IP software stack.  The second phase, where =

the streams layer is completely removed, not only from between IP and TCP, =

but all the way up and down the stack, and IP modules call directly to TCP =

modules (and vice versa) in a lock-less redesign of the software stack is=20
implemented in the current Solaris 10 01=5F06 release.  See page 9 of the=20
FireEngine document listed below.


Here is a list of on-line publications which you will find of interest.=20
They will pay you back the time spent reading them:

http://www.sun.com/bigadmin/content/networkperf/FireEngine=5FWP.pdf      =20
FireEngine - A New Networking Architecture for the Solaris Operating=20
System=20
http://www.sun.com/blueprints/0404/817-6925.pdf          Maximizing the=20
Performance a Gigabit Ethernet NIC Interface (April 2004)
http://www.sun.com/blueprints/0203/817-1657.pdf          Understanding=20
Gigabit Ethernet Performance on Sun Fire Servers (February 2003)
http://www.sun.com/blueprints/0704/817-7526.pdf          Ethernet=20
Autonegotiation Best Practices (July 2004)

        Also, take a look at=20
http://www.sun.com/bigadmin/content/networkperf/  for several other=20
documents which may get the community off their collective fanny and=20
upgrade to Solaris 10.  It's been GA for a year.  If you want HP-UX TCP/IP =

performance at half the price on a Solaris box, you don't need to buy a=20
new server.  Just upgrade your current sparc/x86 servers to Solaris 10.
        The 3rd and final phase of FireEngine/FireHose is implemented in=20
Solaris 11.  This is available in unsupported form on the Sun Solaris=20
Express site.  I've built one Solaris 11 beta system, but have no=20
performance numbers on this yet.

        I'll forward performance numbers to the mailing list in the next=20
few weeks as I compile them.



=20


Michael F Lavelle
CIT Storage Engineering

100 Abbott Park Rd
AP14B-1 GB16
Abbott Park, IL 60064-6042

Office (847) 937-1195
Cell (847) 553-5158
Michael.F.Lavelle AT abbott DOT com
=20

=20





=20



"Paul Keating" <pkeating AT bank-banque-canada DOT ca>=20
Sent by: veritas-bu-admin AT mailman.eng.auburn DOT edu
03/31/2006 08:46 AM

To
<Veritas-bu AT mailman.eng.auburn DOT edu>
cc

Subject
RE: [Veritas-bu] Ethernet port aggregation for performance






Anyone doing it with Solaris?
Trunking is an additional license cost IIRC, and possible PS consult?

Paul

> -----Original Message-----
> From: veritas-bu-admin AT mailman.eng.auburn DOT edu=20
> [mailto:veritas-bu-admin AT mailman.eng.auburn DOT edu] On Behalf Of=20
> Peter DrakeUnderkoffler
> Sent: March 31, 2006 9:34 AM
> To: andrew.x.smith AT jpmchase DOT com
> Cc: veritas-bu AT mailman.eng.auburn DOT edu
> Subject: Re: [Veritas-bu] Ethernet port aggregation for performance
>=20
>=20
> -----BEGIN PGP SIGNED MESSAGE-----
> Hash: SHA1
>=20
> I have a Linux master/media server with a single connection=20
> to a backup network
> via gigabit that I will  be migrating to a bonding in a day=20
> or two.  I have seen
> the single link with 3 or 4 streams to separate clients push=20
> an average of 80 megabytes/sec
> and peak much higher.   Ping me next week and I'll let you=20
> know what I saw with
> bonding.  This is against Extreme switchs, not Cisco, but the=20
> same should hold true.
>=20
> Thanks
> Peter
>=20
> Peter DrakeUnderkoffler
> Xinupro, LLC
> 617-834-2352
>=20
>=20
>=20
> andrew.x.smith AT jpmchase DOT com wrote:
> >=20
> > Does anybody use Ethernet port aggregation (ie Cisco=20
> Etherchannel) to
> > connect their LAN media servers to a backup network? If=20
> yes, what level
> > of performance are you seeing? and based on what hardware?=20
> Am keen to
> > know if anyone has found this to be performant above=20
> 1Gbit/sec speeds....
> >=20
> >    thanks Andy.
> -----BEGIN PGP SIGNATURE-----
> Version: GnuPG v1.4.1 (FreeBSD)
>=20
> iD8DBQFELT3Xl+lekZRM55oRAucHAKC00WeUi6e5uO9fFcjPLfJCHSSDUgCgqu5B
> eaMUDk3A03VnDFY3zmUGHY4=3D
> =3Dj2y4
> -----END PGP SIGNATURE-----
> =5F=5F=5F=5F=5F=5F=5F=5F=5F=5F=5F=5F=5F=5F=5F=5F=5F=5F=5F=5F=5F=5F=5F=5F=
=5F=5F=5F=5F=5F=5F=5F=5F=5F=5F=5F=5F=5F=5F=5F=5F=5F=5F=5F=5F=5F=5F=5F
> Veritas-bu maillist  -  Veritas-bu AT mailman.eng.auburn DOT edu
> http://mailman.eng.auburn.edu/mailman/listinfo/veritas-bu
>=20
=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=
=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=
=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=
=3D=3D=3D=3D=3D=3D=3D=3D=3D

La version fran=E7aise suit le texte anglais.

---------------------------------------------------------------------------=
---------

This email may contain privileged and/or confidential information, and the =

Bank of
Canada does not waive any related rights. Any distribution, use, or=20
copying of this
email or the information it contains by other than the intended recipient=20
is
unauthorized. If you received this email in error please delete it=20
immediately from
your system and notify the sender promptly by email that you have done so. =



---------------------------------------------------------------------------=
---------

Le pr=E9sent courriel peut contenir de l'information privil=E9gi=E9e ou=20
confidentielle.
La Banque du Canada ne renonce pas aux droits qui s'y rapportent. Toute=20
diffusion,
utilisation ou copie de ce courriel ou des renseignements qu'il contient=20
par une
personne autre que le ou les destinataires d=E9sign=E9s est interdite Si vo=
us=20
recevez
ce courriel par erreur, veuillez le supprimer imm=E9diatement et envoyer=20
sans d=E9lai =E0
l'exp=E9diteur un message =E9lectronique pour l'aviser que vous avez =E9lim=
in=E9=20
de votre
ordinateur toute copie du courriel re=E7u.


--=_alternative 002597848625714B_=
Content-Type: text/html; charset="ISO-8859-1"
Content-Transfer-Encoding: quoted-printable


<br><font size=3D2 face=3D"sans-serif">Paul,</font>
<br><font size=3D2 face=3D"sans-serif">&nbsp; &nbsp; &nbsp; &nbsp; Under
Solaris 9 and earlier, the Ethernet trunking software is a priced item
($995 list). &nbsp;Under Solaris 10, it is available as an unpriced (free)
software add-on.</font>
<br><font size=3D2 face=3D"sans-serif">&nbsp; &nbsp; &nbsp; &nbsp; Further,
you may be using a Solaris 9 (or earlier) system as a master server with
some success. &nbsp;However, SunOS 5.8 has serious known defects in it's
TCP/IP implementation, which SunOS 5.9 corrected to some degree, but still
has performance problems due to the STREAMS-based TCP/IP software stack.</f=
ont>
<br><font size=3D2 face=3D"sans-serif">&nbsp; &nbsp; &nbsp; &nbsp; If
you want to use a Solaris sparc/x86 NBU Media Server, upgrade it to Solaris
10 before you do anything else.</font>
<br>
<br><font size=3D2 face=3D"sans-serif">&nbsp; &nbsp; &nbsp; &nbsp; Solaris
10 GA implemented the first of 3 phases of the Solaris Fire Engine rewrite
of the TCP/IP software stack. &nbsp;The second phase, where the streams
layer is completely removed, not only from between IP and TCP, but all
the way up and down the stack, and IP modules call directly to TCP modules
(and vice versa) in a lock-less redesign of the software stack is implement=
ed
in the current Solaris 10 01=5F06 release. &nbsp;See page 9 of the FireEngi=
ne
document listed below.</font>
<br>
<br>
<br><font size=3D2 face=3D"sans-serif">Here is a list of on-line publicatio=
ns
which you will find of interest. &nbsp;They will pay you back the time
spent reading them:</font>
<br>
<br><font size=3D2 face=3D"sans-serif">http://www.sun.com/bigadmin/content/=
networkperf/FireEngine=5FWP.pdf
&nbsp; &nbsp; &nbsp; &nbsp;</font><font size=3D1 color=3D#3f8080 face=3D"Ar=
ial"><b>FireEngine
- A New Networking Architecture for the Solaris Operating System </b></font>
<br><font size=3D2 face=3D"sans-serif">http://www.sun.com/blueprints/0404/8=
17-6925.pdf
&nbsp; &nbsp; &nbsp; &nbsp; &nbsp; &nbsp; &nbsp; &nbsp;</font><font size=3D=
1 color=3D#3f8080 face=3D"Arial"><b>
&nbsp; &nbsp; &nbsp; &nbsp; &nbsp; &nbsp; &nbsp; &nbsp;Maximizing
the Performance a Gigabit Ethernet NIC Interface</b></font><font size=3D1 f=
ace=3D"Arial">
(April 2004)</font>
<br><font size=3D2 face=3D"sans-serif">http://www.sun.com/blueprints/0203/8=
17-1657.pdf
&nbsp; &nbsp; &nbsp; &nbsp; &nbsp; &nbsp; &nbsp; &nbsp;</font><font size=3D=
1 color=3D#3f8080 face=3D"Arial"><b>
&nbsp; &nbsp; &nbsp; &nbsp; &nbsp; &nbsp; &nbsp; &nbsp;Understanding
Gigabit Ethernet Performance on Sun Fire Servers</b></font><font size=3D1 f=
ace=3D"Arial">
(February 2003)</font>
<br><font size=3D2 face=3D"sans-serif">http://www.sun.com/blueprints/0704/8=
17-7526.pdf
&nbsp; &nbsp; &nbsp; &nbsp; &nbsp; &nbsp; &nbsp; &nbsp;</font><font size=3D=
1 color=3D#3f8080 face=3D"Arial"><b>
&nbsp; &nbsp; &nbsp; &nbsp; &nbsp; &nbsp; &nbsp; &nbsp;Ethernet
Autonegotiation Best Practices</b></font><font size=3D1 face=3D"Arial"> (Ju=
ly
2004)</font>
<br>
<br><font size=3D2 face=3D"sans-serif">&nbsp; &nbsp; &nbsp; &nbsp; Also,
take a look at http://www.sun.com/bigadmin/content/networkperf/ &nbsp;for
several other documents which may get the community off their collective
fanny and upgrade to Solaris 10. &nbsp;It's been GA for a year. &nbsp;If
you want HP-UX TCP/IP performance at half the price on a Solaris box, you
don't need to buy a new server. &nbsp;Just upgrade your current sparc/x86
servers to Solaris 10.</font>
<br><font size=3D2 face=3D"sans-serif">&nbsp; &nbsp; &nbsp; &nbsp; The
3rd and final phase of FireEngine/FireHose is implemented in Solaris 11.
&nbsp;This is available in unsupported form on the Sun Solaris Express
site. &nbsp;I've built one Solaris 11 beta system, but have no performance
numbers on this yet.</font>
<br>
<br><font size=3D2 face=3D"sans-serif">&nbsp; &nbsp; &nbsp; &nbsp; I'll
forward performance numbers to the mailing list in the next few weeks as
I compile them.</font>
<br>
<br>
<br><font size=3D2 face=3D"sans-serif"><br>
</font><font size=3D3> </font>
<p>
<table>
<tr>
<td colspan=3D4>
<hr noshade>
<tr valign=3Dtop>
<td bgcolor=3Dwhite><font size=3D1 face=3D"Arial"><b>Michael F Lavelle</b><=
/font>
<p><a href=3Dstorage.abbott.com><font size=3D1 color=3Dblue face=3D"Arial">=
<u>CIT
Storage Engineering</u></font></a><font size=3D1 face=3D"Arial"><br>
</font>
<td bgcolor=3Dwhite><font size=3D1 face=3D"Arial">100 Abbott Park Rd<br>
AP14B-1 GB16<br>
Abbott Park, IL 60064-6042<br>
</font>
<td bgcolor=3Dwhite><font size=3D1 face=3D"Arial">Office (847) 937-1195<br>
Cell (847) 553-5158</font><font size=3D1 color=3Dblue face=3D"Arial"><u><br>
</u></font><a href=3Dmailto:Michael.F.Lavelle AT abbott DOT com><font size=3D1 
col=
or=3Dblue face=3D"Arial"><u>Michael.F.Lavelle AT abbott DOT com</u></font></a>
<td bgcolor=3Dwhite>
<div align=3Dright><font size=3D3>&nbsp;</font></div>
<tr>
<td colspan=3D4>
<hr noshade>
<tr>
<td colspan=3D4><font size=3D3>&nbsp;</font>
<tr>
<td>
<td>
<td>
<td></table>
<br>
<p><font size=3D3>&nbsp;</font>
<br>
<br>
<br>
<table width=3D100%>
<tr valign=3Dtop>
<td width=3D40%><font size=3D1 face=3D"sans-serif"><b>&quot;Paul Keating&qu=
ot;
&lt;pkeating AT bank-banque-canada DOT ca&gt;</b> </font>
<br><font size=3D1 face=3D"sans-serif">Sent by: veritas-bu-admin AT mailman DOT 
en=
g.auburn.edu</font>
<p><font size=3D1 face=3D"sans-serif">03/31/2006 08:46 AM</font>
<td width=3D59%>
<table width=3D100%>
<tr valign=3Dtop>
<td>
<div align=3Dright><font size=3D1 face=3D"sans-serif">To</font></div>
<td><font size=3D1 face=3D"sans-serif">&lt;Veritas-bu AT mailman.eng.auburn DOT 
ed=
u&gt;</font>
<tr valign=3Dtop>
<td>
<div align=3Dright><font size=3D1 face=3D"sans-serif">cc</font></div>
<td>
<tr valign=3Dtop>
<td>
<div align=3Dright><font size=3D1 face=3D"sans-serif">Subject</font></div>
<td><font size=3D1 face=3D"sans-serif">RE: [Veritas-bu] Ethernet port aggre=
gation
for performance</font></table>
<br>
<table>
<tr valign=3Dtop>
<td>
<td></table>
<br></table>
<br>
<br>
<br><font size=3D2><tt>Anyone doing it with Solaris?<br>
Trunking is an additional license cost IIRC, and possible PS consult?<br>
<br>
Paul<br>
<br>
&gt; -----Original Message-----<br>
&gt; From: veritas-bu-admin AT mailman.eng.auburn DOT edu <br>
&gt; [mailto:veritas-bu-admin AT mailman.eng.auburn DOT edu] On Behalf Of <br>
&gt; Peter DrakeUnderkoffler<br>
&gt; Sent: March 31, 2006 9:34 AM<br>
&gt; To: andrew.x.smith AT jpmchase DOT com<br>
&gt; Cc: veritas-bu AT mailman.eng.auburn DOT edu<br>
&gt; Subject: Re: [Veritas-bu] Ethernet port aggregation for performance<br>
&gt; <br>
&gt; <br>
&gt; -----BEGIN PGP SIGNED MESSAGE-----<br>
&gt; Hash: SHA1<br>
&gt; <br>
&gt; I have a Linux master/media server with a single connection <br>
&gt; to a backup network<br>
&gt; via gigabit that I will &nbsp;be migrating to a bonding in a day <br>
&gt; or two. &nbsp;I have seen<br>
&gt; the single link with 3 or 4 streams to separate clients push <br>
&gt; an average of 80 megabytes/sec<br>
&gt; and peak much higher. &nbsp; Ping me next week and I'll let you <br>
&gt; know what I saw with<br>
&gt; bonding. &nbsp;This is against Extreme switchs, not Cisco, but the
<br>
&gt; same should hold true.<br>
&gt; <br>
&gt; Thanks<br>
&gt; Peter<br>
&gt; <br>
&gt; Peter DrakeUnderkoffler<br>
&gt; Xinupro, LLC<br>
&gt; 617-834-2352<br>
&gt; <br>
&gt; <br>
&gt; <br>
&gt; andrew.x.smith AT jpmchase DOT com wrote:<br>
&gt; &gt; <br>
&gt; &gt; Does anybody use Ethernet port aggregation (ie Cisco <br>
&gt; Etherchannel) to<br>
&gt; &gt; connect their LAN media servers to a backup network? If <br>
&gt; yes, what level<br>
&gt; &gt; of performance are you seeing? and based on what hardware? <br>
&gt; Am keen to<br>
&gt; &gt; know if anyone has found this to be performant above <br>
&gt; 1Gbit/sec speeds....<br>
&gt; &gt; <br>
&gt; &gt; &nbsp; &nbsp;thanks Andy.<br>
&gt; -----BEGIN PGP SIGNATURE-----<br>
&gt; Version: GnuPG v1.4.1 (FreeBSD)<br>
&gt; <br>
&gt; iD8DBQFELT3Xl+lekZRM55oRAucHAKC00WeUi6e5uO9fFcjPLfJCHSSDUgCgqu5B<br>
&gt; eaMUDk3A03VnDFY3zmUGHY4=3D<br>
&gt; =3Dj2y4<br>
&gt; -----END PGP SIGNATURE-----<br>
&gt; =5F=5F=5F=5F=5F=5F=5F=5F=5F=5F=5F=5F=5F=5F=5F=5F=5F=5F=5F=5F=5F=5F=5F=
=5F=5F=5F=5F=5F=5F=5F=5F=5F=5F=5F=5F=5F=5F=5F=5F=5F=5F=5F=5F=5F=5F=5F=5F<br>
&gt; Veritas-bu maillist &nbsp;- &nbsp;Veritas-bu AT mailman.eng.auburn DOT 
edu<br>
&gt; http://mailman.eng.auburn.edu/mailman/listinfo/veritas-bu<br>
&gt; =3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=
=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=
=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=
=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D<br>
<br>
La version fran=E7aise suit le texte anglais.<br>
<br>
---------------------------------------------------------------------------=
---------<br>
<br>
This email may contain privileged and/or confidential information, and
the Bank of<br>
Canada does not waive any related rights. Any distribution, use, or copying
of this<br>
email or the information it contains by other than the intended recipient
is<br>
unauthorized. If you received this email in error please delete it immediat=
ely
from<br>
your system and notify the sender promptly by email that you have done
so. <br>
<br>
---------------------------------------------------------------------------=
---------<br>
<br>
Le pr=E9sent courriel peut contenir de l'information privil=E9gi=E9e ou con=
fidentielle.<br>
La Banque du Canada ne renonce pas aux droits qui s'y rapportent. Toute
diffusion,<br>
utilisation ou copie de ce courriel ou des renseignements qu'il contient
par une<br>
personne autre que le ou les destinataires d=E9sign=E9s est interdite Si vo=
us
recevez<br>
ce courriel par erreur, veuillez le supprimer imm=E9diatement et envoyer
sans d=E9lai =E0<br>
l'exp=E9diteur un message =E9lectronique pour l'aviser que vous avez =E9lim=
in=E9
de votre<br>
ordinateur toute copie du courriel re=E7u.<br>
</tt></font>
<br>
--=_alternative 002597848625714B_=--

<Prev in Thread] Current Thread [Next in Thread>
  • [Veritas-bu] Ethernet port aggregation for performance, Michael F Lavelle <=