Re: [Veritas-bu] Some info on my experiences with 10GbE
2007-10-18 15:41:17
Devon,
What is your data type your backing up?
How much data?
Thanks,
Chris Hall
From:
veritas-bu-bounces AT mailman.eng.auburn DOT edu
[mailto:veritas-bu-bounces AT mailman.eng.auburn DOT edu] On Behalf Of Peters, Devon C
Sent: Thursday, October 18, 2007
3:10 PM
To: Karl.Rossing AT federated DOT ca;
VERITAS-BU AT mailman.eng.auburn DOT edu
Subject: Re: [Veritas-bu] Some
info on my experiences with 10GbE
We've been pretty happy with the T2000's.
The tape library is an IBM 3584, the tape
drives are IBM's 4Gb FC LTO-3 drives, there's a dedicated 4Gb HBA for each
drive, and everything is connected to 4Gb McData switches.
We used to have IBM's 2Gb FC LTO-3 drives,
and with those the peak performance was around 165MB/s per drive. These
4Gb drives peak at around 265MB/s per drive, though with all 3 tape drives
active, we see throughput closer to 220MB/s per drive...I'm guessing we're
bottlenecked by the ports on our disk subsystem at the moment, but since
performance is more than acceptable we're not looking to tune this any further
- at least not until our LTO-4 drives are installed next month ;).
-devon
From:
Karl.Rossing AT Federated DOT CA [mailto:Karl.Rossing AT Federated DOT CA]
Sent: Thursday, October 18, 2007
6:10 AM
To: Peters, Devon C;
VERITAS-BU AT mailman.eng.auburn DOT edu
Subject: Re: [Veritas-bu] Some
info on my experiences with 10GbE
Devon,
Good to hear
that T2000's are screamers.
What are the
library/tape drive specs. Are the drives FC attached? or are they attached via
scsi to the media server?
Thanks,
Karl
> From:
veritas-bu-bounces AT mailman.eng.auburn DOT edu [mailto:veritas-bu-
> bounces AT mailman.eng.auburn DOT edu] On Behalf Of
Peters, Devon C
> Sent: Wednesday, October 17, 2007 12:12 PM
> To: VERITAS-BU AT mailman.eng.auburn DOT edu
> Subject: [Veritas-bu] Some info on my
experiences with 10GbE
>
> Since
I've seen a little bit of talk about 10GbE on here in the past
> I figured I'd share some of my experiences...
> I've
recently been testing some of Sun's dual-port 10GbE NICs on
> some small T2000's (1Ghz, 4-core). I'm
only using a single port on
> each card, and the servers are currently
directly connected to each
> other (waiting for my network team to get
switches and fibre in place).
> So far,
I've been able to drive throughput between these two systems
> to about 7500Mbit/sec using iperf. When
the throughput gets this
> high, all the cores/threads on the receiving
T2000 become saturated
> and TCP retransmits start climbing, but both
systems remain quite
> responsive. Since these are only 4-core
T2000's, I would guess that
> the 6 or 8-core T2000's (especially with
1.2Ghz or 1.4Ghz
> processors) should be capable of more
throughput, possibly near line speed.
> The
down side achieving this high of throughput is that it requires
> lots of data streams. When transmitting
with a single data stream,
> the most throughput I've gotten is about
1500Mbit/sec. I only got
> up to 7500Mbit/s when using 64 data
streams… Also, the biggest
> gains seem to be in the jump from 1 to 8 data
streams; with 8
> streams I was able to get throughput up to
6500Mbit/sec.
> Our
goal for 10GbE, is to be able to restore data from tape at a
> speed of at least 2400Mbit/sec (300MB/sec).
We have large daily
> backups (3-4TB) that we would like to be able
to restore (not
> backup) in a reasonable amount of time.
These restores are used to
> refresh our test and development environments
with current data.
> The actual backups are done with array based
snapshots (HDS
> ShadowCopy), which then get mounted and
backed up by a dedicated
> media server (6-core T2000). We're
currently getting about
> 650MB/sec of throughput with the backups (9
streams on 3 LTO3 tape
> drives - MPX=3 and it's very compressible
data).
> Going
off my iperf results, the restoring this data using 9 streams
> should get us well over 2400Mbit/sec.
But - we haven't installed
> the cards on our media servers yet, so I have
yet to see what the
> actual performanee of netbackup and LTO3 over
10GbE is. I'm hopeful
> it'll be close to the iperf results, but if
it doesn't meet the goal
> then we'll be looking at other options.
> --
> Devon Peters
_______________________________________________
> Veritas-bu maillist -
Veritas-bu AT mailman.eng.auburn DOT edu
> http://mailman.eng.auburn.edu/mailman/listinfo/veritas-bu
|
_______________________________________________
Veritas-bu maillist - Veritas-bu AT mailman.eng.auburn DOT edu
http://mailman.eng.auburn.edu/mailman/listinfo/veritas-bu
|
|
|