ADSM-L

Re: [ADSM-L] TSM for VE: recommended VSwitch configuration?

2014-03-20 16:40:35
Subject: Re: [ADSM-L] TSM for VE: recommended VSwitch configuration?
From: "Ryder, Michael S" <michael_s.ryder AT ROCHE DOT COM>
To: ADSM-L AT VM.MARIST DOT EDU
Date: Thu, 20 Mar 2014 16:38:05 -0400
That's a nice setup.  My preference would be to use a physical proxy, and
read them from the SAN, to lessen impact to your VMs and their shared
infrastructure.  You might tinker with that.

Are you partitioning your VM traffic across those 10Gb connections, with
dedicated channels for VMotion, backup, management, etc?  I don't think
you'll find any specific documents at VMware about this, but the best
practice is to move heavy loads like this to separate ethernet channels or
NICs.  If you're using some sort of blade chassis, then that manufacturer
will also have something to say about how to separate heavy-traffic with
extra NICs, interconnects, etc.

I'm guessing if you spent as much time with your ethernet network, as
you've spend on your storage network, then you are probably in good shape,
but feel free to share more about that...This is nerd porn for me....

Best regards,

Mike, x7942
RMD IT Client Services


On Thu, Mar 20, 2014 at 4:15 PM, Matthew McGeary <
Matthew.McGeary AT potashcorp DOT com> wrote:

> The datamover is virtual and uses hotadd or nbd for transport.  All backup
> traffic runs over the network as a result.  Image backups to TSM run
> anywhere from 150-200 MB/s.  Our nightly backup traffic typically peaks at
> 350-400 MB/s.
>
> Matthew McGeary
> Technical Specialist
> PotashCorp - Saskatoon
> 306.933.8921
>
>
>
> From:   "Ryder, Michael S" <michael_s.ryder AT ROCHE DOT COM>
> To:     ADSM-L AT VM.MARIST DOT EDU
> Date:   03/20/2014 02:12 PM
> Subject:        Re: [ADSM-L] TSM for VE: recommended VSwitch
> configuration?
> Sent by:        "ADSM: Dist Stor Manager" <ADSM-L AT VM.MARIST DOT EDU>
>
>
>
> Great
>
> SORRY -- I forgot to ask - where is your proxy?  physical or VM?  is your
> proxy/datamover reading VMs via FC or ethernet?
>
> Is the TSM server a VM or physical?
>
> Offhand I would say those rates aren't horrible, much depends on the
> distribution of file sizes, and number of files you are backing up.
>
> What kind of rates do you get for image backups?  At least then it's
> easier
> to compare with other configurations, since we expect the proxy to send a
> nice solid stream of data to the TSM server.
>
> Best regards,
>
> Mike, x7942
> RMD IT Client Services
>
>
> On Thu, Mar 20, 2014 at 4:01 PM, Matthew McGeary <
> Matthew.McGeary AT potashcorp DOT com> wrote:
>
> > Sure thing:
> >
> > 1) The VMWare environment is connected via 8Gb fibre to an EMC VNX 5700
> > and uses mostly tiered storage pools (SSD-SAS),  The TSM server is
> > connected to a V7000 via fibre as well.  The TSM database is on SSD and
> > the storage pools are on 84 NL-SAS disks in a RAID6 extent pool provided
> > by the V7000.  The TSM server has a LACP nic team consisting of two 10
> Gb
> > adapters.  Each ESXi host has either dual 1Gb NICs or dual 10Gb NICs
> > assigned to the management VKernel port.
> > 2) The stated rates in my previous post are for IFIncremental traffic,
> be
> > it a fresh full or a subsequent CBT incremental backup.
> > 3) The VMware client is 7.1 and the server version is 6.3.4.200.
> >
> > Thanks!
> >
> > Matthew McGeary
> > Technical Specialist
> > PotashCorp - Saskatoon
> > 306.933.8921
> >
> >
> >
> > From:   "Ryder, Michael S" <michael_s.ryder AT ROCHE DOT COM>
> > To:     ADSM-L AT VM.MARIST DOT EDU
> > Date:   03/20/2014 01:55 PM
> > Subject:        Re: [ADSM-L] TSM for VE: recommended VSwitch
> > configuration?
> > Sent by:        "ADSM: Dist Stor Manager" <ADSM-L AT VM.MARIST DOT EDU>
> >
> >
> >
> > Hi Matthew
> >
> > Can you tell us some more about your infrastructure?  What kind of disk
> > storage network are you using?  iSCSI?  FC?  block-data?  NAS?
> >
> > Are your stated rates for image backups, or file-level incremental?
> >
> > What version of TSM are you using?
> >
> > Best regards,
> >
> > Mike, x7942
> > RMD IT Client Services
> >
> >
> > On Thu, Mar 20, 2014 at 3:44 PM, Matthew McGeary <
> > Matthew.McGeary AT potashcorp DOT com> wrote:
> >
> > > I've searched quite a bit and can't seem to find any guidelines on the
> > > following:
> > >
> > > 1) VMWare VSwitch configuration to maximize throughput for VM
> > > backups/restores
> > > 2) Expected throughput using 10Gb adapters
> > >
> > > We are in a situation at the moment where mass backups work quite well
> > and
> > > are very fast: as fast as the TSM server can handle.  However,
> > individual
> > > restores/backups are quite slow.  We've tested on a VMWare cluster
> with
> > > 1Gbps NICs attached to the management network and with 10Gbps attached
> > to
> > > the management network.  Both scenarios are quite a bit slower than
> I'd
> > > expect.  Average backup/restore transfer rates are in the 25 MB/s
> range
> > > using 1Gb NICs and around 55 MB/s using 10Gb NICs.
> > >
> > > How do I improve the throughput on these single-VM backup and restore
> > > sessions?
> > >
> > > Thanks!
> > >
> > > Matthew McGeary
> > > Technical Specialist
> > > PotashCorp - Saskatoon
> > > 306.933.8921
> > >
> >
>