Results 1 to 15 of 15
  1. #1
    Newcomer
    Join Date
    Apr 2012
    Posts
    5
    Thanks
    0
    Thanked 0 Times in 0 Posts

    Default Exchange 2010 DAG - TSM backups too slow

    Hi everyone,

    we have 2 exchange 2010 SP1 with Rollup Update 5 configured for DAG running on Windows 2008 R2 SP1.

    When we try to backup Exchange any node (passive or active) with TSM Data Protection for MS Exchange we see backup throughput is approximately 10MB/second.
    Our TSM Server version 5.5 level 4.3 and DPM is 6.1.2

    I also wanted to see backup performance on different system which is configured for our test platform. on that system exchange server is configured on single server like production exchange version which is exc 2010 SP1 with Rollup Update 5 running on Windows 2008 R2 SP1. Also i updated DPM level to 6.1.3.1 on this test server. But backup performance is not changed which is same like production 10 or 12 MB/second .

    Test system works on Vmware ESXi and production systems works on different Vmware ESX hosts. When i try copy file from/to exchange servers on network, I see 50MB/second throughput which is we expected. So we say there is no network problem with Exchange nodes. Also we see better backup performances from other servers on TSM. so we can say also there is no performance issue with TSM server.

    I changed TCPWindowsize to 63 and TCPBuffSize to 32 in dsm.opt file. However nothing was changed.

    Because of this backup performance issues our backup times takes 14 hours. What should i changed? Where is this performance issue caused by? Is this problem caused by windows 2008 R2 or Exchange 2010 or DPM?

    Thanks for your suggestions.
    Regards.

  2. #2
    Moderator moon-buddy's Avatar
    Join Date
    Aug 2005
    Location
    Somewhere in the US
    Posts
    5,858
    Thanks
    4
    Thanked 228 Times in 223 Posts

    Default

    I am not clear on this: Are the PROD servers on physical boxes or VM Ware guests?
    Ed

  3. #3
    Newcomer
    Join Date
    Apr 2012
    Posts
    5
    Thanks
    0
    Thanked 0 Times in 0 Posts

    Default

    All of them vmware guests;
    - Production servers (2 nodes in DAG) on Vmware ESX platform
    - Test server (single server, no dag configured) on Vmware ESX-i platform

  4. #4
    Moderator moon-buddy's Avatar
    Join Date
    Aug 2005
    Location
    Somewhere in the US
    Posts
    5,858
    Thanks
    4
    Thanked 228 Times in 223 Posts

    Default

    Quote Originally Posted by seckin1983 View Post
    All of them vmware guests;
    - Production servers (2 nodes in DAG) on Vmware ESX platform
    - Test server (single server, no dag configured) on Vmware ESX-i platform
    I have not tested Exchange on VM Ware since I don't 'believe' on virtual environments for heavy I/O Apps or Systems users like Exchange.

    However, see if you can have the Exchange servers the only user of the VM Ware platform for the duration of the test - no other systems running. See if there is an improvement.

    There are parameter settings called BUFFERS and BUFFERSIZE on dsm.opt. BUFFERS is from 2 to 8, and BUFFERSIZE is from 64 to 8192 kilobytes with 1024 as default. Experiment on the values.

    Also, read this or reference it: http://publib.boulder.ibm.com/infoce..._guide_win.pdf
    Last edited by moon-buddy; 04-11-2012 at 11:47 AM.
    Ed

  5. #5
    Newcomer
    Join Date
    Apr 2012
    Posts
    5
    Thanks
    0
    Thanked 0 Times in 0 Posts

    Default

    Quote Originally Posted by moon-buddy View Post
    I have not tested Exchange on VM Ware since I don't 'believe' on virtual environments for heavy I/O Apps or Systems users like Exchange.

    However, see if you can have the Exchange servers the only user of the VM Ware platform for the duration of the test - no other systems running. See if there is an improvement.

    There are parameter settings called BUFFERS and BUFFERSIZE on dsm.opt. BUFFERS is from 2 to 8, and BUFFERSIZE is from 64 to 8192 kilobytes with 1024 as default. Experiment on the values.

    Also, read this or reference it: http://publib.boulder.ibm.com/infoce..._guide_win.pdf

    I dont think its an I/O problem, because the result never changes during the work day or midnight.
    Also backup throughput exactly same on test system which is running on located on local disks in vmware esxi host and production is running on vmware esx located on SAN. however i will examine this again.

    also i will change BUFFERS and BUFFERSIZE settings and observe backup performance.

    Thanks for your suggestions. i will inform you with results.

  6. #6
    Member gimlet's Avatar
    Join Date
    Apr 2008
    Location
    St. Louis, Missouri
    Posts
    154
    Thanks
    0
    Thanked 3 Times in 3 Posts

    Default

    It's hard to say without knowing more details of your environment. You mention the software and platforms, but not network connectivity, storage configuration, other VMs, other workloads/sessions on the TSM server. So it's going to be difficult to debug via forum.

    That said...

    Are you talking data transfer rate or aggregate transfer rate? In our environment, the data transfer rate from Exchange 2010 to TSM 5.5 is ~100MB/s, with an aggregate rate of ~22MB/s.

    How fast does the BA client on the same node(s) backup? Do all other nodes backup much more quickly? Same performance whether full or incremental backups?

  7. #7
    Member
    Join Date
    Apr 2009
    Posts
    31
    Thanks
    0
    Thanked 0 Times in 0 Posts

    Default

    I am also investigating improving backup performance with Exchange 2010. I'm currently at 45MB's per second but could use some improvement. (My issue may be disk though). Anyway, saw this and wanted to chime in that BUFFERS and BUFFERSIZE only apply to legacy backup which isn't supported on Exchange 2010 according to the TDP manual.
    I would start by looking at storage speed. How fast is a file copy (CIFS) from your Exchange mailbox server to your TSM server? It should be around 40-50MB's per second. If not, your storage at either end may be the issue.

  8. #8
    Newcomer
    Join Date
    Nov 2010
    Location
    Germany
    Posts
    16
    Thanks
    0
    Thanked 0 Times in 0 Posts

    Default

    Hi,

    i saw some kind of network trouble with 2010DAG an Citrix Xen Server. I did some network speed testing with jperf and saw heavy errors while using the same TCPWindowsize and Buffer like tsm would do. Maximal speed was < 800 MB/h...

    Finally we activated compression on the client and traffic wend up to >70 MB/s. Maybe you could try out these steps.

    Greetings

  9. #9
    Newcomer
    Join Date
    Apr 2012
    Posts
    5
    Thanks
    0
    Thanked 0 Times in 0 Posts

    Default

    Hi,

    our exchange server dag nodes, tsm server are connected to network 1 Gbps. tsm server is connected to library via fiber.

    we are still using exchange 2003 in our organization for some mailboxes and during backup jobs of exch 2003 with tsm we see 2-3 GB per minute which is acceptable i think. also we see better backup performance values from other clients.

    On the other hand after emerman suggestion i tested the file copy throughput between exchange server to tsm server. i saw average 10 MB per second and i thought bottleneck is caused by network issue. i dont understand that file copy between tsm server and exchange 2003 is better than exchange 2010 with old driver installed tsm server.
    immediately i upgraded the network driver of tsm server. now during file copy between exchange 2010 server to tsm server i see 20-30 MBs per second, however backup performance has not changed it is still 8-12 MBs per second.

    Olis where can i activate the compression, could yo clarify?

    Thanks

  10. #10
    Newcomer
    Join Date
    Apr 2012
    Posts
    5
    Thanks
    0
    Thanked 0 Times in 0 Posts

    Default

    additionally our tsm server is windows 2003 standard sp2 32 bit located on physical server with Broadcom NeXtreme Gigabit network adapter.

  11. #11
    Newcomer
    Join Date
    Nov 2010
    Location
    Germany
    Posts
    16
    Thanks
    0
    Thanked 0 Times in 0 Posts

    Default

    Hey seckin1983,

    you could add the compression statemend to your tdp dsm.opt:

    compression yes

    How did you test the throughput? Copy some files or some real test software? Give jperf or iperf a try.
    Last edited by olis; 04-17-2012 at 08:37 AM.

  12. #12
    Member
    Join Date
    Jun 2010
    Posts
    84
    Thanks
    2
    Thanked 1 Time in 1 Post

    Default

    Hi All,

    Anybody find a solitions? I have a same problem but i did'n find reason yet.

    Could you please share your experience?
    Thank you.

  13. #13
    Member
    Join Date
    Jun 2010
    Posts
    84
    Thanks
    2
    Thanked 1 Time in 1 Post

    Default

    our exchange team did backup test with windows backup same database and backup time and speed look pretty good for 1GBit/sec network interfaces.
    It doesn’t look problem with windows backup.

    it seems problem TDP problem but what?
    Thank you for your advice.

  14. #14
    Member
    Join Date
    Apr 2009
    Posts
    31
    Thanks
    0
    Thanked 0 Times in 0 Posts

    Default

    TSM backs up each database one at a time. The trick for me was to separate the backups into different jobs and then run them side by side. I did this by writing a custom powershell script.

  15. #15
    Member
    Join Date
    Jun 2010
    Posts
    84
    Thanks
    2
    Thanked 1 Time in 1 Post

    Default

    Hello emerman,
    Thank you so much your fastly answer.
    I have one db which is 10 GB. I run test only one db. result so slowly too. ?

Similar Threads

  1. Exchange 2010 DAG and TSM NODE configuration
    By Rigido in forum Exchange / Outlook
    Replies: 0
    Last Post: 02-07-2012, 10:32 AM
  2. TDP for Exchange 2010 - DAG Passive Backups
    By booman55 in forum Backup / Archive Discussion
    Replies: 2
    Last Post: 11-10-2011, 09:33 AM
  3. Problems using Schedule to Backup Exchange 2010 (DAG)
    By ad283m in forum Exchange / Outlook
    Replies: 0
    Last Post: 04-14-2011, 03:55 PM
  4. Exchange 2010 DAG node scheduling configuration
    By lmcginutsw in forum Exchange / Outlook
    Replies: 2
    Last Post: 01-29-2011, 08:58 AM
  5. TDP for Exchange 2010 (DAG)
    By enojado in forum Exchange / Outlook
    Replies: 0
    Last Post: 09-09-2010, 04:49 AM

Posting Permissions

  • You may not post new threads
  • You may not post replies
  • You may not post attachments
  • You may not edit your posts
  •