Veritas-bu

[Veritas-bu] Backup Millions of small files with Solaris client & server

2003-04-23 00:15:23
Subject: [Veritas-bu] Backup Millions of small files with Solaris client & server
From: jv711 AT yahoo DOT com (JV)
Date: Tue, 22 Apr 2003 21:15:23 -0700 (PDT)
Dear Veritas Netbackup pros:

I have a gigabit ethernet client with special backup needs, I'm
asking if you can give any pointers if you've been down this road:

Netbackup client: Sun e250, Solaris 2.6 with a single gigabit
ethernet adapter on a private switched storage network running
SUNWged 2.0 driver, 2x400 Mhz cpus, 2 GB RAM. Storage is two A1000
arrays, they have a hardware RAID 5 controller with ufs filesystems,
ten mount points of 35 GB each, with 4 million files each (total
storage 350 GB, 40 million files, on 20 x 18 GB SCSI disks, 2
controllers on the A1000s). No client-side compression, HW
compression on the LTO drives. I can only do FULL backups once per
week and sneak in an incremental M-F at offpeak times. Netbackup
master is E450 running Solaris 8, Netbackup 4.5_M3, on 5 LTO tape
drives on Brocade 1Gbps switch.

As you can imagine, the tape drives are starving for data with a
pathetic throughput rate. I have set the policy to 2 active jobs per
policy, two storage units (LTO tape drives). The problem is READING
the A1000 arrays, the Solaris host mildly pages (2000 pg/sec) when
running this backup according to vmstat. 

Playing games with the filecard mask in an include list [ie
/data01/*] doesn't look hopeful, there aren't any subdirectories -
all 4M files are 1 level deep in the mount point [ie
/vault01/file_aaaaaaaaaaaaa*]. An "ls -l a*" won't return in a reason
span of time.


What can I do to the configuration of Netbackup to improve the
throughput?!?!  
I have seen several threads in the archives here that reference Win2K
setups, what are the unix ppl out there doing? 

Thanks
JV

__________________________________________________
Do you Yahoo!?
The New Yahoo! Search - Faster. Easier. Bingo
http://search.yahoo.com

<Prev in Thread] Current Thread [Next in Thread>