The bottleneck will be the OS filesystem code. Backup the device the filesystem
is on rather than the filesystem itself. It needs to be quiescent though,
mirror and break is a common method.
BTW, if a page is 8k in size, 2000 pages/sec is 16Mb/sec which could in fact be
the I/O throughput limit on your swap space. IIRC, the default page size in
Solaris is 8k. I'm not convinced I would call that "mildly pages".
HTH.
Regards
Colin.
>-----Original Message-----
>From: JV [mailto:jv711 AT yahoo DOT com]
>Sent: Wednesday, April 23, 2003 5:15 AM
>To: veritas-bu AT mailman.eng.auburn DOT edu
>Subject: [Veritas-bu] Backup Millions of small files with
>Solaris client & server
>
>
>Dear Veritas Netbackup pros:
>
>I have a gigabit ethernet client with special backup needs,
>I'm asking if you can give any pointers if you've been down this road:
>
>Netbackup client: Sun e250, Solaris 2.6 with a single gigabit
>ethernet adapter on a private switched storage network running
>SUNWged 2.0 driver, 2x400 Mhz cpus, 2 GB RAM. Storage is two
>A1000 arrays, they have a hardware RAID 5 controller with ufs
>filesystems, ten mount points of 35 GB each, with 4 million
>files each (total storage 350 GB, 40 million files, on 20 x 18
>GB SCSI disks, 2 controllers on the A1000s). No client-side
>compression, HW compression on the LTO drives. I can only do
>FULL backups once per week and sneak in an incremental M-F at
>offpeak times. Netbackup master is E450 running Solaris 8,
>Netbackup 4.5_M3, on 5 LTO tape drives on Brocade 1Gbps switch.
>
>As you can imagine, the tape drives are starving for data with
>a pathetic throughput rate. I have set the policy to 2 active
>jobs per policy, two storage units (LTO tape drives). The
>problem is READING the A1000 arrays, the Solaris host mildly
>pages (2000 pg/sec) when running this backup according to vmstat.
>
>Playing games with the filecard mask in an include list [ie
>/data01/*] doesn't look hopeful, there aren't any
>subdirectories - all 4M files are 1 level deep in the mount
>point [ie /vault01/file_aaaaaaaaaaaaa*]. An "ls -l a*" won't
>return in a reason span of time.
>
>
>What can I do to the configuration of Netbackup to improve the
>throughput?!?!
>I have seen several threads in the archives here that
>reference Win2K setups, what are the unix ppl out there doing?
>
>Thanks
>JV
>
>__________________________________________________
>Do you Yahoo!?
>The New Yahoo! Search - Faster. Easier. Bingo
>http://search.yahoo.com >_______________________________________________
>Veritas-bu maillist - Veritas-bu AT mailman.eng.auburn DOT edu
>http://mailman.eng.auburn.edu/mailman/listin>fo/veritas-bu
>
|
