I have about 90 million files with an average size of 50K.  It sounds like
you're using the job tracker on the server being backed up.  The crunching
you're seeing with no associated backup is job tracker figuring out how many
files it's going to back up.  This is a completely worthless feature.
Disable it and your life is going to be much easier.  I'd also suggest
breaking up the backups into smaller groups.  For example, if your root has
folders a, b, c and d, perform individual backups of each folder, or a group
of folders.

-----Original Message-----
From: Simon, John [mailto:JSimon AT reliant DOT com] 
Sent: Thursday, October 23, 2003 2:10 PM
To: veritas-bu AT mailman.eng.auburn DOT edu
Subject: [Veritas-bu] Backing up a filesystem with millions of small files

I am trying to backup a new AIX system that has a JFS filesystem with about
1-2 millions files, most smaller then 10k. We first were trying our TSM
server but TSM would give out of memory errors. So since we are phasig TSM
out we hooked up Netbackup and tried it, it seems bpbkar just starts eating
resources and after a few hours is taking like 25% of the system CPU and not
backing up. Any suggestions on backing up filesystems with millions of small
files?

_______________________________________________
Veritas-bu maillist  -  Veritas-bu AT mailman.eng.auburn DOT edu
http://mailman.eng.auburn.edu/mailman/listinfo/veritas-bu