Re: [ADSM-L] best backup method for millions of small files?

Hi there

Try the following:

- install and configure multiple TSM Journal Instances for different
parts of the file system
- run multiple concurrent backup jobs
- run /incrbydate backups during the weeknights, combined with normal
incrementals on weekends






-----Original Message-----
From: ADSM: Dist Stor Manager [mailto:ADSM-L AT VM.MARIST DOT EDU] On Behalf Of
Mehdi Salehi
Sent: Thursday, 30 April 2009 1:58 PM
To: ADSM-L AT VM.MARIST DOT EDU
Subject: [ADSM-L] best backup method for millions of small files?

Hi,
There is an NTFS filesystem in windows with 20 millions of small files
less
than 20 KB each. The total size of the filesystem is less than 300GB.
I have not tried incremental backup, because that would be a nightmare.
Again, inc backup is not a good choice because the long restoration time
is
not acceptable us.
I tested the snapshot image backup and satisfied with backup time. Now
the
problem is how to perform the incremental for this image backup.
Unfortunately "incremental-by-date of last image" scans the whole files
to
filter which files must be in the backup list and would take a
tremendous
amount of time. This is not acceptable as well.
The ideal behavior that I expect from TSM is journal based incremental
backup for image which is apparently not supported by TSM 5.3.
more info:
-the change rate for this filesystem is about 20 thousands of files per
day
-TSM version is 5.3

What do you recommend for this case? Please include TSM 6.1 featues if
exist.

Regards,
Mehdi Salehi

<html>
<body>
<font face="arial" color=#808080 size="-2"><img
alt="Santos Logo" src="http://www.santos.com/library/logo.gif";>
<br>Santos Ltd A.B.N. 80 007 550 923<br>
Disclaimer: The information contained in this email is intended only for the 
use of the person(s) to whom it is addressed and may be confidential or contain 
privileged information. 
If you are not the intended recipient you are hereby notified that any perusal, 
use, distribution, copying or disclosure is strictly prohibited. 
If you have received this email in error please immediately advise us by return 
email and delete the email without making a copy.</font>
<font face="arial" color=#008000 size="-2">Please consider the environment 
before printing this email</font>
</body>
</html>