ADSM-L

Re: Backup of large server (15+ Million objects)

2005-06-17 00:08:44
Subject: Re: Backup of large server (15+ Million objects)
From: Tab Trepagnier <Tab.Trepagnier AT LAITRAM DOT COM>
To: ADSM-L AT VM.MARIST DOT EDU
Date: Thu, 16 Jun 2005 23:08:01 -0500
Bill,

I have a case where I want to isolate a particular directory path from the
remainder of the file server.  That isolated path had been permanently
archived but I've since switched to backupsets.  But that directory path
is part of a file server with 1.7 million files.  This is how I isolated
it given that TSM does not support Virtual Mount Points in Windows.

I created a hidden share on the top-level directory:  Net Share
MyFolder$=D:\MyFolder
Then I added the UNC path to the DSM.OPT file Domain statement:  Domain
\\MyServer\MyFolder$
With that, I could assign a specific management class to that specific
path:  Include  \\MyServer\MyFolder$\...\*  SpecialMgmtClass
I also excluded the physical path to avoid duplicate data copies:
Exclude.Dir  D:\MyFolder

That caused TSM to define the UNC path as its own filespace, with which I
could do anything I wanted using standard TSM functionality.

In my case, that path represents approximately 10% of the entire file
server.  I can create "permanent" backupsets from that filespace without
having to grab the entire server or archive almost 2 million files.

I'm not claiming it's a perfect solution, but it is a way to break up a
large file server without carving it up physically.  Just be aware that
backing up via UNC means passing through the network stack, so you'll take
a small performance hit.  And remember that the System account can't
establish network connections, so you'll have to run your TSM service(s)
under an account with higher priviledges.

Hope this helps.

Tab Trepagnier
TSM Administrator
Laitram LLC








Bill Boyer <bjdboyer AT COMCAST DOT NET>
Sent by: "ADSM: Dist Stor Manager" <ADSM-L AT VM.MARIST DOT EDU>
06/15/2005 11:07 AM
Please respond to
"ADSM: Dist Stor Manager" <ADSM-L AT VM.MARIST DOT EDU>


To
ADSM-L AT VM.MARIST DOT EDU
cc

Subject
Re: Backup of large server (15+ Million objects)






>From what I'm reading and understanding (which may be 2 entirely different
things!!) junction points just let me create a link between directories.
Kinda like hard/soft links in Unix (ln  command). Mount points let me take
a drive and mount it on a directory instead of a new drive letter.

I want to go the other way...take a directory and make it a drive letter
or a new filesystem to TSM. Even if I could split this 15million object
filespace into 3 or more separate filespaces I think I could get a backup
done in a reasonable time...or even get it done! Right now it just plain
doesn't finish. Mostly the scheduler service dies and the backup fails.

IMAGE backups aren't an optoin with 3590E drives and "K" media. I would be
here forever doing the backup and then I couldn't carry all the tapes! :-)

Any ideas or suggestions?? One optoin they are looking at is just
replicating this volume to another location instead of or in addition to
backups (if I can get it to run).

Bill

-------------- Original message --------------

> Actually with both Windows 2000 and Windows 2003 you can create what is
like a
> mount point in Unix land. Search MS's site for "junction point" OR
"mount
> point".
>
>
> Bill Boyer wrote:
> This is a single drive letter, G:, so I can't separate it into multiple
nodes or
> even schedules. Plus virtualmountpoint is only valid for Unix's, not
Windoze.
>
> Thanks.
> Bill
>
> -------------- Original message --------------
>
> > Hi Bill
> >
> > 1. Separating it into multiple TSM nodes, for example one node per
> > filespace
> >
> > 2. Using the virtual mount point option
> >
> > Both theese options should decrease the time TSM spends on inspecting
the
> > filespaces.
> >
> > Best Regards
> >
> > Daniel Sparrman
> > -----------------------------------
> > Daniel Sparrman
> > Exist i Stockholm AB
> > Propellervdgen 6B
> > 183 62 TDBY
> > Vdxel: 08 - 754 98 00
> > Mobil: 070 - 399 27 51
> >
> >
> >
> > Bill Boyer
> > Sent by: "ADSM: Dist Stor Manager"
> > 2005-06-14 16:36
> > Please respond to
> > "ADSM: Dist Stor Manager"
> >
> >
> > To
> > ADSM-L AT VM.MARIST DOT EDU
> > cc
> >
> > Subject
> > Backup of large server (15+ Million objects)
> >
> >
> >
> >
> >
> >
> > Windows 2000 server with TSM client 5.3.0.8.
> > TSM server 5.2.2.0 on Windows2000
> >
> > Configured the journal service with a larger notify buffer, but we
just
> > can't get the first incremental to complete. We see in the server
> > activity log that the session was terminated by the client. Running in
> > managed services mode.
> >
> > Any suggestions on backup strategies on this large of a server?
> >
> > Bill Boyer
> > DSS, Inc.
>
> __________________________________________________
> Do You Yahoo!?
> Tired of spam? Yahoo! Mail has the best spam protection around
> http://mail.yahoo.com