DR Problems

[johnsot]

Hello All,

We just went through our yearly DR testing and it was a Disaster. The funny part was we did the test a year ago and it went just fine. I had not changed anything from the year before except that I upgraded us from version 6.2.1 to 6.2.3.0.

When we went to restore machines for some reason the restores were looking for their data in the Primary pools only. My understanding was that if they looked to the PrimaryPools first they should see the PrimaryPools as Destroyed and then go to the Copy Storage Pools for their data. However, they never looked to their CopyPools for their data. It was like their data never made it to the CopyPools. I did check to make sure that DRM did mark the PrimaryPools at DR as Destroyed and mark the CopyPools as Read-Only. Below Is my Daily Maintenance routine. Please take a look at it and let me know if you see anything that could of caused this problem in our DR testing.

1.Migration (I have auto copy setup on my DiskPools) 03:00
-----------------------------------------------
Parallel
migrate stg diskpool lo=0
migrate stg diskpool2 lo=0
migrate stg diskpool_db2logs lo=0

2.Backing Up Primary TapePools to CopyPools 06:00
------------------------------------------------
Parallel
ba stg "Onsite Primary Tape Pools to Copy Storage Pools" w=y (we have 8 Primary Tape Pools that we backup to Copy Storage Pools here)
Serial
ba db t=dbs devc=lto3 w=y
ba volhist
ba devconfig
q drm wherest=mo s=dbs f=cmd cmd="tape out &VOL" cmdf="/tsm/tapes.out"
move drm * wherest=mo tost=cour s=dbs rem=bulk toloc="Ready to go to Vault" w=y
move drm * wherest=vaultr tost=courierr s=dbs w=y
q drm wherest=courierr s=dbs f=cmd cmd="Please return &VOL" cmdf="/tsm/return.out"
q drm wherest=cour s=dbs f=cmd cmd="Please Vault &VOL" cmdf="/tsm/vault.out"
ba db dev=DBBackup type=f w=y
prepare s=dbs w=y
del volhist tod=-3 type=dbb (Here we are just deleteing any volhist out of the DBBackups that we keep on our TSM server just in case we need to do a DB restore. This way we do not need a tape we do the restore Disk to Disk.)

Please feel free to let me know of anything that you might see that could have caused the problems that I saw at our DR test. I appreciate any help you might give me. Feel free to ask me for any other information that you might need to help me figure out what went wrong.

 

[moon-buddy]

On the on set, I would not do this: 'del volhist tod=-3 type=dbb'

I see that you are using DRM and this is not recommended. I will give other feedback later.

 

[moon-buddy]

I also see that you migrate the disk pool to online tape then do offsite backups.

I would change this slightly:

- Backup disk to offsite tape
- Backup online tape to offsite tape (just in case a spill over from disk to online tape happened)
- Migrate disk to online tape.

 

[johnsot]

moon-buddy,

Just so I understand what is going on here. We do a second database backup each day to a filesystem on our TSM server which is defined as a device class DBBackup. When my daily maintenance script runs the command "'del volhist tod=-3 type=dbb" I thought it was only deleting the fourth database backup in that filesystem only.

Now to your second recommendation. When you said you would slightly change my "Daily Maintenance Script" by doing these things:
- Backup disk to offsite tape
- Backup online tape to offsite tape (just in case a spill over from disk to online tape happened)
- Migrate disk to online tape.

Exactly where would you put them in my script above and would you take anything out of my script from above. Thanks in advance for your help.

 

[moon-buddy]

What I am saying is that you have to change the order of your routine by:

1. backing up the disk to offsite tape first before,
2. You migrate to online tape.

change the appropriate lines on your script above.

I don't use del volhist when DRM is in use. Instead I set the db backup expiration days and Recovery Plan File expiration days.

 

[johnsot]

moon-buddy,

If I have autocopy setup on my Primary Diskpools (which means when migration happens it writes to onsite as well as offsite tapes) then I would not need to add the section about "backing up my diskpools to offsite pools" before my migration then correct. So if my "Daily Maintenance" script looked like this below I should be ok right?
***********************************************************************
parallel
migrate stg diskpool lo=0 w=y
migrate stg diskpool2 lo=0 w=y
migrate stg diskpool_dB2LOGS lo=0 w=y
parallel
ba stg DB2TAPE3 DB2OFFSITE3 maxpr=5 w=y
ba stg LAN-FREE LAN-FREEOFFSITE maxpr=5 w=y
ba stg TAPEPOOL_L3 OFFSITEPOOL-L3 maxpr=2 w=y
ba stg DIRPOOL DIROFFSITE maxpr=3 w=y
ba stg TAPEPOOL2 OFFSITEPOOL2 maxpr=3 w=y
ba stg VMWAREPOOL_L3 VMWAREOFFSITE_L3 maxpr=2 w=y
ba stg EXCHANGETAPE3 EXCHANGETAPE3-OFFSITE maxpr=1 w=y
ba stg VMCTLFILES VMCTLFILESOFFSITE maxpr=1 w=y
ba stg DB2TAPELOG DB2LOGOFFSITE maxpr=1 w=y
serial
ba db t=dbs devc=lto3 w=y
ba volhist
ba devconfig
q drm wherest=mo s=dbs f=cmd cmd="tape out &VOL" cmdf="/tsm/tapes.out"
move drm * wherest=mo tost=cour s=dbs rem=bulk toloc="Ready to go to Vault" w=y
move drm * wherest=vaultr tost=courierr s=dbs w=y
q drm wherest=courierr s=dbs f=cmd cmd="Please return &VOL" cmdf="/tsm/return.out"
q drm wherest=cour s=dbs f=cmd cmd="Please Vault &VOL" cmdf="/tsm/vault.out"
ba db dev=DBBackup type=f w=y
prepare s=dbs w=y
**************************************************************************

Thanks in advance for your help.

 

[moon-buddy]

moon-buddy,

If I have autocopy setup on my Primary Diskpools (which means when migration happens it writes to onsite as well as offsite tapes) then I would not need to add the section about "backing up my diskpools to offsite pools" before my migration then correct. So if my "Daily Maintenance" script looked like this below I should be ok right?
***********************************************************************
parallel
migrate stg diskpool lo=0 w=y
migrate stg diskpool2 lo=0 w=y
migrate stg diskpool_dB2LOGS lo=0 w=y
parallel
ba stg DB2TAPE3 DB2OFFSITE3 maxpr=5 w=y
ba stg LAN-FREE LAN-FREEOFFSITE maxpr=5 w=y
ba stg TAPEPOOL_L3 OFFSITEPOOL-L3 maxpr=2 w=y
ba stg DIRPOOL DIROFFSITE maxpr=3 w=y
ba stg TAPEPOOL2 OFFSITEPOOL2 maxpr=3 w=y
ba stg VMWAREPOOL_L3 VMWAREOFFSITE_L3 maxpr=2 w=y
ba stg EXCHANGETAPE3 EXCHANGETAPE3-OFFSITE maxpr=1 w=y
ba stg VMCTLFILES VMCTLFILESOFFSITE maxpr=1 w=y
ba stg DB2TAPELOG DB2LOGOFFSITE maxpr=1 w=y
serial
ba db t=dbs devc=lto3 w=y
ba volhist
ba devconfig
q drm wherest=mo s=dbs f=cmd cmd="tape out &VOL" cmdf="/tsm/tapes.out"
move drm * wherest=mo tost=cour s=dbs rem=bulk toloc="Ready to go to Vault" w=y
move drm * wherest=vaultr tost=courierr s=dbs w=y
q drm wherest=courierr s=dbs f=cmd cmd="Please return &VOL" cmdf="/tsm/return.out"
q drm wherest=cour s=dbs f=cmd cmd="Please Vault &VOL" cmdf="/tsm/vault.out"
ba db dev=DBBackup type=f w=y
prepare s=dbs w=y
**************************************************************************

Thanks in advance for your help.

You should be OK then.