Networker

[Networker] Staging: Looks like the wrong save sets have been staged

2013-05-09 09:30:46
Subject: [Networker] Staging: Looks like the wrong save sets have been staged
From: tammclaughlin <networker-forum AT BACKUPCENTRAL DOT COM>
To: NETWORKER AT LISTSERV.TEMPLE DOT EDU
Date: Thu, 9 May 2013 06:24:47 -0700
I think I follow you but will read through again to pick up the details.

The issue we have is that we have a 2 month retention period and prefer to keep 
backups on disk.
For additional redundancy we clone to tape to meet the off-site requirement. 
This also has a retention of 2 months.
However, we need to backup more data than disk space is available hence the 
need for staging. If we set staging to much lower then we 
would need an additional amount of tapes which would also increase the 
contention between staging/cloning.

I guess we really need to rethink our processes!


------------
Ok, it can be quite confusing. But just remember that what Networker sees is 
the usages reported by the filesystem. So if you have 3 file-type devices on 
one physical partition/lun, their utilization levels will be parallel. (English 
is not my primary language, so bear with me here)

I'm not that familiar with the internal workings of the staging process when it 
comes to multiple ftds, so I can't say whether it treats savesets differently 
from different volumes/ftds, but I would not use the same staging policy for 
several ftds/volumes. I'd create one for each. The automation I'm talking about 
is when it reaches the high watermark and starts staging savesets to tape. The 
fact that you can only choose a certain percentage and not a specific time or 
date opens up for processes fighting over the tape drive(s) if you have 
anything other than staging using them (which you have, because sometimes 
you'll have to do a restore I imagine).

I would lower the thresholds, 95% is a pretty high utilization rate for almost 
any type of filesystem. Actually everything above 85% is risky, and when you 
hit the 90% mark, performance starts to degrade rapidly.

When I say I use scheduled cloning, I use the "Clones" category in NMC, under 
Configuration. Here(in the first tab) I decide browse and retention times for 
the savesets in the DESTINATION pool (which is a tape pool), WHAT pool to clone 
to (the same tape pool), how many copies I want in my destination pool(usually 
1) and WHEN to clone (start time and how often). In the second tab I decide 
where to clone FROM(a pool on disk), and how far back I want to "look" for 
savesets. So if you schedule cloning for every Friday at 1AM, you should "look" 
back at least 14 days to make sure that everything is picked up in case a 
cloning fails because of a faulty tape drive or anything like that. Savesets 
already cloned to the destination pool will be ignored, and not cloned again.

At the same time, I set retention and browse for every client to be 2-3 weeks. 
This means that the savesets on disk will only be there for that long, and 
after that period of time they will only be available on tape. Which is pretty 
much what you normally want when using staging.

I suggest you create a test disk and tape pool and try it out, there's no harm 
in that.

/tony

+----------------------------------------------------------------------
|This was sent by tam.mclaughlin AT gmail DOT com via Backup Central.
|Forward SPAM to abuse AT backupcentral DOT com.
+----------------------------------------------------------------------