Non-continuous data transfers to tapes.

Mark70

Newcomer
Joined
Dec 19, 2007
Messages
1
Reaction score
0
Points
0
Hello all, I am experiencing what I suspect is not a normal behavier of my Legato backup system. I have several Solaris 9 and 10 storage nodes and monitoring the backup and clone processes with iostat I observe the following:

r/s w/s kr/s kw/s wait actv wsvc_t asvc_t %w %b device
0.0 0.0 0.0 0.0 1.0 0.0 0.0 0.0 100 0 rmt/1
0.0 0.0 0.0 0.0 1.0 0.0 0.0 0.0 100 0 rmt/5
0.0 0.0 0.0 0.0 1.0 0.0 0.0 0.0 100 0 rmt/1
0.0 0.0 0.0 0.0 1.0 0.0 0.0 0.0 100 0 rmt/5
0.0 0.0 0.0 0.0 1.0 0.0 0.0 0.0 100 0 rmt/1
0.0 0.0 0.0 0.0 1.0 0.0 0.0 0.0 100 0 rmt/5
0.0 0.0 0.0 0.0 1.0 0.0 0.0 0.0 100 0 rmt/1
0.0 0.0 0.0 0.0 1.0 0.0 0.0 0.0 100 0 rmt/5
0.0 0.0 0.0 0.0 1.0 0.0 0.0 0.0 100 0 rmt/1
0.0 0.0 0.0 0.0 1.0 0.0 0.0 0.0 100 0 rmt/5
0.0 0.0 0.0 0.0 1.0 0.0 0.0 0.0 100 0 rmt/1
0.0 0.0 0.0 0.0 1.0 0.0 0.0 0.0 100 0 rmt/5
0.0 0.0 0.0 0.0 1.0 0.0 0.0 0.0 100 0 rmt/1
0.0 0.0 0.0 0.0 1.0 0.0 0.0 0.0 100 0 rmt/5
0.0 0.0 0.0 0.0 1.0 0.0 0.0 0.0 100 0 rmt/1
0.0 0.0 0.0 0.0 1.0 0.0 0.0 0.0 100 0 rmt/5
0.0 249.3 0.0 63815.4 0.0 0.9 0.1 3.6 3 89 rmt/1
249.3 0.0 63816.3 0.0 0.0 0.9 0.1 3.8 3 94 rmt/5
0.0 143.8 0.0 36822.8 0.5 0.5 3.2 3.2 46 46 rmt/1
152.8 0.0 39123.8 0.0 0.0 0.6 0.0 3.6 0 55 rmt/5
0.0 0.0 0.0 0.0 1.0 0.0 0.0 0.0 100 0 rmt/1
0.0 0.0 0.0 0.0 1.0 0.0 0.0 0.0 100 0 rmt/1
0.0 0.0 0.0 0.0 1.0 0.0 0.0 0.0 100 0 rmt/1
0.0 0.0 0.0 0.0 1.0 0.0 0.0 0.0 100 0 rmt/1
0.0 0.0 0.0 0.0 1.0 0.0 0.0 0.0 100 0 rmt/1
0.0 0.0 0.0 0.0 1.0 0.0 0.0 0.0 100 0 rmt/1
0.0 0.0 0.0 0.0 1.0 0.0 0.0 0.0 100 0 rmt/1
0.0 0.0 0.0 0.0 1.0 0.0 0.0 0.0 100 0 rmt/1
0.0 0.0 0.0 0.0 1.0 0.0 0.0 0.0 100 0 rmt/1
0.0 85.0 0.0 21755.5 0.6 0.3 6.5 3.2 55 27 rmt/1
76.0 0.0 19451.9 0.0 0.0 0.3 0.0 3.9 0 30 rmt/5
0.0 267.8 0.0 68552.2 0.0 0.8 0.0 3.1 1 83 rmt/1
267.8 0.0 68551.4 0.0 0.0 1.0 0.0 3.6 1 97 rmt/5
0.0 268.2 0.0 68668.9 0.0 0.8 0.0 3.1 1 83 rmt/1
267.2 0.0 68413.6 0.0 0.0 1.0 0.0 3.6 1 97 rmt/5
0.0 263.1 0.0 67350.2 0.0 0.9 0.0 3.4 1 89 rmt/1
266.1 0.0 68118.5 0.0 0.0 1.0 0.0 3.6 1 97 rmt/5
0.0 268.0 0.0 68609.3 0.0 0.9 0.0 3.2 1 86 rmt/1
266.0 0.0 68097.5 0.0 0.0 1.0 0.0 3.6 1 96 rmt/5
0.0 260.6 0.0 66717.6 0.0 0.8 0.0 3.2 1 82 rmt/1
260.6 0.0 66716.4 0.0 0.0 1.0 0.0 3.7 1 96 rmt/5
0.0 267.3 0.0 68423.0 0.0 0.8 0.0 3.1 1 83 rmt/1
267.3 0.0 68423.9 0.0 0.0 1.0 0.0 3.6 1 97 rmt/5
0.0 261.1 0.0 66841.1 0.0 0.8 0.0 3.2 1 84 rmt/1
268.1 0.0 68634.1 0.0 0.0 1.0 0.0 3.6 1 97 rmt/5
0.0 271.0 0.0 69365.4 0.0 0.9 0.0 3.4 1 91 rmt/1
264.0 0.0 67573.4 0.0 0.0 1.0 0.0 3.7 1 97 rmt/5
0.0 5.0 0.0 1279.9 1.0 0.0 194.4 5.0 97 3 rmt/1
5.0 0.0 1279.9 0.0 1.0 0.0 194.4 5.5 97 3 rmt/5
0.0 0.0 0.0 0.0 1.0 0.0 0.0 0.0 100 0 rmt/1
0.0 0.0 0.0 0.0 1.0 0.0 0.0 0.0 100 0 rmt/5
0.0 0.0 0.0 0.0 1.0 0.0 0.0 0.0 100 0 rmt/1
0.0 0.0 0.0 0.0 1.0 0.0 0.0 0.0 100 0 rmt/5
0.0 0.0 0.0 0.0 1.0 0.0 0.0 0.0 100 0 rmt/1
0.0 0.0 0.0 0.0 1.0 0.0 0.0 0.0 100 0 rmt/5
0.0 0.0 0.0 0.0 1.0 0.0 0.0 0.0 100 0 rmt/1
0.0 0.0 0.0 0.0 1.0 0.0 0.0 0.0 100 0 rmt/5
0.0 0.0 0.0 0.0 1.0 0.0 0.0 0.0 100 0 rmt/1
0.0 0.0 0.0 0.0 1.0 0.0 0.0 0.0 100 0 rmt/5
0.0 0.0 0.0 0.0 1.0 0.0 0.0 0.0 100 0 rmt/1
0.0 0.0 0.0 0.0 1.0 0.0 0.0 0.0 100 0 rmt/5
0.0 0.0 0.0 0.0 1.0 0.0 0.0 0.0 100 0 rmt/1
0.0 0.0 0.0 0.0 1.0 0.0 0.0 0.0 100 0 rmt/5
0.0 0.0 0.0 0.0 1.0 0.0 0.0 0.0 100 0 rmt/1
0.0 0.0 0.0 0.0 1.0 0.0 0.0 0.0 100 0 rmt/5
0.0 0.0 0.0 0.0 1.0 0.0 0.0 0.0 100 0 rmt/1
0.0 0.0 0.0 0.0 1.0 0.0 0.0 0.0 100 0 rmt/5
0.0 249.8 0.0 63959.4 0.0 0.9 0.1 3.5 4 89 rmt/1
249.8 0.0 63958.8 0.0 0.0 0.9 0.1 3.8 3 94 rmt/5
0.0 267.9 0.0 68589.6 0.0 0.8 0.0 3.1 1 83 rmt/1
266.9 0.0 68333.6 0.0 0.0 1.0 0.0 3.6 1 97 rmt/5
0.0 261.1 0.0 66839.4 0.0 0.9 0.0 3.4 1 90 rmt/1
265.1 0.0 67864.0 0.0 0.0 1.0 0.0 3.6 1 97 rmt/5
0.0 269.0 0.0 68874.0 0.0 0.9 0.0 3.2 1 87 rmt/1
266.0 0.0 68106.0 0.0 0.0 1.0 0.0 3.6 1 97 rmt/5
0.0 260.0 0.0 66548.4 0.0 0.8 0.0 3.1 1 81 rmt/1
260.0 0.0 66548.2 0.0 0.0 1.0 0.0 3.7 1 97 rmt/5
0.0 266.1 0.0 68120.8 0.0 0.8 0.0 3.1 1 83 rmt/1
266.1 0.0 68121.2 0.0 0.0 1.0 0.0 3.7 0 97 rmt/5
0.0 29.0 0.0 7425.1 0.9 0.1 30.8 3.1 89 9 rmt/1
38.0 0.0 9729.4 0.0 0.0 0.1 0.0 3.6 0 14 rmt/5
0.0 0.0 0.0 0.0 1.0 0.0 0.0 0.0 100 0 rmt/1
0.0 0.0 0.0 0.0 1.0 0.0 0.0 0.0 100 0 rmt/1
0.0 0.0 0.0 0.0 1.0 0.0 0.0 0.0 100 0 rmt/1
0.0 0.0 0.0 0.0 1.0 0.0 0.0 0.0 100 0 rmt/1
0.0 0.0 0.0 0.0 1.0 0.0 0.0 0.0 100 0 rmt/1
0.0 0.0 0.0 0.0 1.0 0.0 0.0 0.0 100 0 rmt/1
0.0 0.0 0.0 0.0 1.0 0.0 0.0 0.0 100 0 rmt/1
0.0 0.0 0.0 0.0 1.0 0.0 0.0 0.0 100 0 rmt/1
0.0 0.0 0.0 0.0 1.0 0.0 0.0 0.0 100 0 rmt/1
0.0 203.0 0.0 51958.5 0.1 0.6 0.6 3.1 11 64 rmt/1
194.0 0.0 49654.9 0.0 0.0 0.7 0.0 3.8 0 73 rmt/5
0.0 225.0 0.0 57609.0 0.0 0.7 0.0 3.1 1 70 rmt/1
224.0 0.0 57353.0 0.0 0.2 0.8 0.7 3.6 17 81 rmt/5
0.0 0.0 0.0 0.0 1.0 0.0 0.0 0.0 100 0 rmt/5
0.0 0.0 0.0 0.0 1.0 0.0 0.0 0.0 100 0 rmt/5
0.0 0.0 0.0 0.0 1.0 0.0 0.0 0.0 100 0 rmt/5
0.0 0.0 0.0 0.0 1.0 0.0 0.0 0.0 100 0 rmt/5
0.0 0.0 0.0 0.0 1.0 0.0 0.0 0.0 100 0 rmt/5
0.0 0.0 0.0 0.0 1.0 0.0 0.0 0.0 100 0 rmt/5
0.0 0.0 0.0 0.0 1.0 0.0 0.0 0.0 100 0 rmt/5
0.0 0.0 0.0 0.0 1.0 0.0 0.0 0.0 100 0 rmt/5
0.0 0.0 0.0 0.0 1.0 0.0 0.0 0.0 100 0 rmt/5
0.0 31.0 0.0 7943.4 0.0 0.1 0.0 3.9 0 12 rmt/1
35.0 0.0 8968.4 0.0 0.8 0.2 23.9 4.5 84 16 rmt/5
0.0 270.1 0.0 69151.2 0.0 0.9 0.0 3.3 1 88 rmt/1
267.1 0.0 68383.3 0.0 0.0 1.0 0.0 3.6 1 97 rmt/5
0.0 144.0 0.0 36861.6 0.5 0.5 3.2 3.1 47 45 rmt/1
144.0 0.0 36861.5 0.0 0.5 0.5 3.2 3.6 46 52 rmt/5
0.0 0.0 0.0 0.0 1.0 0.0 0.0 0.0 100 0 rmt/1
0.0 0.0 0.0 0.0 1.0 0.0 0.0 0.0 100 0 rmt/5
0.0 0.0 0.0 0.0 1.0 0.0 0.0 0.0 100 0 rmt/1
0.0 0.0 0.0 0.0 1.0 0.0 0.0 0.0 100 0 rmt/5
0.0 0.0 0.0 0.0 1.0 0.0 0.0 0.0 100 0 rmt/1
0.0 0.0 0.0 0.0 1.0 0.0 0.0 0.0 100 0 rmt/5
0.0 0.0 0.0 0.0 1.0 0.0 0.0 0.0 100 0 rmt/1
0.0 0.0 0.0 0.0 1.0 0.0 0.0 0.0 100 0 rmt/5
0.0 0.0 0.0 0.0 1.0 0.0 0.0 0.0 100 0 rmt/1
0.0 0.0 0.0 0.0 1.0 0.0 0.0 0.0 100 0 rmt/5
0.0 0.0 0.0 0.0 1.0 0.0 0.0 0.0 100 0 rmt/1
0.0 0.0 0.0 0.0 1.0 0.0 0.0 0.0 100 0 rmt/5
0.0 0.0 0.0 0.0 1.0 0.0 0.0 0.0 100 0 rmt/1
0.0 0.0 0.0 0.0 1.0 0.0 0.0 0.0 100 0 rmt/5
0.0 0.0 0.0 0.0 1.0 0.0 0.0 0.0 100 0 rmt/1
0.0 0.0 0.0 0.0 1.0 0.0 0.0 0.0 100 0 rmt/5
0.0 0.0 0.0 0.0 1.0 0.0 0.0 0.0 100 0 rmt/1

Obviously this is a clone monitored session but the same 100%-wait events are present in a common backup (write) session.
As a result of this behavier I think, our backup times are very variable: for 500 GB of data th best results are around 4 hours and the worst cases takes 7-8 hours, depending I guess on how much time is spent in 100%-wait state. I have also seen 100%-busy lines on the rmt devices as the previous lines.

I dont admin the Windows Legato Server (I am the UNIX System Administrator) and dont know much about how these backups sessions are configured. But I think the backup process is waiting for something INSIDE my UNIX box (application data, file system level, Volume Manager level, Qlogic backup HBA driver level....) or outside it (Legato server, drives, SAN...) .

Any help is very very welcome as I am lost in space.

TIA.
Mark.
 
Back
Top