Veritas-bu

[Veritas-bu] bpbkar cpu %100 utilization

2002-08-13 11:47:36
Subject: [Veritas-bu] bpbkar cpu %100 utilization
From: GRABBEB AT dominos DOT com (Bob Grabbe)
Date: Tue, 13 Aug 2002 11:47:36 -0400
This is similar to a problem I have with netbackup 4.5 on Solaris, with
the client version 4.5 on Windows 2000.
What I'm seeing is network timeouts, status 41, varying amounts of data
written to tape, multiple bpbkar processes running on the client. 
I had to go back to the 3.4GA client with no patches installed to get
backups to work on the client at all. It does seem to be related to
either a large number of files, or large file sizes. 


Bob Grabbe
Dominos Pizza LLC
734-930-3703
Fax 734-669-3703
grabbeb AT dominos DOT com

>>> "Vic Vac" <perl AT vicvac DOT com> 8/13/02 10:48:37 AM >>>
Hi,
I have an issue that is a huge pain in the ass
ENV= Master server win2k sp2 (yea that is a pain in the ass )
Media server win2k (ditto)
Netbackup=3.4.1 ga patch level is 775
Server hardware is a Compaq dl380
Controller adaptec 2944uw
Storage device is a storage tek timberwolf 9730 diff scsi

Every time a backup kicks off, everything looks ok, but the backups
always fail,  data gets written to tape, error 41 , network connection
times out

 When you look at the server, cpu is at 100%

I have increased the timeouts. Disabled OTM and get a weird error in
the bpbkar log, see below.

There are 3 bpbkar processes running 1 will be running forever using
all the cycles and 2 that aren't doing anything, you can't manually stop
them , you have to reboot. ( I did mention this was windows already )

 I found some issues while searching for solutions that mentioning the
page file system.

 There are several otm.temp files from the past few days that are all
exactly 102,400 kb,  

 Server has 2 file systems

System 8 gig, 60% free

Data     82 gig , 10% free

Page file is set to 768mg

 

I have been trying to get backups running here for sometime now. I have
several media server with the exact same config working fine. There are
several large files on this server 1-1.5 gig in size.

 




10:34:18.586 AM: [2376.2416] <4> ov_log::OVInit: INF - Starting log
file: C:\Program Files\VERITAS\NetBackup\logs\BPBKAR\081302.LOG

10:34:18.586 AM: [2376.2416] <4> ov_log::OVInit: GENERAL Log Level: 0
10:34:18.586 AM: [2376.2416] <4> ov_log::OVInit: TCP Log Level: 0
10:34:18.586 AM: [2376.2416] <4> ov_log::OVInit: INF - the log mutex:
104
BPBKAR  NetBackup Backup/Archive  4.5GA  [Mar 21 2002]
Copyright 1993 - 2002 VERITAS Software Corporation
All Rights Reserved.

10:34:18.961 AM: [2376.2416] <2> WinMain: DAT - _pgmptr = 'c:\Program
Files\VERITAS\NetBackup\bin\bpbkar32.exe'
10:34:18.961 AM: [2376.2416] <2> WinMain: DAT - lpCmdLine = '-r 4672560
-ru root -dt 0 -to 0 -clnt inohoa01 -class CLE-OH -sched Cumulative-Inc
-st CINC -bpstart_to 300 -bpend_to 300 -read_to 300 -use_otm -fso -b
inohoa01_1029249219 -kl 28 -ct 13 -shm '
10:34:18.961 AM: [2376.2416] <2> date_debug: DAT - timezone: Eastern
Standard Time, offset=18000, dst: Eastern Daylight Time
10:34:18.961 AM: [2376.2416] <2> date_debug: DAT - current time:
1029249258, 8/13/2002 10:34:18 AM
10:34:18.961 AM: [2376.2416] <2> date_debug: DAT - 01/01/94 UCT: 
757382400, 12/31/1993 8:00:00 PM
10:34:18.961 AM: [2376.2416] <2> date_debug: DAT - 07/01/94 UCT: 
773020800, 6/30/1994 8:00:00 PM
10:34:18.961 AM: [2376.2416] <2> WinMain: DAT - standard input handle =
560
10:34:19.149 AM: [2376.2416] <2> WinMain: DAT - standard output handle
= 108
10:34:19.149 AM: [2376.2416] <2> WinMain: DAT - standard error handle =
416
10:34:25.180 AM: [2376.2416] <4> V_OTM_Initialize: INF -
======================================================================
10:34:25.180 AM: [2376.2416] <4> V_OTM_Initialize: INF - OTM Version
Information
10:34:25.180 AM: [2376.2416] <4> V_OTM_Initialize: INF -
----------------------------------------------------------------------
10:34:25.180 AM: [2376.2416] <4> V_OTM_Initialize: INF -    OSType:
00000025
10:34:25.180 AM: [2376.2416] <4> V_OTM_Initialize: INF - OSVersion:
08930005
10:34:25.180 AM: [2376.2416] <4> V_OTM_Initialize: INF -   Version:
00ca0112
10:34:25.180 AM: [2376.2416] <4> V_OTM_Initialize: INF - LoVersion:
00000110
10:34:25.180 AM: [2376.2416] <4> V_OTM_Initialize: INF -
======================================================================
10:34:25.180 AM: [2376.2416] <4> V_OTM_Initialize: INF - OTM Initialize
- able to register
10:34:30.977 AM: [2376.2416] <4> backup_create: INF - NetBackup Temp
Directory: 'c:\Program Files\VERITAS\NetBackup\Temp'
10:34:31.743 AM: [2376.2416] <4> tar_backup::backup_create: INF -
dwJobData: 00000000
10:34:31.743 AM: [2376.2416] <4> tar_backup::backup_create: INF -    
dwJob: 00000000
10:34:31.743 AM: [2376.2416] <4> dos_backup::V_PreProcessing: INF -
backup privileges enabled, previous = 3
10:34:31.758 AM: [2376.2416] <4> dos_backup::V_PreProcessing: INF -
restore privileges enabled, previous = 3
10:34:31.946 AM: [2376.2416] <4> dos_backup::V_PreProcessing: INF -
security privileges enabled, previous = 3
10:34:31.946 AM: [2376.2416] <4> dos_backup::V_PreProcessing: INF - tcb
privileges enabled, previous = 3
10:34:31.946 AM: [2376.2416] <4> dos_backup::V_PreProcessing: INF -
create token privileges enabled, previous = 3
10:34:31.946 AM: [2376.2416] <4> dos_backup::V_PreProcessing: INF -
user name: root
10:34:31.946 AM: [2376.2416] <4> dos_backup::V_PreProcessing: INF - no
access token: scheduled backup
10:34:31.946 AM: [2376.2416] <2> tar_backup::backup_create: TAR -
CONTINUE BACKUP received
10:34:31.946 AM: [2376.2416] <2> tar_backup::backup_create: TAR -
backup filename = ALL_LOCAL_DRIVES
10:34:35.352 AM: [2376.2416] <4> tar_backup::OVPC_SetupSharedMemory:
INF - media_shm_info = 16 65536 35498156 2340 0 0 0 0 1
10:34:35.352 AM: [2376.2416] <4> tar_backup::OVPC_SetupSharedMemory:
INF - SHMID = 35498156, BUF_PTR = 0xdb0000, BUF_CONTROL = 0xeb0000,
readyptr = 0xeb0180
10:34:38.727 AM: [2376.2416] <4> dos_backup::V_VerifyFileList: INF -
Added: C:\
10:34:38.727 AM: [2376.2416] <4> dos_backup::V_VerifyFileList: INF -
Added: F:\
10:34:38.727 AM: [2376.2416] <4> dos_backup::V_VerifyFileList: INF -
Added: System_State:\
10:35:51.993 AM: [2376.2416] <4> tar_backup::V_DetermineEstimate: INF -
================================================================================
10:35:51.993 AM: [2376.2416] <4> tar_backup::V_DetermineEstimate: INF -
job tracking estimate: start
10:35:51.993 AM: [2376.2416] <2> ov_log::V_GlobalLog: INF - Exchange
Server MailBox Interface Ver:1.1
10:35:52.180 AM: [2376.2416] <2> ov_log::V_GlobalLog: INF - BEDS_Init()
Enter InitFlags:0x0
10:35:52.368 AM: [2376.2416] <2> ov_log::V_GlobalLog: WRN - BEDS_Init()
FS_InitDleList() Failed! (0xFFFFFE46:No data stores can be initialized. 
The software is most likely installed incorrectly.
)
10:35:52.368 AM: [2376.2416] <2> ov_log::V_GlobalLog: INF - BEDS_Term()
Enter InitFlags:0x1





<Prev in Thread] Current Thread [Next in Thread>