ADSM-L

JBB Notification Buffer overflow ?

2006-12-28 06:18:48
Subject: JBB Notification Buffer overflow ?
From: Otto Chvosta <otto.chvosta AT MEDUNIWIEN.AC DOT AT>
To: ADSM-L AT VM.MARIST DOT EDU
Date: Thu, 28 Dec 2006 12:18:15 +0100
Hi,

the problem with one of our fileservers using JBB still exists.

After install of the journal service and an initial full incremental backup
it seems impossible to get a vaild journal.

When we start the journal service the following errors are reported in 2
second intervals in jbberror.log :

12/28/2006 09:21:11 ReadFsChangesThread(tid 10236): ReadDirectoryChangesW:
buffer overflow error.
12/28/2006 09:21:11 ReadFsChangesThread(tid 10236): ReadDirectoryChangesW:
exiting thread due to buffer overflow error.
12/28/2006 09:21:11 psFsMonitorThread(tid 13352): Notification buffer
overrun for monitored FS 'Q:\', journal will be reset.
12/28/2006 09:21:11 jnlDbCntrl(): Resetting journal for fs 'Q:'.

same effect using the filemon utility (details below):

MonitorThread(tid 6192): *** Notification Buffer  overflow. ***
MonitorThread(tid 6192): Restarting.

Our buffer sizes are 20 MB (NotifyBufferSize) and 10MB
(DirNotifyBufferSize).

Any idea what can be wrong ?

Where can we get the actual release of jbbtools (dbviewb, filemon, etc.) for
Client Level 5.3 ?


Thank you in advance,

Otto

TSM-Administration
Medical University of Vienna, Austria


some info's ....

SYSTEMINFO:
-----------
Server Version 5, Release 3, Level 4.0 on AIX5L Level 5300-05-03

Client Version 5, Release 3, Level 4.0

[System Summary]

Item    Value   
OS Name Microsoft(R) Windows(R) Server 2003, Standard Edition   
Version 5.2.3790 Service Pack 1 Build 3790      
Other OS Description    R2      
OS Manufacturer Microsoft Corporation   
System Name     FS1LUBEC        
System Manufacturer     HP      
System Model    ProLiant DL380 G4       
System Type     X86-based PC    
Processor       x86 Family 15 Model 4 Stepping 10 GenuineIntel ~3400 Mhz

Processor       x86 Family 15 Model 4 Stepping 10 GenuineIntel ~3400 Mhz

BIOS Version/Date       HP P51, 10/10/2005      
SMBIOS Version  2.3     
Windows Directory       C:\WINDOWS      
System Directory        C:\WINDOWS\system32     
Boot Device     \Device\HarddiskVolume1 
Locale  United States   
Hardware Abstraction Layer      Version = "5.2.3790.1830
(srv03_sp1_rtm.050324-1447)"    
User Name       FS1LUBEC\Administrator  
Time Zone       W. Europe Standard Time 
Total Physical Memory   2,047.47 MB     
Available Physical Memory       1.45 GB 
Total Virtual Memory    1.86 GB 
Available Virtual Memory        1.42 GB 
Page File Space 4.00 GB 
Page File       C:\pagefile.sys 


jbberror.log:

12/28/2006 09:21:11 ReadFsChangesThread(tid 10236): ReadDirectoryChangesW:
buffer overflow error.
12/28/2006 09:21:11 ReadFsChangesThread(tid 10236): ReadDirectoryChangesW:
exiting thread due to buffer overflow error.
12/28/2006 09:21:11 psFsMonitorThread(tid 13352): Notification buffer
overrun for monitored FS 'Q:\', journal will be reset.
12/28/2006 09:21:11 jnlDbCntrl(): Resetting journal for fs 'Q:'.
12/28/2006 09:21:11 ReadFsChangesThread(tid 7136): ReadDirectoryChangesW:
buffer overflow error.
12/28/2006 09:21:11 ReadFsChangesThread(tid 7136): ReadDirectoryChangesW:
exiting thread due to buffer overflow error.
12/28/2006 09:21:13 psFsMonitorThread(tid 13352): Notification buffer
overrun for monitored FS 'Q:\', journal will be reset.
12/28/2006 09:21:13 jnlDbCntrl(): Resetting journal for fs 'Q:'.
12/28/2006 09:21:13 ReadFsChangesThread(tid 9864): ReadDirectoryChangesW:
buffer overflow error.
12/28/2006 09:21:13 ReadFsChangesThread(tid 9864): ReadDirectoryChangesW:
exiting thread due to buffer overflow error.
12/28/2006 09:21:15 psFsMonitorThread(tid 13352): Notification buffer
overrun for monitored FS 'Q:\', journal will be reset.
12/28/2006 09:21:15 jnlDbCntrl(): Resetting journal for fs 'Q:'.
12/28/2006 09:21:15 ReadFsChangesThread(tid 13020): ReadDirectoryChangesW:
buffer overflow error.
12/28/2006 09:21:15 ReadFsChangesThread(tid 13020): ReadDirectoryChangesW:
exiting thread due to buffer overflow error.
12/28/2006 09:21:17 psFsMonitorThread(tid 13352): Notification buffer
overrun for monitored FS 'Q:\', journal will be reset.
12/28/2006 09:21:17 jnlDbCntrl(): Resetting journal for fs 'Q:'.
12/28/2006 09:21:17 ReadFsChangesThread(tid 10636): ReadDirectoryChangesW:
buffer overflow error.
12/28/2006 09:21:17 ReadFsChangesThread(tid 10636): ReadDirectoryChangesW:
exiting thread due to buffer overflow error.
12/28/2006 09:21:19 psFsMonitorThread(tid 13352): Notification buffer
overrun for monitored FS 'Q:\', journal will be reset.
12/28/2006 09:21:19 jnlDbCntrl(): Resetting journal for fs 'Q:'.
12/28/2006 09:21:19 ReadFsChangesThread(tid 9712): ReadDirectoryChangesW:
buffer overflow error.
12/28/2006 09:21:19 ReadFsChangesThread(tid 9712): ReadDirectoryChangesW:
exiting thread due to buffer overflow error.
12/28/2006 09:21:21 psFsMonitorThread(tid 13352): Notification buffer
overrun for monitored FS 'Q:\', journal will be reset.
12/28/2006 09:21:21 jnlDbCntrl(): Resetting journal for fs 'Q:'.



tsmjbbd.ini:

JournaledFileSystems=Q:

[JournaledFileSystemSettings.Q:\]

JournalDBSize=0x00000000
NotifyBufferSize=0x01400000
DirNotifyBufferSize=0x00A00000
PreserveDBOnExit=1
DeferFsMonStart=1
DeferRetryInterval=30
logFsErrors=1



Q:\tsm\jbbtools>filemon -filter=0x00000117 -buffer=0x01400000 q:
MainThread(): Monitor starting ...

MainThread(): Fifo Queue Created and Initialized.

MainThread(): Starting Monitor Thread for 'q:' ....

MonitorThread(tid 6192): Started.
--------------------------------------
     Monitored Directory             = q:\
     Notification Filter             = 0x117
     Notification Buffer Size        = 20 Meg (20971520 Bytes)

     Change notifications monitored:

        Filter for File Name Changes
        Filter for Directory Name Changes
        Filter for Attribute Bit Mask Changes
        Filter for Last Write Time Changes
        Filter for Security Descriptor Changes
----------------------------------------



MonitorThread(tid 6192): *** Notification Buffer  overflow. ***

MonitorThread(tid 6192): Restarting.



MonitorThread(tid 6192): *** Notification Buffer  overflow. ***

MonitorThread(tid 6192): Restarting.



MonitorThread(tid 6192): *** Notification Buffer  overflow. ***

MonitorThread(tid 6192): Restarting.

MainThread(): 1 Monitor Threads Started.
MainThread(): Listening to monitor threads ....
CheckKeyThread(tid 12424): Started.

CheckKeyThread(): Press 'S' to display  stats
                        '+' to increase scroll rate
                        '-' to decrease scroll rate
                        'Q' to quit



MonitorThread(tid 6192): *** Notification Buffer  overflow. ***

MonitorThread(tid 6192): Restarting.



MonitorThread(tid 6192): *** Notification Buffer  overflow. ***

MonitorThread(tid 6192): Restarting.



MonitorThread(tid 6192): *** Notification Buffer  overflow. ***

MonitorThread(tid 6192): Restarting.



MonitorThread(tid 6192): *** Notification Buffer  overflow. ***

MonitorThread(tid 6192): Restarting.



MonitorThread(tid 6192): *** Notification Buffer  overflow. ***

MonitorThread(tid 6192): Restarting.



MonitorThread(tid 6192): *** Notification Buffer  overflow. ***

MonitorThread(tid 6192): Restarting.



MonitorThread(tid 6192): *** Notification Buffer  overflow. ***

MonitorThread(tid 6192): Restarting.



MonitorThread(tid 6192): *** Notification Buffer  overflow. ***

MonitorThread(tid 6192): Restarting.

CheckKeyThread(): 'Q' key posted, action pending.
CheckKeyThread(tid 12424): Ending.

MainThread(): Shutting down ...

MainThread(): Final Monitor Statistics:


MainThread(): 1 Monitor Thread(s) running
MainThread(): Monitor Thread Statistics

              -------------------------
               Monitor Thread 0:
                  Thread ID                          : 6192
                  Status                             : running
                  Monitored Directory                : q:
                  Allocated Buffer Size              : 20 Meg (20971520
Bytes)

                  Max Notification Buffer Size       : 0 Bytes
                  Max Notification Buffer Entries    : 0
                  Number of Buffer Overflow Errors   : 11
                  Number of Object Access Errors     : 0
                  Total Notification Buffers         : 0

                  Total Notifications                : 0
                           Creations                 : 0
                           Deletions                 : 0
                           Modifications             : 0

                  Average Notifications per Buffer   : 0
                  Average Notification Buffer Size   : 0 Bytes
                  Average Object Path Length         : 0 Bytes

                  Elapsed time                       : 000:00:09

              -------------------------

             0 total filesystem changes recorded.


MainThread(): Shutting down Monitor Threads ....

MainThread(): Issuing shutdown signal to Monitor Thread 0 ...
MainThread(): Monitor Thread 0 not responding to shutdown signal.
MainThread(): Terminating Monitor Thread 0, tid 6192.
MainThread(): Deleted fifo queue.
MainThread(): Monitor has ended.

<Prev in Thread] Current Thread [Next in Thread>