Domino restore (The integrity of a database storage container has been lost)

[Stator]

Hello,

I have TSM 6.1 server and 5.5 client running on top of RHEL 5.
Few days ago I tried to do restore of one mailbox (Domino 8.5.1).
First I tested it with small inbox of 150 MB and everything went fine.
But when I try the same procedure on real 3.6 GB mailbox something broke.

First command

domdsmc restore mail/aboehm2.nsf /pick=showall /into=backup/= /activate=no

Everything went ok! (selective backup)


Second command

domdsmc activatedbs /applylogs=07/29/2010 /pick

And i got this

... (there was more text but it was all the same)

Full: 0 Read: 0 Written: 0 Rate: 0.00 Kb/Sec /Sec
Waiting for TSM server.......
Full: 0 Read: 67109888 Written: 67109888 Rate: 3,584.19 Kb/Sec
Restore of S0003151.TXN completed successfully.
comp = 11, fnc = 82, tracePt = 102
3D000000
Restoring transaction log file S0003150.TXN
to /local/notesdata/logdir/S0003150.TXN
Full: 0 Read: 0 Written: 0 Rate: 0.00 Kb/Sec
Waiting for TSM server......
Full: 0 Read: 67109888 Written: 67109888 Rate: 3,709.99 Kb/Sec
Restore of S0003150.TXN completed successfully.
comp = 11, fnc = 82, tracePt = 102
3D000000
Restoring transaction log file S0003149.TXN
to /local/notesdata/logdir/S0003149.TXN
Full: 0 Read: 0 Written: 0 Rate: 0.00 Kb/Sec
Waiting for TSM server.....
Full: 0 Read: 67109888 Written: 67109888 Rate: 3,952.06 Kb/Sec
Restore of S0003149.TXN completed successfully.
comp = 11, fnc = 82, tracePt = 102
3D000000
Restoring transaction log file S0003144.TXN
to /local/notesdata/logdir/S0003144.TXN
Full: 0 Read: 67109888 Written: 67109888 Rate: 5,760.48 Kb/Sec
Restore of S0003144.TXN completed successfully.
08/05/2010 11:00:55 AM Recovery Manager: Media Recovery complete for /local/notesdata/backup/aboehm2.nsf.dad, last update applied 07/28/2010 11:56:44 PM.

Transaction log file processing completed successfully.

Activating database backup/aboehm2.nsf, 1 of 1,
**** DbMarkCorrupt(NoteOpenExtended: NBNS signature invalid), DB=/local/notesdata/backup/aboehm2.nsf.dad TID=[02711:00002-3086436032] File=ntopen.c Line=1743 ***
Clearing DBIID A48AB226 for DB /local/notesdata/backup/aboehm2.nsf.dad
08/05/2010 11:02:44 AM Document NT00000A52 in database /local/notesdata/backup/aboehm2.nsf.dad is damaged: Document attachment is invalid
08/05/2010 11:02:44 AM Document (UNID OF042AA810:3405CBBF-ON85256D03:0045A670) in database /local/notesdata/backup/aboehm2.nsf.dad has been deleted
08/05/2010 11:02:51 AM Document NT0000111A in database /local/notesdata/backup/aboehm2.nsf.dad is damaged: Document attachment is invalid
08/05/2010 11:02:51 AM Document (UNID OF82317FA0:977DE0C1-ONC1257512:0052C9A1) in database /local/notesdata/backup/aboehm2.nsf.dad has been deleted
08/05/2010 11:02:52 AM Document NT00001402 in database /local/notesdata/backup/aboehm2.nsf.dad is damaged: Document attachment is invalid
08/05/2010 11:02:52 AM Document (UNID OF22447DF4:B23069F2-ONC1257519:004F1AA8) in database /local/notesdata/backup/aboehm2.nsf.dad has been deleted
08/05/2010 11:02:52 AM Document NT000011DE in database /local/notesdata/backup/aboehm2.nsf.dad is damaged: Document attachment is invalid
08/05/2010 11:02:52 AM Document (UNID OF0EB777B86D76F36-ONC1257513:004A6B04) in database /local/notesdata/backup/aboehm2.nsf.dad has been deleted
08/05/2010 11:02:52 AM Document NT00001A4A in database /local/notesdata/backup/aboehm2.nsf.dad is damaged: This database cannot be read due to an invalid on disk structure
08/05/2010 11:02:52 AM Document (UNID OF84B0F82E:E8BA7563-ONC1257513:004B3CB8) in database /local/notesdata/backup/aboehm2.nsf.dad has been deleted
08/05/2010 11:02:52 AM Document NT000011E6 in database /local/notesdata/backup/aboehm2.nsf.dad is damaged: Document attachment is invalid

yada yada yada more same errors


08/05/2010 11:06:14 AM Document (UNID OFC63EE0A3:8FEEBA5F-ON3FDBEC73:9BE5B4ED) in database /local/notesdata/backup/aboehm2.nsf.dad has been deleted
08/05/2010 11:06:15 AM Document NT000257BA in database /local/notesdata/backup/aboehm2.nsf.dad is damaged: This database cannot be read due to an invalid on disk structure
08/05/2010 11:06:15 AM Document (UNID OF063E51EC:21582481-ONC125773D:002905D2) in database /local/notesdata/backup/aboehm2.nsf.dad has been deleted
08/05/2010 11:07:10 AM Document NT0002A172 in database /local/notesdata/backup/aboehm2.nsf.dad is damaged: Document attachment is invalid
08/05/2010 11:07:10 AM Document (UNID OFAB4B8F75:03BE94DA-ONC1257765:0035F984) in database /local/notesdata/backup/aboehm2.nsf.dad has been deleted
08/05/2010 11:07:10 AM Document NT0002A706 in database /local/notesdata/backup/aboehm2.nsf.dad is damaged: Document attachment is invalid
08/05/2010 11:07:10 AM Document (UNID OF59B1D51E:10EB27B7-ONC1257766:0031B45A) in database /local/notesdata/backup/aboehm2.nsf.dad has been deleted
08/05/2010 11:08:57 AM Recovery Manager: Assigning new DBIID for /local/notesdata/backup/aboehm2.nsf.dad (need new backup for media recovery).
Activate of backup/aboehm2.nsf failed.
The integrity of a database storage container has been lost - the container will be rebuilt.

Total pending databases inspected: 1
Total pending databases requested for activation: 1
Total pending databases activated: 0

Total archived log backups requested for restore: 419
Throughput rate to restore log files: 5,448.36 Kb/Sec
Total bytes transferred to restore log files: 28,119,043,072
Elapsed processing time to restore log files: 5,040.05 Secs


ACD0151E Errors occurred while processing the request.

I couldn't find anything like this, does anyone have any advice ?

 

[f4ts0]

Seems like corrupted database?

Type "q sched" and provide output to see your policies

 

[Stator]

Here it is.

tsm: SERVER1>q sched

Domain           *     Schedule Name        Action     Start Date/Time          Duration     Period     Day
------------     -     ----------------     ------     --------------------     --------     ------     ---
STANDARD               DOMINO_ARCHIVE       CMD        05/22/2009 18:00:00          1 H        6 H      Any                                                                               
STANDARD               INCREMENTAL_MAIL     CMD        05/22/2009 01:30:00          1 H        1 D      Any
STANDARD               SELECTIVE_MAIL       CMD        05/18/2010 19:00:00          3 H        1 Mo     Any