Well.
We just got hit with the same problem - 10 triggered DB backups in a row
without clearing the archivelog.
TSM on Windows 6.3.4.300.
We did figure out what - just not why.
After adding an archlogoverflow directory and watching MORE db backups, what we
found was that every time the DB backup ran, it did clear the recent stuff out
of archlogoverflow and about 55 G out of the 1.2 TB archivelog directory. So
we could keep running the most critical part of our load and stay up.
Further investigation showed that we had a big groups of what I will call
"orphaned" log files in the archivelog directory. There was a chunk of log
files from 7/11, a chunk from 8/20, 8/22, and 8/27. Then a gap in time, then
the log files since the most recent DB backup.
So whatever hit us, hit once on 7/11, then started happening big time on 8/20.
Left more than 700G of orphans.
It looks like TSM DB backup is never going to go back and look for those.
Anybody know what causes this?
Remco, thanks VERY much for your post, that's the most useful info I've seen so
far.
I don't see anything in db2diagx.log that I can relate to failing to locate or
delete archive logs - OTOH I really don't know how to interpret what I see in
there. We opened a PMR and sent the db2diag.log to IBM support and AFAIK they
didn't read it at all.
But what we've done for now is move the old chunks out, so that the archivelog
directory is clean up until the time of the last DB backup. Will let it run a
few days and see if it happens again. Then at least I"ll have an accurate
point of reference to try and match up the db2diag and TSM actlog.
Wanda
-----Original Message-----
From: ADSM: Dist Stor Manager [mailto:ADSM-L AT VM.MARIST DOT EDU] On Behalf Of
Remco Post
Sent: Tuesday, August 26, 2014 6:19 PM
To: ADSM-L AT VM.MARIST DOT EDU
Subject: Re: [ADSM-L] tsm archive log full, causes repeated backups
check the following:
- db2 recovery history retention. IIRC it should be set to 0 for TSM. In one
environment I used to manage a db2 DBA once decided to sanitize all db2
installations to a recovery history retention of 30 days... major pains. You'll
have to do the google foo yourself, I don't recall if it's part of db2 database
or db2 database manager parameters.
- if at all possible grow J:
- if growing J is hard: try harder
- if growing J: is absolutely impossible it is not very dangerous to move the
oldest db2 log files to some other place, they are indeed archived log files
and are no longer needed for your operation. They might be needed for recovery
until you've made sufficient full database backups. Check the db2 event log for
any messages regarding required log files not being found. In principle a full
backup should contain a full copy of the database and all active log files that
have been touched during the making of the backup.
- if in doubt: call IBM
Op 26 aug. 2014, om 18:37 heeft Tim Brown <TBrown AT CENHUD DOT COM> het
volgende geschreven:
> Archive logs are in j:\tsm\archlog
>
> Drive J is 250Gb total, free space just 386mb
>
> Tim
>
> -----Original Message-----
> From: ADSM: Dist Stor Manager [mailto:ADSM-L AT VM.MARIST DOT EDU] On Behalf
> Of Rhodes, Richard L.
> Sent: Tuesday, 26 August, 2014 12:26 PM
> To: ADSM-L AT VM.MARIST DOT EDU
> Subject: Re: [ADSM-L] tsm archive log full, causes repeated backups
>
> Cound something wrong with your archive log filesystem? Might it be
> unmounted or something?
>
> Rick
>
>
>
> -----Original Message-----
> From: ADSM: Dist Stor Manager
> [https://urldefense.proofpoint.com/v1/url?u=http://mailto:ADSM-L%40VM.MARIST.EDU&k=pCpgOv%2FKLW5dYRss05kLEw%3D%3D%0A&r=tQq0J85k4w4CeO1cI0sWanGhPyb3Fq7EC6ctgNHLxNs%3D%0A&m=wLQwo6jEM4gBohY6PaUggUKrw4TZKeuDMgOs7FtRQdQ%3D%0A&s=37a9c6f9d2e7c472c894e68ee88ab04eb74a4c87016a83326c058eb0e36cd30d]
> On Behalf Of Tim Brown
> Sent: Tuesday, August 26, 2014 12:13 PM
> To: ADSM-L AT VM.MARIST DOT EDU
> Subject: Re: tsm archive log full, causes repeated backups
>
> There have actually been 5 backups completed in a row since server was
> started all with success! ?
>
> All started due to ANR0299I A full database backup will be started. The
> archive log space used is 99 % and the archive log space used threshold is
> 80 percent.
>
>
> Tim
>
> -----Original Message-----
> From: ADSM: Dist Stor Manager
> [https://urldefense.proofpoint.com/v1/url?u=http://mailto:ADSM-L%40VM.MARIST.EDU&k=pCpgOv%2FKLW5dYRss05kLEw%3D%3D%0A&r=tQq0J85k4w4CeO1cI0sWanGhPyb3Fq7EC6ctgNHLxNs%3D%0A&m=wLQwo6jEM4gBohY6PaUggUKrw4TZKeuDMgOs7FtRQdQ%3D%0A&s=37a9c6f9d2e7c472c894e68ee88ab04eb74a4c87016a83326c058eb0e36cd30d]
> On Behalf Of Prather, Wanda
> Sent: Tuesday, 26 August, 2014 12:05 PM
> To: ADSM-L AT VM.MARIST DOT EDU
> Subject: Re: [ADSM-L] tsm archive log full, causes repeated backups
>
> That usually means your activity log is enormous! :>) But restarting the
> server would have killed any reorg or pinning transaction.
>
> Try 2 db backups in a row now, your archive log should clear.
>
> W
>
> -----Original Message-----
> From: ADSM: Dist Stor Manager
> [https://urldefense.proofpoint.com/v1/url?u=http://mailto:ADSM-L%40VM.MARIST.EDU&k=pCpgOv%2FKLW5dYRss05kLEw%3D%3D%0A&r=tQq0J85k4w4CeO1cI0sWanGhPyb3Fq7EC6ctgNHLxNs%3D%0A&m=59fjuhngA9cOaKKoSEEx7QKvB8n8WS8AJcQc7dKkvOg%3D%0A&s=b9b987e96026d7ceb61565c822db7a14a1f95296ced725cff1999c4c0687b4eb]
> On Behalf Of Tim Brown
> Sent: Tuesday, August 26, 2014 11:32 AM
> To: ADSM-L AT VM.MARIST DOT EDU
> Subject: Re: [ADSM-L] tsm archive log full, causes repeated backups
>
> I had even restarted the tsm server today
>
> If I enter with just =today it comes right back If I enter with today-1 the
> query hangs
>
> Tim
>
> -----Original Message-----
> From: ADSM: Dist Stor Manager
> [https://urldefense.proofpoint.com/v1/url?u=http://mailto:ADSM-L%40VM.MARIST.EDU&k=pCpgOv%2FKLW5dYRss05kLEw%3D%3D%0A&r=tQq0J85k4w4CeO1cI0sWanGhPyb3Fq7EC6ctgNHLxNs%3D%0A&m=59fjuhngA9cOaKKoSEEx7QKvB8n8WS8AJcQc7dKkvOg%3D%0A&s=b9b987e96026d7ceb61565c822db7a14a1f95296ced725cff1999c4c0687b4eb]
> On Behalf Of Prather, Wanda
> Sent: Tuesday, 26 August, 2014 11:16 AM
> To: ADSM-L AT VM.MARIST DOT EDU
> Subject: Re: [ADSM-L] tsm archive log full, causes repeated backups
>
> You could have a reorg running and pinning the log.
>
> Try: q actlog begindate=today-2 search=reorg
>
> -----Original Message-----
> From: ADSM: Dist Stor Manager
> [https://urldefense.proofpoint.com/v1/url?u=http://mailto:ADSM-L%40VM.MARIST.EDU&k=pCpgOv%2FKLW5dYRss05kLEw%3D%3D%0A&r=tQq0J85k4w4CeO1cI0sWanGhPyb3Fq7EC6ctgNHLxNs%3D%0A&m=QJwU6pc4k02OIaQLlHzQMrXul8%2BYJojUNnuh%2Fs91wxo%3D%0A&s=a65decc3894f7c9fae1a61e6b2087a6511ffef0e590b9e0aa9b8acbbf7846978]
> On Behalf Of Tim Brown
> Sent: Tuesday, August 26, 2014 11:10 AM
> To: ADSM-L AT VM.MARIST DOT EDU
> Subject: Re: [ADSM-L] tsm archive log full, causes repeated backups
>
> 6.3.1
>
> Tim
>
> -----Original Message-----
> From: ADSM: Dist Stor Manager
> [https://urldefense.proofpoint.com/v1/url?u=http://mailto:ADSM-L%40VM.MARIST.EDU&k=pCpgOv%2FKLW5dYRss05kLEw%3D%3D%0A&r=tQq0J85k4w4CeO1cI0sWanGhPyb3Fq7EC6ctgNHLxNs%3D%0A&m=QJwU6pc4k02OIaQLlHzQMrXul8%2BYJojUNnuh%2Fs91wxo%3D%0A&s=a65decc3894f7c9fae1a61e6b2087a6511ffef0e590b9e0aa9b8acbbf7846978]
> On Behalf Of Prather, Wanda
> Sent: Tuesday, 26 August, 2014 10:42 AM
> To: ADSM-L AT VM.MARIST DOT EDU
> Subject: Re: [ADSM-L] tsm archive log full, causes repeated backups
>
> What version of TSM?
>
> -----Original Message-----
> From: ADSM: Dist Stor Manager
> [https://urldefense.proofpoint.com/v1/url?u=http://mailto:ADSM-L%40VM.MARIST.EDU&k=pCpgOv%2FKLW5dYRss05kLEw%3D%3D%0A&r=tQq0J85k4w4CeO1cI0sWanGhPyb3Fq7EC6ctgNHLxNs%3D%0A&m=WGFM1MwQYmdG60UDE8OSw1g%2BOcDaDhXYoMB5ty9btmc%3D%0A&s=e4b40d364f7ded807ac7a3b7e58fb1e895fe5c250d61f997bcea2b981110fbc6]
> On Behalf Of Tim Brown
> Sent: Tuesday, August 26, 2014 10:21 AM
> To: ADSM-L AT VM.MARIST DOT EDU
> Subject: [ADSM-L] tsm archive log full, causes repeated backups
>
> ANR0299I A full database backup will be started. The archive log space used
> is 99 % and the archive log space used threshold is 80 percent. (PROCESS:
> 23)
>
> This is continually happening, I have had this issue in the past but I don't
> recall the resolution.
> The prior backup that ran before that completed successfully.
>
> There are no sessions or processes running.
>
> Thanks,
>
> Tim Brown
>
>
> -----------------------------------------The information contained in this
> message is intended only for the personal and confidential use of the
> recipient(s) named above. If the reader of this message is not the intended
> recipient or an agent responsible for delivering it to the intended
> recipient, you are hereby notified that you have received this document in
> error and that any review, dissemination, distribution, or copying of this
> message is strictly prohibited. If you have received this communication in
> error, please notify us immediately, and delete the original message.
--
Met vriendelijke groeten/Kind Regards,
Remco Post
r.post AT plcs DOT nl
+31 6 248 21 622
|
