ADSM-L

AW: Expiration performance

2004-09-13 05:03:24
Subject: AW: Expiration performance
From: Stefan Holzwarth <stefan.holzwarth AT ADAC DOT DE>
To: ADSM-L AT VM.MARIST DOT EDU
Date: Mon, 13 Sep 2004 11:03:31 +0200
Hi, our current performance.

TSM 5.2.3.1 @ Z/OS 1.4 ~ 626 Mips
1 Gbyte Regionsize, Bufferpool 175.000 pages a 4K
34 Gbyte DB with 78% util  -  about 4.000.000 objets, 300.000 deleted each
day
11 Gbyte Log
1 TByte Primary Diskpool
All on heavily loaded EMC Symmetrix 5930 Raid 5 with SRDF sync
Tape 8 *  3590B and 4 * 3490(!)

ACTIVITY                     Date                Objects Examined Up/Hr
------------------     ----------     ---------------------------------
EXPIRATION             2004-08-01                                298800
EXPIRATION             2004-08-02                                478800
EXPIRATION             2004-08-03                                471600
EXPIRATION             2004-08-04                                212400
EXPIRATION             2004-08-05                                342000
EXPIRATION             2004-08-06                                500400
EXPIRATION             2004-08-08                                320400
EXPIRATION             2004-08-09                                547200
EXPIRATION             2004-08-10                                504000
EXPIRATION             2004-08-11                                486000
EXPIRATION             2004-08-12                                410400
EXPIRATION             2004-08-13                                550800
EXPIRATION             2004-08-15                                367200
EXPIRATION             2004-08-16                                529200
EXPIRATION             2004-08-17                                525600
EXPIRATION             2004-08-18                                428400
EXPIRATION             2004-08-19                                259200
EXPIRATION             2004-08-20                                115200
EXPIRATION             2004-08-20                                342000
EXPIRATION             2004-08-22                                363600
EXPIRATION             2004-08-23                                525600
EXPIRATION             2004-08-23                                597600
EXPIRATION             2004-08-24                                583200
EXPIRATION             2004-08-25                                514800
EXPIRATION             2004-08-26                                331200
EXPIRATION             2004-08-27                                356400
EXPIRATION             2004-08-29                                356400
EXPIRATION             2004-08-30                                547200
EXPIRATION             2004-08-31                                478800
EXPIRATION             2004-09-01                                262800
EXPIRATION             2004-09-02                                208800
EXPIRATION             2004-09-03                                482400
EXPIRATION             2004-09-05                                360000
EXPIRATION             2004-09-06                                597600

ACTIVITY                     Date                    Pages backed Up/Hr
------------------     ----------     ---------------------------------
FULL_DBBACKUP          2004-07-17                               4795200
FULL_DBBACKUP          2004-07-24                               5929200
FULL_DBBACKUP          2004-07-29                               1112400
FULL_DBBACKUP          2004-07-31                               7200000
FULL_DBBACKUP          2004-08-07                               5292000
FULL_DBBACKUP          2004-08-14                               4096800
FULL_DBBACKUP          2004-08-20                               1969200
FULL_DBBACKUP          2004-08-21                               4953600
FULL_DBBACKUP          2004-08-28                               6922800
FULL_DBBACKUP          2004-09-03                               5410800
FULL_DBBACKUP          2004-09-11                               7722000


Kind regards,
Stefan Holzwarth
----------------------------------------------------------------------------
--
ADAC e.V. (Informationsverarbeitung - Systemtechnik - Basisdienste)
Am Westpark 8, 81373 München, Tel.: (089) 7676-5212, Fax: (089) 76768924
mailto:stefan.holzwarth AT adac DOT de



-----Ursprüngliche Nachricht-----
Von: goc [mailto:goran.k AT VIP DOT HR] 
Gesendet: Montag, 13. September 2004 10:42
An: ADSM-L AT VM.MARIST DOT EDU
Betreff: Re: Expiration performance


ok, i have to shere mine ... look pretty messy ... LOL ... bu here you go
...
specs:
IBM p640 4GB RAM, 2 procs
db 24GB and 80% utilized is on SSA disks on 5 volumes ... RAID5 <- thats
important !

  Operation Results


ACTIVITY                     Date                     Pages backedUp/Hr
------------------     ----------     ---------------------------------
FULL_DBBACKUP          2004-08-14                              12888000
FULL_DBBACKUP          2004-08-14                              13060800
FULL_DBBACKUP          2004-08-14                               6843600
FULL_DBBACKUP          2004-08-15                              13975200
FULL_DBBACKUP          2004-08-15                               9097200
FULL_DBBACKUP          2004-08-15                               5904000
FULL_DBBACKUP          2004-08-16                              12528000
FULL_DBBACKUP          2004-08-16                              11394000
FULL_DBBACKUP          2004-08-16                               4485600
FULL_DBBACKUP          2004-08-17                              12844800
FULL_DBBACKUP          2004-08-17                              12974400
FULL_DBBACKUP          2004-08-17                               4111200
FULL_DBBACKUP          2004-08-18                              13276800
FULL_DBBACKUP          2004-08-18                              11556000
FULL_DBBACKUP          2004-08-18                               3733200
FULL_DBBACKUP          2004-08-19                               4471200
FULL_DBBACKUP          2004-08-19                               5292000
FULL_DBBACKUP          2004-08-19                               5684400
FULL_DBBACKUP          2004-08-20                              10285200
FULL_DBBACKUP          2004-08-20                               9129600
FULL_DBBACKUP          2004-08-20                               4302000
FULL_DBBACKUP          2004-08-21                               9867600
FULL_DBBACKUP          2004-08-21                              16203600
FULL_DBBACKUP          2004-08-21                               5162400
FULL_DBBACKUP          2004-08-22                              10173600
FULL_DBBACKUP          2004-08-22                               7729200
FULL_DBBACKUP          2004-08-22                               6066000
FULL_DBBACKUP          2004-08-23                              12758400
FULL_DBBACKUP          2004-08-23                              10018800
FULL_DBBACKUP          2004-08-23                               4392000
FULL_DBBACKUP          2004-08-24                              18010800
FULL_DBBACKUP          2004-08-24                              13150800
FULL_DBBACKUP          2004-08-24                               8251200
FULL_DBBACKUP          2004-08-25                              14040000
FULL_DBBACKUP          2004-08-25                              14749200
FULL_DBBACKUP          2004-08-25                               6728400
FULL_DBBACKUP          2004-08-26                              14328000
FULL_DBBACKUP          2004-08-26                              16524000
FULL_DBBACKUP          2004-08-26                               4770000
FULL_DBBACKUP          2004-08-27                               6843600
FULL_DBBACKUP          2004-08-27                              13064400
FULL_DBBACKUP          2004-08-27                               5770800
FULL_DBBACKUP          2004-08-28                              15130800
FULL_DBBACKUP          2004-08-28                              15890400
FULL_DBBACKUP          2004-08-28                              11192400
FULL_DBBACKUP          2004-08-29                              16322400
FULL_DBBACKUP          2004-08-29                              10188000
FULL_DBBACKUP          2004-08-29                               6501600
FULL_DBBACKUP          2004-08-30                              16596000
FULL_DBBACKUP          2004-08-30                              16214400
FULL_DBBACKUP          2004-08-30                               6271200
FULL_DBBACKUP          2004-08-31                              17420400
FULL_DBBACKUP          2004-08-31                              17805600
FULL_DBBACKUP          2004-08-31                               6019200
FULL_DBBACKUP          2004-09-01                              17740800
FULL_DBBACKUP          2004-09-01                              17269200
FULL_DBBACKUP          2004-09-01                               4363200
FULL_DBBACKUP          2004-09-02                              14731200
FULL_DBBACKUP          2004-09-02                              18230400
FULL_DBBACKUP          2004-09-02                               5428800
FULL_DBBACKUP          2004-09-03                               5932800
FULL_DBBACKUP          2004-09-03                               5475600
FULL_DBBACKUP          2004-09-03                               4777200
FULL_DBBACKUP          2004-09-04                              15170400
FULL_DBBACKUP          2004-09-04                              13554000
FULL_DBBACKUP          2004-09-04                               7092000
FULL_DBBACKUP          2004-09-05                              19126800
FULL_DBBACKUP          2004-09-05                              10393200
FULL_DBBACKUP          2004-09-05                               7308000
FULL_DBBACKUP          2004-09-06                              17560800
FULL_DBBACKUP          2004-09-06                              18241200
FULL_DBBACKUP          2004-09-06                               5562000
FULL_DBBACKUP          2004-09-07                              16038000
FULL_DBBACKUP          2004-09-07                              16729200
FULL_DBBACKUP          2004-09-07                               6141600
FULL_DBBACKUP          2004-09-08                               5112000
FULL_DBBACKUP          2004-09-08                               6087600
FULL_DBBACKUP          2004-09-08                               5803200
FULL_DBBACKUP          2004-09-09                               4960800
FULL_DBBACKUP          2004-09-09                               3974400
FULL_DBBACKUP          2004-09-09                               4507200
FULL_DBBACKUP          2004-09-10                               5763600
FULL_DBBACKUP          2004-09-10                               7210800
FULL_DBBACKUP          2004-09-10                               4939200
FULL_DBBACKUP          2004-09-11                              17272800
FULL_DBBACKUP          2004-09-11                              18478800
FULL_DBBACKUP          2004-09-11                               6818400
FULL_DBBACKUP          2004-09-12                              17272800
FULL_DBBACKUP          2004-09-12                              10764000
FULL_DBBACKUP          2004-09-12                               6206400
FULL_DBBACKUP          2004-09-13                              16628400
FULL_DBBACKUP          2004-09-13                              12564000
any comments ? thanks ...goran konjicaix and tsm admin----- Original
Message -----
From: "Michael Garnebode" <Michael.Garnebode AT T-SYSTEMS DOT COM>
To: <ADSM-L AT VM.MARIST DOT EDU>
Sent: Monday, September 13, 2004 10:01 AM
Subject: AW: Expiration performance


Hi,

i will share our values for expiration and dbbackup performance.
The comparison with Chistos values look like :-(

AIX 5.1
TSM-Server 5.1.9.3 (P630 , 4 GB Ram, 4 CPU)
TSM-DB 41 GB 67% Utilization on EMC-DMX 801
IBM 3584 with 10 LTO2

tsm: SWX00306>run db_backup_perf

ACTIVITY                     Date                    Pages backed Up/Hr
------------------     ----------     ---------------------------------
FULL_DBBACKUP          2004-09-06                               4896000
FULL_DBBACKUP          2004-09-06                               5965200
FULL_DBBACKUP          2004-09-07                               6667200
FULL_DBBACKUP          2004-09-07                               6490800
FULL_DBBACKUP          2004-09-08                               6004800
FULL_DBBACKUP          2004-09-08                               6609600
FULL_DBBACKUP          2004-09-09                               5886000
FULL_DBBACKUP          2004-09-09                               7081200
FULL_DBBACKUP          2004-09-09                               5644800
FULL_DBBACKUP          2004-09-09                               5569200
FULL_DBBACKUP          2004-09-10                               7462800
FULL_DBBACKUP          2004-09-10                               4885200
FULL_DBBACKUP          2004-09-11                               6534000
FULL_DBBACKUP          2004-09-11                               8168400
FULL_DBBACKUP          2004-09-11                               7196400
FULL_DBBACKUP          2004-09-11                               5486400
FULL_DBBACKUP          2004-09-12                               7153200
FULL_DBBACKUP          2004-09-12                               5378400
FULL_DBBACKUP          2004-09-12                               3402000
FULL_DBBACKUP          2004-09-13                               7628400
ANR1462I RUN: Command script DB_BACKUP_PERF completed successfully.

tsm: SWX00306>run expiration_perf

ACTIVITY                     Date                Objects Examined Up/Hr
------------------     ----------     ---------------------------------
EXPIRATION             2004-09-06                                277200
EXPIRATION             2004-09-07                                349200
EXPIRATION             2004-09-08                                 97200
EXPIRATION             2004-09-09                                334800
EXPIRATION             2004-09-10                                356400
EXPIRATION             2004-09-11                                338400
EXPIRATION             2004-09-12                                244800
ANR1462I RUN: Command script EXPIRATION_PERF completed successfully.

Regards

Michael Garnebode
Diplom-Informatiker
Systemberater

Schmitz RZ Consult
Gesellschaft f|r DV-Beratung und Projektmanagement mbH
Im Blumersfeld 22
50259 Pulheim
Tel.: +49 (0) 2238/922266
Fax:  +49 (0) 2238/922267
EMail: garnebode AT schmitz-rz-consult DOT de

-----Urspr|ngliche Nachricht-----
Von: ADSM: Dist Stor Manager [mailto:ADSM-L AT VM.MARIST DOT EDU] Im Auftrag von
Christo Heuer
Gesendet: Montag, 13. September 2004 09:13
An: ADSM-L AT VM.MARIST DOT EDU
Betreff: Re: Expiration performance


Hi Ben,

I agree with you on these points - ran Dave's script on our main TSM
server - and the Database backup performance is exceptionally good - the
slowest I'm seeing is  31000000:
FULL_DBBACKUP          2004-09-03                              62625600
FULL_DBBACKUP          2004-09-04                              56156400
FULL_DBBACKUP          2004-09-05                              59911200
FULL_DBBACKUP          2004-09-06                              51152400
FULL_DBBACKUP          2004-09-07                              57801600
FULL_DBBACKUP          2004-09-08                              60886800
FULL_DBBACKUP          2004-09-09                              52707600
FULL_DBBACKUP          2004-09-10                              59018400
FULL_DBBACKUP          2004-09-11                              57938400
FULL_DBBACKUP          2004-09-12                              58968000

The average seems to be in the region of 50000000 +, so from that point of
view it seems excellent - but the expiration sucks according to the script.

ACTIVITY                     Date                Objects Examined Up/Hr
------------------     ----------     ---------------------------------
EXPIRATION             2004-08-14                                856800
EXPIRATION             2004-08-14                                867600
EXPIRATION             2004-08-15                                864000
EXPIRATION             2004-08-17                                770400
EXPIRATION             2004-08-18                                669600
EXPIRATION             2004-08-19                                846000
EXPIRATION             2004-08-20                                734400

So, yes, it seems that Ymmv, but is there anyone out there getting good
performance from expiration? If there are people out there, don't you want
to share your environment with us - might be able to collectively cast some
light on the lower expiration figures.

For the record, my environment is as follows:
AIX 5.2
TSM 5.2.2.5
DB size 105Gig - 93% utilized - 13 Lun's (One over the recommendation). Disk
subsys - FastT900 File system - RLV Tape technology: 3584 with Lto-2 drives.
P650 (4 Processors and 4Gig Ram)

Regards
ChristoH

===================================================================
        Yes, interesting stats. On all my TSM servers, they get above 5M
pages for the DB backup, but none of them are above 3.8M objects on the
expire inventory. Some in the 2M, others only in the .5 M range.

        These random thoughts pointed at the group, not necessarily Joe.

        Since my db backups (sequential reads) go well, but the expire
inventory (random reads and writes) are slow, might that point to DB
fragmentation? Improper tuning of TSM buffers? Overcommittal of the
fast-write disk cache? Bad karma?

        One would think that the more files deleted during the expire
inventory, the longer it will take for the expire inventory to progress? No?
I can run 2 expire inventories in a row and the second one goes much much
quicker because there are very few changes to the DB to be made. It seems
like the performance on the "number of objects examined" is really one of
those "your mileage may vary" kind of stats.

        Perhaps I'm not getting the performance I should out of the
expiration...

Ben



______________________________________________________
Important Notice:

Important restrictions, qualifications and
disclaimers ("the Disclaimer") apply to this email.

To read this click on the following address:

http://www.absa.co.za/ABSA/EMail_Disclaimer

The Disclaimer forms part of the content of this
email in terms of section 11 of the Electronic
Communications and Transactions Act, 25 of 2002.

If you are unable to access the Disclaimer,
send a blank e-mail to disclaimer AT absa.co DOT za and we
will send you a copy of the Disclaimer.

<Prev in Thread] Current Thread [Next in Thread>