Amanda-Users

Re: Prefere a dump from the disklist and do several dumpes to holding disk?

2006-09-11 13:20:28
Subject: Re: Prefere a dump from the disklist and do several dumpes to holding disk?
From: Dominik Schips <mail-lists AT s235 DOT de>
To: amanda-users AT amanda DOT org
Date: Mon, 11 Sep 2006 19:14:45 +0200
Hello all,

thank you Joshua, Cyrille and Jon for your very good and fast replies.
With this information I can have a closer look why everythink is so slow.
I'll send a message again if I tried some of your advices.


I try the dumporder as Joshua mentioned and the taperalgo that I found at
http://wiki.zmanda.com/index.php/Amanda.conf now.

My aim is to get all the DLEs fast to the holding disk and then I have enough 
time to write them to tape. :)
I think the dumporder and/or taperalgo are very usefull for me.

On Monday 11 September 2006 17:52, you wrote:
> On Mon, 11 Sep 2006 at 11:41am, Jon LaBadie wrote
>
> > On Mon, Sep 11, 2006 at 11:28:29AM -0400, Joshua Baker-LePain wrote:
> >> On Mon, 11 Sep 2006 at 11:23am, Jon LaBadie wrote
> >>
> >>>> That tape write rate is too slow.  Native speed for an LTO3 drive is
> >>>> rated at ~80MB/s.
> >>>
> >>> I think it is really an LTO2.
> >>> The OP said 400GB, but was probably referring to marketing capacity.
> >>
> >> Well that makes sense.  Even in that case, though, 30MB/s is still too
> >> slow, especially given that he's using hardware compression.
> >
> > Really, my tapechart (from Fuji), says Ultrium 2 is 30MB/s for HP drive
> > and 35 for an IBM drive.
>
> *sigh*  That's what I get for not checking the specs.  I recalled
> (incorrectly) that LTO had been scaling speed with capacity the whole
> time.  You're right -- rated native speed for LTO2 is 30MB/s.

As you mentioned that a LTO2 drive only can do about 30MB/s I'll have a closer 
look at the used drive tomorrow . But I think you are right that this should 
be a LTO2 (HP Ultrium2) drive and not a LTO3 drive.

I also have a look at my tapetype enties and send them to the list. Maybe they 
are totally bad.

> > I also suspect his data is already pretty random, possibly compressed
> > by whatever moved it to his server.  Note only 200GB of amanda data
> > filled the tape.

The files are whole server data from /etc, /usr, /var, ... with all of the 
small files who can be found on a normal linux server.
Not the best to dump to tape direct so I thought to use the holding disk 
first.

> Well, a bit more, but not enough to really affect the speed.
>
> So it looks like the problem really is dumping to holding disk, which
> shouldn't be necessary if this is all on the same server.

For your information.
The holding disk is on another harddisk as the data harddisk to back up. So 
the holding disk dumps are from a RAID5 (S-ATA) were the backup files are to 
another harddisk.
I have to check them with bonnie for their speed.


I tested the backup without holding disk since a few days but the speed is 
slower than with the holding disk. I only save the time for the dumps.

I have to check about I/O problems.
The RAID5 device and the tape device use their own SCSI controller but I 
should check the settings again.

Here are some statistics without holding disk:

STATISTICS:
                          Total       Full      Daily
                        --------   --------   --------
Estimate Time (hrs:min)    0:39
Run Time (hrs:min)        10:27
Dump Time (hrs:min)        8:19       8:19       0:00
Output Size (meg)      375747.5   375747.5        0.0
Original Size (meg)    375747.5   375747.5        0.0
Avg Compressed Size (%)     --         --         -- 
Filesystems Dumped           12         12          0
Avg Dump Rate (k/s)     12863.4    12863.4        -- 

Tape Time (hrs:min)        8:19       8:19       0:00
Tape Size (meg)        375747.5   375747.5        0.0
Tape Used (%)             194.7      194.7        0.0
Filesystems Taped            12         12          0
Avg Tp Write Rate (k/s) 12861.5    12861.5        --


And here with the holding disk:

STATISTICS:
                          Total       Full      Daily
                        --------   --------   --------
Estimate Time (hrs:min)    0:37
Run Time (hrs:min)        11:41
Dump Time (hrs:min)        7:46       7:46       0:00
Output Size (meg)      370976.6   370976.6        0.0
Original Size (meg)    370976.6   370976.6        0.0
Avg Compressed Size (%)     --         --         -- 
Filesystems Dumped           12         12          0
Avg Dump Rate (k/s)     13578.8    13578.8        -- 

Tape Time (hrs:min)        3:31       3:31       0:00
Tape Size (meg)        370976.6   370976.6        0.0
Tape Used (%)             192.2      192.2        0.0
Filesystems Taped            12         12          0
Avg Tp Write Rate (k/s) 30008.7    30008.7        --



Best regards

Dominik