Networker

Re: [Networker] backup mail server very slow (linux)

2004-04-29 08:55:12
Subject: Re: [Networker] backup mail server very slow (linux)
From: "Maarten Boot (CWEU-USERS/CWNL)" <Maarten.Boot AT NL.COMPUWARE DOT COM>
To: NETWORKER AT LISTMAIL.TEMPLE DOT EDU
Date: Thu, 29 Apr 2004 14:54:08 +0200
Slow backups can also be caused by lots of very small files,

We have one accound used for compiling our product. It has hundereds of
thousanda of small c files and their objects files. Without any precaution my
backups dropped to kilobytes per second on that account only.

how is your data ?

Maarten


On Thursday 29 April 2004 14:43, you wrote:
> Hi
>
> There is a known bug in Solaris which only arise only under special
> circumstances with using several sessions. We had a similar problem this
> year on a very large site when only 1 client was running we got very good
> speed of 30MB/s but when we increased the number of sessions the speed
> instantly dropped to around 4MB/s. There is a patch in the works, it's easy
> to verify though.
>
> Does the server in question have the necessary HW to push data usually GB
> interfaces eat 1 processor, but it shouldn't justify 100KB/s :-)
>
> Uppgrading the NetWorker client though and to the latest kernel, that's
> where I'd start.
>
> Regards
> Michael Persson
>
> -----Original Message-----
> From: David De Maeyer [mailto:ddm AT RUC DOT DK]
> Sent: den 29 april 2004 14:26
> To: NETWORKER AT LISTMAIL.TEMPLE DOT EDU
> Subject: Re: [Networker] backup mail server very slow (linux)
>
>
> RAID is one big partition and parallelism is on 4 for the client. I thought
> increasing the parallelism on the client.
>
> David
>
> ___________________________________________________
> David De Maeyer
> Roskilde University Center, Department of Computer Science
> Box 260, Hus 42.1, 4000 Roskilde, Denmark
> voice (+45) 46 74 38 29 / fax (+45) 46 74 30 72
>
> On 29 Apr 2004, at 14:19, agascoyn wrote:
> > Hi David
> >
> > How is your raid setup.
> >
> > Is it one big partition or groups of smaller partitions.
> >
> > Also what is your parellalism set to currently.
> >
> > Andrew Gascoyne
> >
> > Data Backup / Recovery Administrator
> >
> > David De Maeyer wrote:
> >> Hi all!
> >>
> >> We are facing a performance issue when taking a full backup of our
> >> mail server (>7000 users, 350 GB of data, running Debian linux).
> >>
> >> The backup server has no problem with the other linux clients. It is
> >> writing at around 100 KB/s... which is far from the 2 to 8 MB/s we
> >> are used to have on the other clients.
> >>
> >> It takes forever to backup all the user directories! And we simply
> >> can't find where the bottleneck is... just that there are a lot of
> >> I/O on the RAID on which these directories are stored.
> >>
> >> Would it help to increase/decrease the parallelism for the client
> >> and/or other clients (smaller filesystems)?
> >>
> >> Does somebody on this mailing-list once faced a similar problem? Is
> >> the upgrade of the client on the mail server a must?
> >>
> >> Regards,
> >> David
> >>
> >> server: NetWorker 7.1.1 (running Solaris 8)
> >> client: NetWorker 6.1.1 (running Debian linux, IMAP server, 350 GB on
> >> external RAID)
> >>
> >> ___________________________________________________
> >> David De Maeyer
> >> Roskilde University Center, Department of Computer Science Box 260,
> >> Hus 42.1, 4000 Roskilde, Denmark voice (+45) 46 74 38 29 / fax (+45)
> >> 46 74 30 72
> >>
> >> --
> >> Note: To sign off this list, send a "signoff networker" command via
> >> email to listserv AT listmail.temple DOT edu or visit the list's Web site 
> >> at
> >> http://listmail.temple.edu/archives/networker.html where you can
> >> also view and post messages to the list.
> >> =*=*=*=*=*=*=*=*=*=*=*=*=*=*=*=*=*=*=*=*=*=*=*=*=*=*=*=*=*=*=*=
> >
> > --
> > Andrew Gascoyne
> > Unix Administrator
> > European Southern Observatory
> > Karl-Schwarzschild-Strasse 2
> > D-85748 Garching bei Muenchen
> >
> > Phone: +49 89 32006443
> > Fax  : +49 89 32006380
> > EMail: agascoyn AT eso DOT org
>
> --
> Note: To sign off this list, send a "signoff networker" command via email
> to listserv AT listmail.temple DOT edu or visit the list's Web site at
> http://listmail.temple.edu/archives/networker.html where you can
> also view and post messages to the list.
> =*=*=*=*=*=*=*=*=*=*=*=*=*=*=*=*=*=*=*=*=*=*=*=*=*=*=*=*=*=*=*=
>
> --
> Note: To sign off this list, send a "signoff networker" command via email
> to listserv AT listmail.temple DOT edu or visit the list's Web site at
> http://listmail.temple.edu/archives/networker.html where you can
> also view and post messages to the list.
> =*=*=*=*=*=*=*=*=*=*=*=*=*=*=*=*=*=*=*=*=*=*=*=*=*=*=*=*=*=*=*=

--
Note: To sign off this list, send a "signoff networker" command via email
to listserv AT listmail.temple DOT edu or visit the list's Web site at
http://listmail.temple.edu/archives/networker.html where you can
also view and post messages to the list.
=*=*=*=*=*=*=*=*=*=*=*=*=*=*=*=*=*=*=*=*=*=*=*=*=*=*=*=*=*=*=*=