Networker

Re: [Networker] backup mail server very slow (linux)

2004-04-29 11:33:29
Subject: Re: [Networker] backup mail server very slow (linux)
From: Yura Pismerov <ypismerov AT TUCOWS DOT COM>
To: NETWORKER AT LISTMAIL.TEMPLE DOT EDU
Date: Thu, 29 Apr 2004 11:33:21 -0400
Maarten Boot (CWEU-USERS/CWNL) wrote:

Slow backups can also be caused by lots of very small files,

We have one accound used for compiling our product. It has hundereds of
thousanda of small c files and their objects files. Without any precaution my
backups dropped to kilobytes per second on that account only.



   Same here.

how is your data ?

Maarten


On Thursday 29 April 2004 14:43, you wrote:


Hi

There is a known bug in Solaris which only arise only under special
circumstances with using several sessions. We had a similar problem this
year on a very large site when only 1 client was running we got very good
speed of 30MB/s but when we increased the number of sessions the speed
instantly dropped to around 4MB/s. There is a patch in the works, it's easy
to verify though.

Does the server in question have the necessary HW to push data usually GB
interfaces eat 1 processor, but it shouldn't justify 100KB/s :-)

Uppgrading the NetWorker client though and to the latest kernel, that's
where I'd start.

Regards
Michael Persson

-----Original Message-----
From: David De Maeyer [mailto:ddm AT RUC DOT DK]
Sent: den 29 april 2004 14:26
To: NETWORKER AT LISTMAIL.TEMPLE DOT EDU
Subject: Re: [Networker] backup mail server very slow (linux)


RAID is one big partition and parallelism is on 4 for the client. I thought
increasing the parallelism on the client.

David

___________________________________________________
David De Maeyer
Roskilde University Center, Department of Computer Science
Box 260, Hus 42.1, 4000 Roskilde, Denmark
voice (+45) 46 74 38 29 / fax (+45) 46 74 30 72

On 29 Apr 2004, at 14:19, agascoyn wrote:


Hi David

How is your raid setup.

Is it one big partition or groups of smaller partitions.

Also what is your parellalism set to currently.

Andrew Gascoyne

Data Backup / Recovery Administrator

David De Maeyer wrote:


Hi all!

We are facing a performance issue when taking a full backup of our
mail server (>7000 users, 350 GB of data, running Debian linux).

The backup server has no problem with the other linux clients. It is
writing at around 100 KB/s... which is far from the 2 to 8 MB/s we
are used to have on the other clients.

It takes forever to backup all the user directories! And we simply
can't find where the bottleneck is... just that there are a lot of
I/O on the RAID on which these directories are stored.

Would it help to increase/decrease the parallelism for the client
and/or other clients (smaller filesystems)?

Does somebody on this mailing-list once faced a similar problem? Is
the upgrade of the client on the mail server a must?

Regards,
David

server: NetWorker 7.1.1 (running Solaris 8)
client: NetWorker 6.1.1 (running Debian linux, IMAP server, 350 GB on
external RAID)

___________________________________________________
David De Maeyer
Roskilde University Center, Department of Computer Science Box 260,
Hus 42.1, 4000 Roskilde, Denmark voice (+45) 46 74 38 29 / fax (+45)
46 74 30 72

--
Note: To sign off this list, send a "signoff networker" command via
email to listserv AT listmail.temple DOT edu or visit the list's Web site at
http://listmail.temple.edu/archives/networker.html where you can
also view and post messages to the list.
=*=*=*=*=*=*=*=*=*=*=*=*=*=*=*=*=*=*=*=*=*=*=*=*=*=*=*=*=*=*=*=


--
Andrew Gascoyne
Unix Administrator
European Southern Observatory
Karl-Schwarzschild-Strasse 2
D-85748 Garching bei Muenchen

Phone: +49 89 32006443
Fax  : +49 89 32006380
EMail: agascoyn AT eso DOT org


--
Note: To sign off this list, send a "signoff networker" command via email
to listserv AT listmail.temple DOT edu or visit the list's Web site at
http://listmail.temple.edu/archives/networker.html where you can
also view and post messages to the list.
=*=*=*=*=*=*=*=*=*=*=*=*=*=*=*=*=*=*=*=*=*=*=*=*=*=*=*=*=*=*=*=

--
Note: To sign off this list, send a "signoff networker" command via email
to listserv AT listmail.temple DOT edu or visit the list's Web site at
http://listmail.temple.edu/archives/networker.html where you can
also view and post messages to the list.
=*=*=*=*=*=*=*=*=*=*=*=*=*=*=*=*=*=*=*=*=*=*=*=*=*=*=*=*=*=*=*=



--
Note: To sign off this list, send a "signoff networker" command via email
to listserv AT listmail.temple DOT edu or visit the list's Web site at
http://listmail.temple.edu/archives/networker.html where you can
also view and post messages to the list.
=*=*=*=*=*=*=*=*=*=*=*=*=*=*=*=*=*=*=*=*=*=*=*=*=*=*=*=*=*=*=*=



--
Yuri Pismerov, Sr. System Administrator,
TUCOWS.COM INC. (416) 535-0123  ext. 1352

--
Note: To sign off this list, send a "signoff networker" command via email
to listserv AT listmail.temple DOT edu or visit the list's Web site at
http://listmail.temple.edu/archives/networker.html where you can
also view and post messages to the list.
=*=*=*=*=*=*=*=*=*=*=*=*=*=*=*=*=*=*=*=*=*=*=*=*=*=*=*=*=*=*=*=