Re: [BackupPC-users] BackupPC

On 05/07/12 22:12, jonas wrote:
> Hello,
>
> recently we were forced to re-setup a large BackupPC-server with up to
> 150 clients and 5.0TB (12 disks in RAID10). This was several weeks ago.
>
> Unfortunately the server has problems keeping up with the backups since
> then. (see
> http://sourceforge.net/mailarchive/message.php?msg_id=29433950) Even
> after enabling rsync checksum caching and playing around with raising or
> lowering MaxBackups, MaxPendingCmds, the server doesn't scale as
> expected. And just for the record: before the re-setup, it managed the
> same amount of backups and the same hosts.
>
> Now while comparing BackupPC logs to another big BackupPC-server on our
> side, I recognized that BackupPC-Link takes ages for every backupped
> host on the new server, while it's incredibly fast on the other BackupPC
> server.
>
> Even for hosts with several 100GB of data, BackupPC_Link takes only few
> minutes on the old BackupPC server. On the new (re-setup) one, it takes
> several hours up to days for backupped hosts.
>
> Do you have any idea or suggestions why BackupPC_Link takes that long
> and how we can change it?
One thing this sounds like is that you moved the location for the backups, therefore instead of linking the files, every backup is actually a full copy (because the links fail to the pool/cpool). Check the backuppc log files and see if anything unusual is being logged.

Failing that, consider the things that have changed from the old server to the "re-setup server":
1) Hardware - hard drives, controller, amount of RAM, etc....
2) Filesystem or hard drive layout/configuration (ie, RAID level, layout, chunk size, ext3 compared to jfs, etc)
3) Double check (while the system is idle if possible) the performance of the server, disk speed, especially random read/write performance).
4) Consider that if all clients are configured at the same time, then all clients will start doing full backups on the same days, which will screw with performance. Try to manually run full backups on some clients to skew the timelines, so that full backups are spread across different days.

Hope something above helps or triggers some idea of the issue.

Regards,
Adam

--
Adam Goryachev
Website Managers
www.websitemanagers.com.au

------------------------------------------------------------------------------
Live Security Virtual Conference
Exclusive live event will cover all the ways today's security and 
threat landscape has changed and how IT managers can respond. Discussions 
will include endpoint security, mobile security and the latest in malware 
threats. http://www.accelacomm.com/jaw/sfrnl04242012/114/50122263/

_______________________________________________
BackupPC-users mailing list
BackupPC-users AT lists.sourceforge DOT net
List:    https://lists.sourceforge.net/lists/listinfo/backuppc-users
Wiki:    http://backuppc.wiki.sourceforge.net
Project: http://backuppc.sourceforge.net/

Re: [BackupPC-users] BackupPC_Link takes ages