BackupPC-users

Re: [BackupPC-users] BPC 4 very slow

2016-01-17 20:47:59
Subject: Re: [BackupPC-users] BPC 4 very slow
From: Adam Goryachev <mailinglists AT websitemanagers.com DOT au>
To: backuppc-users AT lists.sourceforge DOT net
Date: Mon, 18 Jan 2016 12:46:00 +1100
On 17/01/16 05:53, Alexander Moisseev wrote:
> On 16.01.16 15:04, Gandalf Corvotempesta wrote:
>> I can't use v3 because i'm having servers with millions of file to be
>> transfered and v3 takes ages in "Building files list".
> You mentioned earlier you are trying to backup dovecot with Maildir. Do you 
> have considered to move from Maildir to mdbox? It will definitely help with 
> BackupPC and rsync performance. More over you will be able to use dovecot 
> tools (+ your own scripts) or dovecot replication feature instead of 
> rsync/BackupPC. It will increase performance dramatically.

I'm not sure of the exact numbers you are referring to (millions is 1 
million or 50 million?, also "ages" is 5 minutes or 5 hours). In any 
case, back in 2012, I did a full backup of one of my mail servers, and 
it was completed in 70 minutes, with approx 1.3 million files (that 
would have been with BPC v3). Equally, a more recent backup with v4 
shows it took 402 minutes (almost 7 hours) and the quickest (recent BPC 
v4) full backup took 146 minutes.

So, while generating the file list might take a long time with BPC v3, I 
don't think it should significantly change the overall backup time. I 
would expect my BPC server has gotten quicker over the years, as has the 
mail server. Variations are likely due to concurrent backups, and 
bandwidth limitations.

It would be interesting to hear an update of where you are at, and what 
has happened (either good or bad).

Regards,
Adam

-- 
Adam Goryachev Website Managers www.websitemanagers.com.au

------------------------------------------------------------------------------
Site24x7 APM Insight: Get Deep Visibility into Application Performance
APM + Mobile APM + RUM: Monitor 3 App instances at just $35/Month
Monitor end-to-end web transactions and take corrective actions now
Troubleshoot faster and improve end-user experience. Signup Now!
http://pubads.g.doubleclick.net/gampad/clk?id=267308311&iu=/4140
_______________________________________________
BackupPC-users mailing list
BackupPC-users AT lists.sourceforge DOT net
List:    https://lists.sourceforge.net/lists/listinfo/backuppc-users
Wiki:    http://backuppc.wiki.sourceforge.net
Project: http://backuppc.sourceforge.net/

<Prev in Thread] Current Thread [Next in Thread>