On 16.01.16 22:16, Gandalf Corvotempesta wrote:
> 2016-01-16 19:53 GMT+01:00 Alexander Moisseev <moiseev AT mezonplus DOT ru>:
>> You mentioned earlier you are trying to backup dovecot with Maildir. Do you
>> have considered to move from Maildir to mdbox? It will definitely help with
>> BackupPC and rsync performance. More over you will be able to use dovecot
>> tools (+ your own scripts) or dovecot replication feature instead of
>> rsync/BackupPC. It will increase performance dramatically.
>
> mdbox is available since version 2. Some server are very old, with dovecot 1.
>
I don't think old hardware will be a problem for version 2.
I am using low end hardware for a small mail server (P4 2.80GHz, 2GB RAM,
gmirror of 2 SATA drives) and BackupPC server (P4 2.80GHz, 1.5GB RAM, SATA
drive) and 100 Mbps networking.
About 2 years ago I was using Maildir and BPC v3 (rsyncd with checksum caching).
Mail storage had about 100 thousands files.
The first two full backups was completed in about 4 hours each.
Subsequent full backups was taken about 30 minutes (if there is no concurrent
backups).
I never tried BPC v4 to backup Maildir.
Then I converted mail storage to mdbox + SIS (single instance attachment
storage) + compression. I never tried BPC with mdbox, I see no point, but I
believe file list building should be much quicker since file number is
significantly lower. I installed dovecot (mdbox + SIS + compression) on a test
machine with similar hardware configuration. Initial backup with "doveadm
backup" took about 1-3 hours, I don't remember exact time. Subsequent everyday
backups take about 1-2 minutes and don't depend on mail storage size or
messages number, but on changes made between backups.
Finally for the backup end I've installed dovecot (mdbox + SIS + compression)
on a server with ZFS. Now, in order to have retrospective, I'm taking snapshot
after each backup and using BackupPC-like aging.
And "zfs send" to make offline copies.
Hostname | Level | Size (MB) | Written (MB) | Used (MB) | Last available |
Days old
----------------------------------------------------------------------------------------
tank1/vmail | 0 | 27860.45 | 23650.66 | 2128.86 | 2015-07-11 07:51 |
191
tank1/vmail | 0 | 27804.61 | 2073.86 | 612.73 | 2015-08-12 07:51 |
159
tank1/vmail | 0 | 29287.60 | 2227.53 | 686.91 | 2015-09-13 07:51 |
127
tank1/vmail | 0 | 30896.84 | 2488.86 | 601.22 | 2015-10-15 07:51 |
95
tank1/vmail | 0 | 35778.12 | 6177.88 | 1852.94 | 2015-11-16 07:51 |
63
tank1/vmail | 0 | 37257.94 | 4151.30 | 443.62 | 2015-12-18 07:51 |
31
tank1/vmail | 0 | 37257.47 | 519.09 | 186.52 | 2015-12-22 07:51 |
27
tank1/vmail | 0 | 37273.77 | 545.84 | 191.96 | 2015-12-26 07:51 |
23
tank1/vmail | 0 | 37564.53 | 686.51 | 165.02 | 2015-12-30 07:51 |
19
tank1/vmail | 0 | 37533.15 | 415.20 | 129.96 | 2016-01-03 07:51 |
15
tank1/vmail | 0 | 37454.53 | 220.35 | 99.68 | 2016-01-07 07:51 |
11
tank1/vmail | 0 | 37419.07 | 170.54 | 107.71 | 2016-01-11 07:51 |
7
tank1/vmail | 0 | 37520.83 | 317.79 | 112.94 | 2016-01-12 07:51 |
6
tank1/vmail | 0 | 37633.12 | 328.19 | 113.92 | 2016-01-13 07:51 |
5
tank1/vmail | 0 | 37792.96 | 345.29 | 83.54 | 2016-01-14 07:51 |
4
tank1/vmail | 0 | 37961.14 | 302.97 | 61.54 | 2016-01-15 07:51 |
3
tank1/vmail | 0 | 38045.83 | 178.00 | 12.08 | 2016-01-16 07:51 |
2
tank1/vmail | 0 | 38060.19 | 31.03 | 15.53 | 2016-01-17 07:51 |
1
tank1/vmail | 0 | 38029.69 | 38.44 | 0.00 | 2016-01-18 07:51 |
0
tank1/vmail | - | 38029.69 | 0.00 | 32687.01 | - |
-
NAME PROPERTY VALUE
tank1/vmail used 43.8G
tank1/vmail logicalused 51.1G
Actual total size of mail stored on the mailserver (prior SIS and compression)
62GB, 170 thousands of messages.
I know it is a very small server, but you can extrapolate the results.
------------------------------------------------------------------------------
Site24x7 APM Insight: Get Deep Visibility into Application Performance
APM + Mobile APM + RUM: Monitor 3 App instances at just $35/Month
Monitor end-to-end web transactions and take corrective actions now
Troubleshoot faster and improve end-user experience. Signup Now!
http://pubads.g.doubleclick.net/gampad/clk?id=267308311&iu=/4140
_______________________________________________
BackupPC-users mailing list
BackupPC-users AT lists.sourceforge DOT net
List: https://lists.sourceforge.net/lists/listinfo/backuppc-users
Wiki: http://backuppc.wiki.sourceforge.net
Project: http://backuppc.sourceforge.net/
|
