BackupPC-users

Re: [BackupPC-users] Incremental backup takes all files

2009-06-14 13:13:10
Subject: Re: [BackupPC-users] Incremental backup takes all files
From: Adam Goryachev <mailinglists AT websitemanagers.com DOT au>
To: "General list for user discussion, questions and support" <backuppc-users AT lists.sourceforge DOT net>
Date: Mon, 15 Jun 2009 03:09:13 +1000
-----BEGIN PGP SIGNED MESSAGE-----
Hash: SHA1

Matthias Meyer wrote:
> Erik Hjertén wrote:
> 
>> Matthias Meyer skrev:
>>> I make a full backup each 7 days and use $Conf{IncrLevels}  = [1, 2, 3,
>>> 4, 5, 6];
>>> So the first incremental save all files changed since last full. All
>>> following incrementals will save changed files since last incremental
>>> backup.
>>> The famous backuppc GUI will fill each incremental backup with the files
>>> not backuped since last full (sorry for my bad english;-). So each
>>> incremental appears in the GUI like a full backup.
>>>   
>> Sounds like a good plan. I'll read up the IncrLevel this evening. That
>> and a glass of single malt will do the trick ;-) Thanks for your help.

I've been battling with a similar problem over the past week. Previously
this host was being backed up without any problem (over a 256k DSL
connection). Here is a small extract from the currently running backup:

hcn/ManageEzy/HCNSample/Config/MD.xqr got digests
31cb9b6de8cd720f6c0c062b02bdf912 vs 31cb9b6de8cd720f6c0c062b02bdf912
  pool     644    18/544       14630 hcn/ManageEzy/HCNSample/Config/MD.xqr
  create d 755    18/544           0 hcn/ManageEzy/HCNSample/Document
hcn/ManageEzy/HCNSample/HCNSample.udl got digests
13d0a8a8f3ef7427557909f0a5be5e46 vs 13d0a8a8f3ef7427557909f0a5be5e46
  pool     644    18/544         438 hcn/ManageEzy/HCNSample/HCNSample.udl
  create d 755    18/544           0 hcn/ManageEzy/HCNSample/Ole
  create d 755    18/544           0 hcn/ManageEzy/HCNSample/Q
hcn/ManageEzy/MPServer.exe got digests d92db23ea596ca16d358f008dfe48e8c
vs d92db23ea596ca16d358f008dfe48e8c
  pool     755    18/544       45056 hcn/ManageEzy/MPServer.exe
hcn/ManageEzy/MPStandaloneViewer.exe got digests
f7cbbc96386466159f6276f7ead8f266 vs f7cbbc96386466159f6276f7ead8f266
  pool     755    18/544       36864 hcn/ManageEzy/MPStandaloneViewer.exe
hcn/ManageEzy/Maadmin.dtl got digests 67f0b1d97350f118f2a392a373db0b57
vs 67f0b1d97350f118f2a392a373db0b57
  pool     644    18/544      249856 hcn/ManageEzy/Maadmin.dtl
hcn/ManageEzy/Maadmin.udl got digests 06582c25ced17c692473d6213ae67fb6
vs 06582c25ced17c692473d6213ae67fb6
  pool     644    18/544         402 hcn/ManageEzy/Maadmin.udl
hcn/ManageEzy/ManageEzyInstallHelper.dll got digests
e72d04b34c7cb00e2e41e11c77e667c8 vs e72d04b34c7cb00e2e41e11c77e667c8
  pool     755    18/544       73728
hcn/ManageEzy/ManageEzyInstallHelper.dll

There is pretty much a zero chance that these files were
modified/changed permissions/etc since the previous successful backup.

I had IncrLevels = [1,2] with a full backup followed by two
incrementals, and then another full backup... etc.

I've just modified this to IncrLevel = [1,2,3,4,5,6,7,8,9] so if the
current backup fails, I'll see what happens on the next one. However,
unless backuppc was to ignore all previous backups of this host, then it
shouldn't need to re-transfer these files.

I have an SSH tunnel which is setup by the pre-backup between backuppc
host and a Linux PC on the same LAN as the destination. I then use
rsyncd backup over the SSH tunnel to the remote windows PC.

Interestingly... here is the end of the previous incremental backup of
this host (with a lower log level since I wasn't having problems back
then). Note the backup is running normally, until the error, and then it
assumes the remaining files and directories were deleted from the remote
host!

pool     644    18/544       70751 Program Files/eScan/Vista/AVCBack/fa._vc
  pool     644    18/544      160661 Program
Files/eScan/Vista/AVCBack/fa001._vc
  pool     644    18/544       25007 Program
Files/eScan/Vista/AVCBack/unp021._vc
  pool     644    18/544       49358 Program
Files/eScan/Vista/AVCBack/unp037._vc
  pool     644    18/544       53801 Program
Files/eScan/Vista/AVCBack/unp043._vc
  create d 755    18/544           0 Program Files/eScan/W2k
  create d 755    18/544           0 Program Files/eScan/WORK
  create d 755    18/544           0 Program Files/eScan/Warns
  create   644    18/544      114246 Program Files/eScan/avp.klb
  same     644    18/544       16603 Program Files/eScan/avp.set
  same     644    18/544       16603 Program Files/eScan/avp_ext.set
  same     644    18/544       16603 Program Files/eScan/avp_x.set
  create   644    18/544       48415 Program Files/eScan/base851c.avc
  create   644    18/544        1555 Program Files/eScan/daily-ec.avc
  create   644    18/544       26650 Program Files/eScan/dailyc.avc
  create   644    18/544       24263 Program Files/eScan/filelist.lst
Read EOF:
Tried again: got 0 bytes
finish: removing in-process file Program Files/eScan/sfdb.dat
  delete   644    18/544         815 Program Files/eScan/virwarn.rec
  delete   755    18/544      481792 Program Files/eScan/wgwin.exe
  delete   644    18/544         318 Program Files/eScan/uninstall.ico
  delete   644    18/544      794530 Program Files/eScan/updll6.dlz
  delete   644    18/544       52399 Program Files/eScan/unp011.avc
  delete   644    18/544        6636 Program Files/eScan/special.txt
  delete   644    18/544       48732 Program Files/eScan/unp009.avc
  delete   644    18/544       32843 Program Files/eScan/unp030.avc
  delete   644    18/544        2934 Program Files/eScan/unp999.avc
  delete   644    18/544       36305 Program Files/eScan/unp020.avc
  delete   644    18/544      275608 Program Files/eScan/sfdb.dat
  delete   755    18/544        8464 Program Files/eScan/sporder.dll
  delete   644    18/544       44546 Program Files/eScan/unp033.avc
  delete   644    18/544       14700 Program Files/eScan/trayicoc.lan
  delete   755    18/544       43520 Program Files/eScan/unregx.exe
  delete   644    18/544       25580 Program Files/eScan/unp031.avc
  delete   644    18/544       55546 Program Files/eScan/unp041.avc
  delete   644    18/544      896181 Program Files/eScan/spydb.OLD
  delete   644    18/544       31761 Program Files/eScan/unp032.avc
  delete   644    18/544      388401 Program Files/eScan/updll5.dlz
  delete   644    18/544       17005 Program Files/eScan/tree.lan
  delete   644    18/544       57165 Program Files/eScan/unp008.avc
  delete   644    18/544       37268 Program Files/eScan/unp022.avc
  delete   644    18/544        1383 Program Files/eScan/update.txt
  delete   644    18/544       33367 Program Files/eScan/unp042.avc
  delete   644    18/544       40726 Program Files/eScan/unp012.avc
  delete   755    18/544       28778 Program Files/eScan/zip.ppl
  delete   755    18/544       54272 Program Files/eScan/sfx.exe
  delete   644    18/544       64066 Program Files/eScan/unp010.avc
  delete   644    18/544       58762 Program Files/eScan/unp019.avc
  delete   644    18/544       50301 Program Files/eScan/unp027.avc
  delete   644    18/544      414456 Program Files/eScan/splash.bmp
  delete   644    18/544         721 Program Files/eScan/tips.txt
  delete   644    18/544       14989 Program Files/eScan/unp029.avc
  delete   755    18/544        4205 Program Files/eScan/stored.ppl
  delete   644    18/544       49088 Program Files/eScan/unp001.avc
  delete   644    18/544           5 Program Files/eScan/trayico.lck
  delete   755    18/544      147456 Program Files/eScan/test2.exe
  delete   644    18/544      414456 Program Files/eScan/splash2.bmp
  delete   644    18/544       75678 Program Files/eScan/unp007.avc
  delete   644    18/544        9216 Program Files/eScan/virus.avi
  delete   644    18/544       71379 Program Files/eScan/unp035.avc
  delete   644    18/544       49358 Program Files/eScan/unp037.avc
  delete   644    18/544        1834 Program Files/eScan/viewtcp.lan
  delete   644    18/544       88053 Program Files/eScan/unp002.avc
  delete   644    18/544          23 Program Files/eScan/update.adm
  delete   644    18/544       40986 Program Files/eScan/unp036.avc
  delete   644    18/544       64362 Program Files/eScan/unp015.avc
  delete   644    18/544         494 Program Files/eScan/swnames.txt
  delete   644    18/544       24556 Program Files/eScan/unp004.avc
  delete   644    18/544       75629 Program Files/eScan/unp016.avc
  delete   644    18/544       64369 Program Files/eScan/updll7.dlz
  delete   644    18/544       35145 Program Files/eScan/unp018.avc
  delete   644    18/544          20 Program Files/eScan/version.ini
  delete   755    18/544       89088 Program Files/eScan/trayeser.exe
  delete   755    18/544     1001478 Program Files/eScan/unins000.exe
  delete   755    18/544        4207 Program Files/eScan/zcompare.ppl
  delete   644    18/544       39617 Program Files/eScan/unp026.avc
  delete   755    18/544       90112 Program Files/eScan/traysser.exe
  delete   755    18/544       90112 Program Files/eScan/traycser.exe
  delete   644    18/544        3732 Program Files/eScan/testes.rtf
  delete   644    18/544       25007 Program Files/eScan/unp021.avc
  delete   755    18/544      816640 Program Files/eScan/trayicos.exe
  delete   644    18/544       45839 Program Files/eScan/unp039.avc
  delete   644    18/544      510185 Program Files/eScan/updll4.dlz
  delete   644    18/544       54419 Program Files/eScan/unp005.avc
  delete   644    18/544         799 Program Files/eScan/virwarn.snd
  delete   644    18/544       13705 Program Files/eScan/unp024.avc
  delete   644    18/544      910562 Program Files/eScan/spydb.avs
  delete   644    18/544       13424 Program Files/eScan/unp028.avc
  delete   644    18/544        7306 Program Files/eScan/smart.avc
  delete   755    18/544        8192 Program Files/eScan/sporder.exe
  delete   644    18/544       77879 Program Files/eScan/unins000.dat
  delete   644    18/544      508852 Program Files/eScan/updll2.dlz
  delete   644    18/544         797 Program Files/eScan/virwarn.adm
  delete   644    18/544       55434 Program Files/eScan/unp023.avc
  delete d 755    18/544           0 Program Files/eScan/vista32
  delete   644    18/544       53801 Program Files/eScan/unp043.avc
  delete   644    18/544       56179 Program Files/eScan/unp034.avc
  delete   644    18/544       59183 Program Files/eScan/unp003.avc
  delete   644    18/544       35735 Program Files/eScan/unp025.avc
  delete   644    18/544       16438 Program Files/eScan/toolbmp.bmp
  delete   644    18/544        3392 Program Files/eScan/up.avs
  delete   644    18/544       62530 Program Files/eScan/unp013.avc
  delete   644    18/544         167 Program Files/eScan/wgwin.ini
  delete   644    18/544       53345 Program Files/eScan/unp017.avc
  delete   644    18/544       17063 Program Files/eScan/trayicos.lan
  delete   644    18/544       54555 Program Files/eScan/unp006.avc
  delete   644    18/544       52888 Program Files/eScan/unp040.avc
  delete   644    18/544         139 Program Files/eScan/verinfo.ini
  delete   644    18/544           0 Program Files/eScan/success.sem
  delete   644    18/544       27469 Program Files/eScan/unp000.avc
  delete   644    18/544       51235 Program Files/eScan/unp038.avc
  delete   644    18/544       57928 Program Files/eScan/unp014.avc
  delete d 755    18/544           0 System Volume Information
  delete   644    18/544         211 boot.ini
  delete   444    18/544      297072 ntldr
  delete d 755    18/544           0 RECYCLER
  delete d 755    18/544           0 hcn
  delete d 755    18/544           0 rsyncd
  delete d 755    18/544           0 myob12
  delete d 755    18/544           0 TEMP
  delete d 755    18/544           0 var
  delete d 755    18/544           0 TempData
  delete   644    18/544         208 bootini.ins
  delete d 755    18/544           0 wmpub
  delete d 755    18/544           0 WINDOWS
  delete d 755    18/544           0 cygwin
  delete   644    18/544         248 back.cmd
  delete d 755    18/544           0 TempEI4
  delete   644    18/544         522 RHDSetup.log
Child is aborting
Done: 75 files, 4335673777 bytes
Executing DumpPostUserCmd: /usr/bin/pkill -u backuppc -f onetunnel


So, I guess this is why the following full backup is attempting to
re-transfer all of the files/directories after the "error"... So, the
million dollar question, why did backuppc see/log the error, and then
continue with marking the rest of the entries deleted, and mark the
backup successfully completed?

Regards,
Adam
-----BEGIN PGP SIGNATURE-----
Version: GnuPG v1.4.9 (GNU/Linux)
Comment: Using GnuPG with Mozilla - http://enigmail.mozdev.org

iEYEARECAAYFAko1LrAACgkQGyoxogrTyiWuAwCdHNtE4HL5+Pc76NOPsFBqrn8u
isoAoKrbbGMtuovFAoHkUs3BwqNv0A9z
=MKpq
-----END PGP SIGNATURE-----

------------------------------------------------------------------------------
Crystal Reports - New Free Runtime and 30 Day Trial
Check out the new simplified licensing option that enables unlimited
royalty-free distribution of the report engine for externally facing 
server and web deployment.
http://p.sf.net/sfu/businessobjects
_______________________________________________
BackupPC-users mailing list
BackupPC-users AT lists.sourceforge DOT net
List:    https://lists.sourceforge.net/lists/listinfo/backuppc-users
Wiki:    http://backuppc.wiki.sourceforge.net
Project: http://backuppc.sourceforge.net/