Bacula-users

Re: [Bacula-users] Bacula + Postgres : copy batch problem

2010-08-09 16:26:13
Subject: Re: [Bacula-users] Bacula + Postgres : copy batch problem
From: Rory Campbell-Lange <rory AT campbell-lange DOT net>
To: Dan Langille <dan AT langille DOT org>
Date: Mon, 9 Aug 2010 21:23:58 +0100
On 04/08/10, Rory Campbell-Lange (rory AT campbell-lange DOT net) wrote:
> On 03/08/10, Dan Langille (dan AT langille DOT org) wrote:
> > On 8/3/2010 7:09 PM, Rory Campbell-Lange wrote:
> 
> > > Yes, a batch insert is faster than a specfic insert, but the latter
> > > should be done at the "written-to-tape" transaction time, and could be
> > > done asynchronously, but in a transaction.
> > 
> > So... don't use batch-insert.  Go the single insert approach.  I dare 
> > you.  ;)
> 
> Yes, I'm trying! I'm trying to do it properly by recompiling debian
> stable backports and I'm running into library dependancy problems.

Done. I've recompiled with batch inserts set to off.

I tested spooling to see how this would work although it isn't strictly
necessary for my situation (a single server with AoE and internal
storage and a locally attached tape drive). The backup started running
off disk at around 100MB/s and then spooling at around 100MB/s. The disk
copy slowed down dramatically over the weekend due to contention due to
some external MD5 audits and rsync processes.

I'm now going to play with non-spooled backups and some options such as
noatime.

  Build OS:               x86_64-pc-linux-gnu debian 5.0.5
  JobId:                  1
  Job:                    HAbkp.2010-08-06_15.46.23_03
  Backup Level:           Full
  Client:                 "clwbackup-fd" 5.0.2 (28Apr10) 
x86_64-pc-linux-gnu,debian,5.0.5
  FileSet:                "HAfileset" 2010-08-06 15:46:23
  Pool:                   "HAPool" (From Job resource)
  Catalog:                "MyCatalog" (From Client resource)
  Storage:                "CLW_LTO4" (From Job resource)
  Scheduled time:         06-Aug-2010 15:46:07
  Start time:             06-Aug-2010 15:46:25
  End time:               09-Aug-2010 18:23:16
  Elapsed time:           3 days 2 hours 36 mins 51 secs
  Priority:               10
  FD Files Written:       7,706,717
  SD Files Written:       7,706,717
  FD Bytes Written:       7,337,839,018,613 (7.337 TB)
  SD Bytes Written:       7,339,475,824,330 (7.339 TB)
  Rate:                   27317.7 KB/s
  Software Compression:   None
  VSS:                    no
  Encryption:             no
  Accurate:               no
  Volume name(s):         HA-01|HA-02|HA-03|HA-04|HA-05|HA-06|HA-07
  Volume Session Id:      1
  Volume Session Time:    1281090914
  Last Volume Bytes:      896,114,386,944 (896.1 GB)
  Non-fatal FD errors:    0
  SD Errors:              0
  FD termination status:  OK
  SD termination status:  OK
  Termination:            Backup OK


-- 
Rory Campbell-Lange
rory AT campbell-lange DOT net

------------------------------------------------------------------------------
This SF.net email is sponsored by 

Make an app they can't live without
Enter the BlackBerry Developer Challenge
http://p.sf.net/sfu/RIM-dev2dev 
_______________________________________________
Bacula-users mailing list
Bacula-users AT lists.sourceforge DOT net
https://lists.sourceforge.net/lists/listinfo/bacula-users