Bacula-users

Re: [Bacula-users] Backup of many many files

2008-09-02 21:02:15
Subject: Re: [Bacula-users] Backup of many many files
From: Michael Galloway <mgx AT ornl DOT gov>
To: Daniel Betz <dbetz AT df DOT eu>
Date: Tue, 02 Sep 2008 21:02:04 -0400
On Tue, Sep 02, 2008 at 07:13:51AM -0400, Michael Galloway wrote:
> 
> i'm going to jump into the middle of this thread as this is currrently my
> biggest issue with bacula. my 'problematic' filesyste is this:
> 
> | 1,249 | birch         | 2008-07-27 00:25:05 | B    | F     | 16,060,382 | 
> 1,090,359,097,266 | T         |
> 
> 16M files at just about 1.1TB. it currently takes me days go get this backup 
> up via nfs mount to
> a DLT-4 tape drive. the filesystem is on a Netapp, mounted via nfs with the 
> netapp recommened nfs
> options, 1000Mb/s network. here is the summary from the last full backup:
> 
>   Build OS:               x86_64-unknown-linux-gnu redhat
>   JobId:                  1414
>   Job:                    birch.2008-08-24_00.05.44
>   Backup Level:           Full
>   Client:                 "molbio-fd" 2.2.6 (10Nov07) 
> x86_64-unknown-linux-gnu,redhat,
>   FileSet:                "Birch Set" 2007-12-22 09:56:56
>   Pool:                   "Full" (From Run pool override)
>   Storage:                "LTO4" (From Job resource)
>   Scheduled time:         24-Aug-2008 00:05:00
>   Start time:             25-Aug-2008 11:32:24
>   End time:               29-Aug-2008 12:45:00
>   Elapsed time:           4 days 1 hour 12 mins 36 secs
>   Priority:               10
>   FD Files Written:       16,236,207
>   SD Files Written:       16,236,207
>   FD Bytes Written:       1,095,742,761,452 (1.095 TB)
>   SD Bytes Written:       1,098,729,651,969 (1.098 TB)
>   Rate:                   3131.1 KB/s
>   Software Compression:   None
>   VSS:                    no
>   Encryption:             no
>   Volume name(s):         020745L4|020746L4
>   Volume Session Id:      135
>   Volume Session Time:    1217593761
>   Last Volume Bytes:      739,811,100,672 (739.8 GB)
>   Non-fatal FD errors:    0
>   SD Errors:              0
>   FD termination status:  OK
>   SD termination status:  OK
>   Termination:            Backup OK
> 
> i'm using bacula 2.2.6, postgres 8.2.5, spooling of data and attributes. 
>

for comparison, here is another backup of a different netapp, same nfs 
parameters, more disk
space involved, but much less files:

  Build OS:               x86_64-unknown-linux-gnu redhat
  JobId:                  1464
  Job:                    bioinfo.2008-09-02_01.05.15
  Backup Level:           Incremental, since=2008-08-23 17:15:42
  Client:                 "bioinfo-fd" 2.2.6 (10Nov07) 
x86_64-unknown-linux-gnu,redhat,
  FileSet:                "Bioinfo Set" 2007-12-10 08:57:04
  Pool:                   "Inc" (From Run pool override)
  Storage:                "LTO4" (From Job resource)
  Scheduled time:         02-Sep-2008 01:05:00
  Start time:             02-Sep-2008 04:16:08
  End time:               02-Sep-2008 18:15:49
  Elapsed time:           13 hours 59 mins 41 secs
  Priority:               10
  FD Files Written:       485,955
  SD Files Written:       485,955
  FD Bytes Written:       1,591,936,914,339 (1.591 TB)
  SD Bytes Written:       1,592,005,510,500 (1.592 TB)
  Rate:                   31598.0 KB/s
  Software Compression:   None
  VSS:                    no
  Encryption:             no
  Volume name(s):         000296L4|000295L4
  Volume Session Id:      8
  Volume Session Time:    1220276378
  Last Volume Bytes:      1,056,271,813,632 (1.056 TB)
  Non-fatal FD errors:    0
  SD Errors:              0
  FD termination status:  OK
  SD termination status:  OK
  Termination:            Backup OK

== michael

-------------------------------------------------------------------------
This SF.Net email is sponsored by the Moblin Your Move Developer's challenge
Build the coolest Linux based applications with Moblin SDK & win great prizes
Grand prize is a trip for two to an Open Source event anywhere in the world
http://moblin-contest.org/redirect.php?banner_id=100&url=/
_______________________________________________
Bacula-users mailing list
Bacula-users AT lists.sourceforge DOT net
https://lists.sourceforge.net/lists/listinfo/bacula-users