Bacula-users

Re: [Bacula-users] Time for change

2008-12-18 07:48:08
Subject: Re: [Bacula-users] Time for change
From: Alan Brown <ajb2 AT mssl.ucl.ac DOT uk>
To: Jesper Krogh <jesper AT krogh DOT cc>
Date: Thu, 18 Dec 2008 12:43:48 +0000 (GMT)
On Thu, 18 Dec 2008, Jesper Krogh wrote:

> > 100-200Gb ram and systems capable of addressing that amount of memory are
> > still far more expensive than a stack of flash drives, else I'd use them.
>
> But do you need to spool a complete tape? In order to avoid doing "evil" stuff
> to you tape drive, much less is sufficient.

I'm multiplexing anything up to 20 jobs at a time. To ensure that small
incremental and diff jobs are dumped in one hit and to ensure that full
backups are laid in as large chunks as possible, this is the kindof size
which is required.

> > My concern isn't just backup run time.
>
> So you'd like to spool a complete Job? Whats you average job-size? (mine is
> less than 8GB)

Full backups run 500Gb to 1Tb apiece, the average nightly incremental is
about 80-150Gb - multiplied out by 90 filesystems.

You get the idea.

> Concerned about job run time, its my impression that spool space only speeds
> up incremental/differential.

It does at the moment. HOWEVER if spooling isn't used then jobs are
interleaved on the tape at record time, resulting in massive shoeshining
on restores and restore throughput rates measured in kb/Sec instead of
25-40Mb/sec

> Whats the time consuming part in this? Seeking on tapes? Neither SSD's or
> memory will change that. AFAIK the spooling area is only used when going TO
> tape, not FROM tape.

Using large spool areas increases the size of the chunks dropped to tape
and thus allows the tapes to stream for longer periods. ONE of my backups
might span 5 LTO2s

> Can you give some numbers, so we have a feeling about the sizes you talk
> about?

250Tb startup, 1Pb within 18 months, and growing past that. Filesizes
measured in tens of Mb apiece.




------------------------------------------------------------------------------
SF.Net email is Sponsored by MIX09, March 18-20, 2009 in Las Vegas, Nevada.
The future of the web can't happen without you.  Join us at MIX09 to help
pave the way to the Next Web now. Learn more and register at
http://ad.doubleclick.net/clk;208669438;13503038;i?http://2009.visitmix.com/
_______________________________________________
Bacula-users mailing list
Bacula-users AT lists.sourceforge DOT net
https://lists.sourceforge.net/lists/listinfo/bacula-users