Amanda-Users

Re: Time outs for S3 Backups

2008-12-08 06:59:34
Subject: Re: Time outs for S3 Backups
From: Matt Burkhardt <mlb AT imparisystems DOT com>
To: Nikolas Coukouma <atrus AT zmanda DOT com>
Date: Mon, 08 Dec 2008 06:52:39 -0500
On Sun, 2008-12-07 at 21:40 -0500, Nikolas Coukouma wrote:
On Sun, 2008-12-07 at 13:25 -0500, Dustin J. Mitchell wrote:
> On Sun, Dec 7, 2008 at 12:22 PM, Matt Burkhardt <mlb AT imparisystems DOT com> wrote:
> > Now that I've got my holding disk set up, I've been running into issues with
> > timeouts from S3.
>
> ... These errors
> are only reported to you after 14 retrires, which means Amazon has
> been given ample opportunity to resolve any network issues.
> ...

Actually, the 2.6.0p2 release (and earlier) uses significantly different
values.
The maximum number of retries is only 5 and the resulting time is fairly
short (the backoff increases exponentially). I believe that 2.6.0p2 only
waits a a couple seconds

If the bucket you're trying to backup to isn't created yet, that's
probably the problem. If the problem persists, I'd recommend either
trying the beta or compiling a copy from source, tweaking the values in
device-src/s3.c .
I'm running 2.6.1b1 right now - I'm using the Ubuntu Hardy package for i386. 

Specifically, you'd want to change the values
#define EXPONENTIAL_BACKOFF_START_USEC 10000
#define EXPONENTIAL_BACKOFF_MAX_RETRIES 5
to
#define EXPONENTIAL_BACKOFF_START_USEC G_USEC_PER_SEC/100
#define EXPONENTIAL_BACKOFF_MAX_RETRIES 14

I'll give it a try, but it's a bear to uninstall with the package and install from source - wish me luck!
Regards,
Matt Burkhardt, MSTM
President
Impari Systems, Inc.
502 Fairview Avenue
Frederick, MD  21701
mlb AT imparisystems DOT com
www.imparisystems.com
(301) 682-7901


<Prev in Thread] Current Thread [Next in Thread>