Amanda-Users

Re: amflush problem

2004-10-20 14:01:44
Subject: Re: amflush problem
From: Gene Heskett <gene.heskett AT verizon DOT net>
To: Frederic Medery <dist-list AT LEXUM.UMontreal DOT CA>
Date: Fri, 15 Oct 2004 12:31:06 -0400
On Friday 15 October 2004 11:35, Frederic Medery wrote:
>ok :)
>
>here is the output of amanda/daily :
>total 24
>drwxr-xr-x    6 amanda   disk         4096 Oct 14 20:00 .
>drwxr-xr-x    7 root     root         4096 Aug 23 13:27 ..
>drwx------    2 amanda   disk         4096 Aug 25 14:19 20040823
>drwx------    2 amanda   disk         4096 Oct 12 10:30 20040910
>drwx------    2 amanda   disk         4096 Oct 13 16:28 20041012
>drwx------    2 amanda   disk         4096 Oct 15 08:30 20041014

Humm, what would a 'du .' show?

>./20040823:
>total 11258772
>drwx------    2 amanda   disk         4096 Aug 25 14:19 .
>drwxr-xr-x    6 amanda   disk         4096 Oct 14 20:00 ..
>-rw-------    1 amanda   disk     1073741824 Aug 24 09:18
>sassari.lan.lexum.pri._home_workdata_archie_.1
>-rw-------    1 amanda   disk     1073741824 Aug 24 09:18
>sassari.lan.lexum.pri._home_workdata_archie_.1.1
>-rw-------    1 amanda   disk     1073741824 Aug 24 09:18
>sassari.lan.lexum.pri._home_workdata_archie_.1.2
>-rw-------    1 amanda   disk     1073741824 Aug 24 09:18
>sassari.lan.lexum.pri._home_workdata_archie_.1.3
>-rw-------    1 amanda   disk     1073741824 Aug 24 09:18
>sassari.lan.lexum.pri._home_workdata_archie_.1.4
>-rw-------    1 amanda   disk     1073741824 Aug 24 09:18
>sassari.lan.lexum.pri._home_workdata_archie_.1.5
>-rw-------    1 amanda   disk     1073741824 Aug 24 09:18
>sassari.lan.lexum.pri._home_workdata_archie_.1.6
>-rw-------    1 amanda   disk     1073741824 Aug 24 09:18
>sassari.lan.lexum.pri._home_workdata_archie_.1.7
>-rw-------    1 amanda   disk     1073741824 Aug 24 09:29
>sassari.lan.lexum.pri._home_workdata_archie_.1.8
>-rw-------    1 amanda   disk     530968564 Aug 24 09:32
>sassari.lan.lexum.pri._home_workdata_archie_.1.9.tmp
>-rw-------    1 amanda   disk     1073741824 Aug 24 11:32
>urbino.lan.lexum.pri._home_web_canlii_web.1
>-rw-------    1 amanda   disk     213549056 Aug 24 11:35
>urbino.lan.lexum.pri._home_web_canlii_web.1.1.tmp
>-rw-------    1 amanda   disk     17739324 Aug 24 01:22
>urbino.lan.lexum.pri._var_lib_pgsql.1
>-rw-------    1 amanda   disk     17984275 Aug 24 02:37
>urbino.lan.lexum.pri._var_spool_mail.0
>
>./20040910:
>total 118824
>drwx------    2 amanda   disk         4096 Oct 12 10:30 .
>drwxr-xr-x    6 amanda   disk         4096 Oct 14 20:00 ..
>-rw-------    1 amanda   disk       113950 Sep 11 02:17
>modena.dmz.lexum.pri._etc_courier.0
>-rw-------    1 amanda   disk        33426 Sep 11 02:17
>modena.dmz.lexum.pri._etc_httpd.1
>-rw-------    1 amanda   disk     48062501 Sep 11 03:11
>modena.dmz.lexum.pri._home.2
>-rw-------    1 amanda   disk        37002 Sep 11 02:17
>modena.dmz.lexum.pri._usr_lib_courier.1
>-rw-------    1 amanda   disk     67833381 Sep 11 03:04
>modena.dmz.lexum.pri._var.0
>-rw-------    1 amanda   disk      5428247 Sep 11 03:02
>sassari.lan.lexum.pri._home_workdata_archie_.2
>
>./20041012:
>total 32444796
>drwx------    2 amanda   disk         4096 Oct 13 16:28 .
>drwxr-xr-x    6 amanda   disk         4096 Oct 14 20:00 ..
>-rw-------    1 amanda   disk     1073741824 Oct 13 04:38
>pisa.lan.lexum.pri._home_projets.0
>-rw-------    1 amanda   disk     1073741824 Oct 13 04:41
>pisa.lan.lexum.pri._home_projets.0.1
>-rw-------    1 amanda   disk     1073741824 Oct 13 05:01
>pisa.lan.lexum.pri._home_projets.0.10
>-rw-------    1 amanda   disk     1073741824 Oct 13 05:03
>pisa.lan.lexum.pri._home_projets.0.11
>-rw-------    1 amanda   disk     1073741824 Oct 13 05:05
>pisa.lan.lexum.pri._home_projets.0.12
>-rw-------    1 amanda   disk     1073741824 Oct 13 05:07
>pisa.lan.lexum.pri._home_projets.0.13
>-rw-------    1 amanda   disk     1073741824 Oct 13 05:09
>pisa.lan.lexum.pri._home_projets.0.14
>-rw-------    1 amanda   disk     1073741824 Oct 13 05:11
>pisa.lan.lexum.pri._home_projets.0.15
>-rw-------    1 amanda   disk     1073741824 Oct 13 05:14
>pisa.lan.lexum.pri._home_projets.0.16
>-rw-------    1 amanda   disk     1073741824 Oct 13 05:16
>pisa.lan.lexum.pri._home_projets.0.17
>-rw-------    1 amanda   disk     1073741824 Oct 13 05:18
>pisa.lan.lexum.pri._home_projets.0.18
>-rw-------    1 amanda   disk     141387973 Oct 13 05:18
>pisa.lan.lexum.pri._home_projets.0.19
>-rw-------    1 amanda   disk     1073741824 Oct 13 04:43
>pisa.lan.lexum.pri._home_projets.0.2
>-rw-------    1 amanda   disk     1073741824 Oct 13 04:45
>pisa.lan.lexum.pri._home_projets.0.3
>-rw-------    1 amanda   disk     1073741824 Oct 13 04:47
>pisa.lan.lexum.pri._home_projets.0.4
>-rw-------    1 amanda   disk     1073741824 Oct 13 04:49
>pisa.lan.lexum.pri._home_projets.0.5
>-rw-------    1 amanda   disk     1073741824 Oct 13 04:51
>pisa.lan.lexum.pri._home_projets.0.6
>-rw-------    1 amanda   disk     1073741824 Oct 13 04:54
>pisa.lan.lexum.pri._home_projets.0.7
>-rw-------    1 amanda   disk     1073741824 Oct 13 04:56
>pisa.lan.lexum.pri._home_projets.0.8
>-rw-------    1 amanda   disk     1073741824 Oct 13 04:58
>pisa.lan.lexum.pri._home_projets.0.9
>-rw-------    1 amanda   disk     47940080 Oct 13 10:12
>roma.dmz.lexum.pri._home.1
>-rw-------    1 amanda   disk     177768448 Oct 13 10:06
>salerno.lan.lexum.pri._var.1
>-rw-------    1 amanda   disk     145864980 Oct 13 10:19
>urbino.lan.lexum.pri._.0
>-rw-------    1 amanda   disk     236706733 Oct 13 10:07
>urbino.lan.lexum.pri._home_soft.0
>-rw-------    1 amanda   disk     627680359 Oct 13 10:09
>urbino.lan.lexum.pri._home_users.0
>-rw-------    1 amanda   disk     264508449 Oct 13 10:18
>urbino.lan.lexum.pri._home_users_lexum.2
>-rw-------    1 amanda   disk     1073741824 Oct 13 07:18
>urbino.lan.lexum.pri._home_web_canlii_web.1
>-rw-------    1 amanda   disk     1073741824 Oct 13 08:13
>urbino.lan.lexum.pri._home_web_canlii_web.1.1
>-rw-------    1 amanda   disk     1073741824 Oct 13 08:47
>urbino.lan.lexum.pri._home_web_canlii_web.1.2
>-rw-------    1 amanda   disk     1073741824 Oct 13 09:38
>urbino.lan.lexum.pri._home_web_canlii_web.1.3
>-rw-------    1 amanda   disk     1073741824 Oct 13 09:41
>urbino.lan.lexum.pri._home_web_canlii_web.1.4
>-rw-------    1 amanda   disk     1073741824 Oct 13 09:46
>urbino.lan.lexum.pri._home_web_canlii_web.1.5
>-rw-------    1 amanda   disk     1073741824 Oct 13 09:49
>urbino.lan.lexum.pri._home_web_canlii_web.1.6
>-rw-------    1 amanda   disk     1073741824 Oct 13 09:52
>urbino.lan.lexum.pri._home_web_canlii_web.1.7
>-rw-------    1 amanda   disk     1073741824 Oct 13 09:56
>urbino.lan.lexum.pri._home_web_canlii_web.1.8
>-rw-------    1 amanda   disk     925189551 Oct 13 10:05
>urbino.lan.lexum.pri._home_web_canlii_web.1.9
>-rw-------    1 amanda   disk     494201171 Oct 13 10:24
>urbino.lan.lexum.pri._usr_local.0
>-rw-------    1 amanda   disk     64832009 Oct 13 10:06
>urbino.lan.lexum.pri._var.0
>
>./20041014:
>total 26179504
>drwx------    2 amanda   disk         4096 Oct 15 08:30 .
>drwxr-xr-x    6 amanda   disk         4096 Oct 14 20:00 ..
>-rw-------    1 amanda   disk     155631944 Oct 15 03:11
>pisa.lan.lexum.pri._home_cvs.0
>-rw-------    1 amanda   disk       356771 Oct 15 03:10
>pisa.lan.lexum.pri._home_projets.2
>-rw-------    1 amanda   disk       248840 Oct 15 01:25
>pisa.lan.lexum.pri._home_soft.0
>-rw-------    1 amanda   disk     137720918 Oct 15 03:03
>pisa.lan.lexum.pri._home_web.1
>-rw-------    1 amanda   disk     508538410 Oct 15 08:04
>pisa.lan.lexum.pri._var_lib_pgsql.0
>-rw-------    1 amanda   disk       105105 Oct 15 03:01
>roma.dmz.lexum.pri._etc_courier.0
>-rw-------    1 amanda   disk        63029 Oct 15 03:01
>roma.dmz.lexum.pri._etc_httpd.0
>-rw-------    1 amanda   disk     67442797 Oct 15 03:05
>roma.dmz.lexum.pri._home.2
>-rw-------    1 amanda   disk      1907262 Oct 15 01:25
>roma.dmz.lexum.pri._usr_lib_courier.0
>-rw-------    1 amanda   disk     29264451 Oct 15 03:12
>roma.dmz.lexum.pri._var.0
>-rw-------    1 amanda   disk      1398660 Oct 15 08:25
>salerno.lan.lexum.pri._etc.0
>-rw-------    1 amanda   disk     1073741824 Oct 15 01:35
>salerno.lan.lexum.pri._home_canlii.0
>-rw-------    1 amanda   disk     1073741824 Oct 15 01:46
>salerno.lan.lexum.pri._home_canlii.0.1
>-rw-------    1 amanda   disk     1073741824 Oct 15 01:55
>salerno.lan.lexum.pri._home_canlii.0.2
>-rw-------    1 amanda   disk     1073741824 Oct 15 01:59
>salerno.lan.lexum.pri._home_canlii.0.3
>-rw-------    1 amanda   disk     1073741824 Oct 15 02:12
>salerno.lan.lexum.pri._home_canlii.0.4
>-rw-------    1 amanda   disk     1073741824 Oct 15 02:21
>salerno.lan.lexum.pri._home_canlii.0.5
>-rw-------    1 amanda   disk     1073741824 Oct 15 02:28
>salerno.lan.lexum.pri._home_canlii.0.6
>-rw-------    1 amanda   disk     1073741824 Oct 15 02:41
>salerno.lan.lexum.pri._home_canlii.0.7
>-rw-------    1 amanda   disk     1073741824 Oct 15 02:57
>salerno.lan.lexum.pri._home_canlii.0.8
>-rw-------    1 amanda   disk     664569240 Oct 15 03:01
>salerno.lan.lexum.pri._home_canlii.0.9
>-rw-------    1 amanda   disk     384165888 Oct 15 08:24
>salerno.lan.lexum.pri._var.0
>-rw-------    1 amanda   disk      9930279 Oct 15 01:25
>turin.dmz.lexum.pri._home_web_coldfusion.0
>-rw-------    1 amanda   disk     842928462 Oct 15 03:16
>turin.dmz.lexum.pri._home_web_juris.0
>-rw-------    1 amanda   disk     13214810 Oct 15 03:11
>turin.dmz.lexum.pri._var_lib_pgsql.0
>-rw-------    1 amanda   disk       103429 Oct 15 03:03
>urbino.lan.lexum.pri._.1
>-rw-------    1 amanda   disk       482433 Oct 15 08:24
>urbino.lan.lexum.pri._home_soft.1
>-rw-------    1 amanda   disk      1455375 Oct 15 08:25
>urbino.lan.lexum.pri._home_users.1
>-rw-------    1 amanda   disk     314693000 Oct 15 08:30
>urbino.lan.lexum.pri._home_users_lexum.3
>-rw-------    1 amanda   disk     1073741824 Oct 15 07:28
>urbino.lan.lexum.pri._home_web.1
>-rw-------    1 amanda   disk     214479715 Oct 15 07:29
>urbino.lan.lexum.pri._home_web.1.1
>-rw-------    1 amanda   disk        34010 Oct 15 03:02
>urbino.lan.lexum.pri._home_web_acjnet.1
>-rw-------    1 amanda   disk     1018667197 Oct 15 07:41
>urbino.lan.lexum.pri._home_web_bcmf.0
>-rw-------    1 amanda   disk        87166 Oct 15 03:02
>urbino.lan.lexum.pri._home_web_beta1.1
>-rw-------    1 amanda   disk       674748 Oct 15 03:10
>urbino.lan.lexum.pri._home_web_beta2.1
>-rw-------    1 amanda   disk        32958 Oct 15 03:01
>urbino.lan.lexum.pri._home_web_beta3.1
>-rw-------    1 amanda   disk     11529492 Oct 15 03:11
>urbino.lan.lexum.pri._home_web_canlii.1
>-rw-------    1 amanda   disk     1073741824 Oct 15 07:04
>urbino.lan.lexum.pri._home_web_canlii_archives.0
>-rw-------    1 amanda   disk     1073741824 Oct 15 07:06
>urbino.lan.lexum.pri._home_web_canlii_archives.0.1
>-rw-------    1 amanda   disk     1073741824 Oct 15 07:08
>urbino.lan.lexum.pri._home_web_canlii_archives.0.2
>-rw-------    1 amanda   disk     1073741824 Oct 15 07:11
>urbino.lan.lexum.pri._home_web_canlii_archives.0.3
>-rw-------    1 amanda   disk     248219125 Oct 15 07:11
>urbino.lan.lexum.pri._home_web_canlii_archives.0.4
>-rw-------    1 amanda   disk     37992302 Oct 15 03:13
>urbino.lan.lexum.pri._home_web_canlii_edition.2
>-rw-------    1 amanda   disk     1073741824 Oct 15 08:16
>urbino.lan.lexum.pri._home_web_canlii_source.0
>-rw-------    1 amanda   disk     576043793 Oct 15 08:24
>urbino.lan.lexum.pri._home_web_canlii_source.0.1
>-rw-------    1 amanda   disk     1073741824 Oct 15 04:57
>urbino.lan.lexum.pri._home_web_canlii_web.3
>-rw-------    1 amanda   disk     1073741824 Oct 15 05:41
>urbino.lan.lexum.pri._home_web_canlii_web.3.1
>-rw-------    1 amanda   disk     1073741824 Oct 15 06:08
>urbino.lan.lexum.pri._home_web_canlii_web.3.2
>-rw-------    1 amanda   disk     723153466 Oct 15 06:57
>urbino.lan.lexum.pri._home_web_canlii_web.3.3
>-rw-------    1 amanda   disk     19820171 Oct 15 03:13
>urbino.lan.lexum.pri._home_web_fca-caf.1
>-rw-------    1 amanda   disk     605650569 Oct 15 07:19
>urbino.lan.lexum.pri._home_web_fc-cf.0
>-rw-------    1 amanda   disk        68202 Oct 15 03:02
>urbino.lan.lexum.pri._home_web_juris.1
>-rw-------    1 amanda   disk        33163 Oct 15 03:01
>urbino.lan.lexum.pri._home_web_legis.1
>-rw-------    1 amanda   disk     172085244 Oct 15 03:18
>urbino.lan.lexum.pri._home_web_lexum.1
>-rw-------    1 amanda   disk       919829 Oct 15 03:03
>urbino.lan.lexum.pri._home_web_loisca.1
>-rw-------    1 amanda   disk        36691 Oct 15 01:25
>urbino.lan.lexum.pri._home_web_quadcom.1
>-rw-------    1 amanda   disk     673924377 Oct 15 07:01
>urbino.lan.lexum.pri._home_web_tax.0
>-rw-------    1 amanda   disk       652063 Oct 15 03:03
>urbino.lan.lexum.pri._usr_local.1
>-rw-------    1 amanda   disk     15610778 Oct 15 08:25
>urbino.lan.lexum.pri._var.1
>-bash-2.05b$
>
>Frédéric Médery
>Administrateur Système
>LexUM, Université de Montréal
>
>mederyf AT lexum.umontreal DOT ca
>tel. : (514) 343-6111  #3288

I see that you are using a 1GB chunk size setting, and just a rather 
cursory mental addup of one of them indicates it would take about a 
21 to 22GB tape to actually hold just the dump of

 pisa.lan.lexum.pri._home_projets

Are your tapes that big?  We apparently neglected to specifically ask 
that.

Since amanda cannot span an individual dump (all those chunks added 
together again) over more than one tape, it probably totals things up 
and throws up its hands in defeat since the backup is bigger than the 
tape. 

The design of amanda tends to want its disklist to be rather lengthy, 
and broken up such that no one backup image is more than say 10% of a 
tape, and with a few that may be only a few megabytes, which can then 
allow amanda to juggle its scheduleing to facilitate a consistent 
amount of data (on the tape, after any gzip compression if used) each 
night.  I have had it fill the tapes to 97+% many nights in a row 
without ever hitting the dreaded EOT here.

Unless the budget has the sheckles for a bigger drive, I think I'd be 
rather inclined to rm -fR all of this, and breakup the disklist 
entries into smaller sized pieces and more of them.  Start with the 
biggest one tonight, making 4 or 5 pieces (disklist entries) out of 
it, do the next biggest one tomorrow night, etc till you have it 
carved down into gigabyte or smaller hunks per entry.  Or get a 
larger drive, much larger.  See sheckles above...

-- 
Cheers, Gene
"There are four boxes to be used in defense of liberty:
 soap, ballot, jury, and ammo. Please use in that order."
-Ed Howdershelt (Author)
99.27% setiathome rank, not too shabby for a WV hillbilly
Yahoo.com attorneys please note, additions to this message
by Gene Heskett are:
Copyright 2004 by Maurice Eugene Heskett, all rights reserved.

<Prev in Thread] Current Thread [Next in Thread>