Doesn't TSM-Client understand what I want ????

[obiwan2]

Hi guys,

I hope that one of you can explain me in simple words, why this happens....

This is in my inclexcl.list:
-------------------------------------------
* EXCLUDE ALL files and directories
exclude /*
exclude /.../*

* ONLY /tmp/backup/databases and its contents should be backed up
include "/tmp/backup/databases/.../*"
---------------------------------------------

ONLY the files and directories under /tmp/backup/databases should be saved.....not less, not more....
If I check with: dsmc preview backup /tmp/backup/databases
I get the following result in dsmprev.txt:
--------------------------------------------------------------------------------------------------------------------
Preview generated on 27.05.2016 13:31:56.
Name: Size: Type: Status: Pattern: Source: Mgmt Class:
/tmp/backup/apps 4,00 KB Directory Included - - MC_DEF
/tmp/backup/backup 4,00 KB Directory Included - - MC_DEF
/tmp/backup/conf 4,00 KB Directory Included - - MC_DEF
/tmp/backup/cron 4,00 KB Directory Included - - MC_DEF
/tmp/backup/data 4,00 KB Directory Included - - MC_DEF
/tmp/backup/databases 4,00 KB Directory Included - - MC_DEF
/tmp/backup/docroot 4,00 KB Directory Included - - MC_DEF
/tmp/backup/logfiles 4,00 KB Directory Included - - MC_DEF
/tmp/backup/lost+found 16,00 KB Directory Included - - MC_DEF
/tmp/backup/tmp 4,00 KB Directory Included - - MC_DEF
/tmp/backup/apps/haproxy 4,00 KB Directory Included - - MC_DEF
/tmp/backup/apps/man 4,00 KB Directory Included - - MC_DEF
/tmp/backup/apps/scripts 4,00 KB Directory Included - - MC_DEF
/tmp/backup/apps/share 4,00 KB Directory Included - - MC_DEF
/tmp/backup/apps/databases 0 B - Excluded /.../* "/web/conf/tsm/inclexcl.list" -
/tmp/backup/apps/haproxy/databases 0 B - Excluded /.../* "/web/conf/tsm/inclexcl.list" -
/tmp/backup/apps/man/man1 4,00 KB Directory Included - - MC_DEF
/tmp/backup/apps/man/databases 0 B - Excluded /.../* "/web/conf/tsm/inclexcl.list" -
/tmp/backup/apps/man/man1/databases 0 B - Excluded /.../* "/web/conf/tsm/inclexcl.list" -
/tmp/backup/apps/scripts/databases 0 B - Excluded /.../* "/web/conf/tsm/inclexcl.list" -
/tmp/backup/apps/share/doc 4,00 KB Directory Included - - MC_DEF
/tmp/backup/apps/share/databases 0 B - Excluded /.../* "/web/conf/tsm/inclexcl.list" -
/tmp/backup/apps/share/doc/DWhaproxy-1.5.14 4,00 KB Directory Included - - MC_DEF
/tmp/backup/apps/share/doc/DWnrpe-2.13 4,00 KB Directory Included - - MC_DEF
/tmp/backup/apps/share/doc/databases 0 B - Excluded /.../* "/web/conf/tsm/inclexcl.list" -
/tmp/backup/apps/share/doc/DWhaproxy-1.5.14/databases 0 B - Excluded /.../* "/web/conf/tsm/inclexcl.list" -
/tmp/backup/apps/share/doc/DWnrpe-2.13/databases 0 B - Excluded /.../* "/web/conf/tsm/inclexcl.list" -
/tmp/backup/backup/databases 0 B - Excluded /.../* "/web/conf/tsm/inclexcl.list" -
/tmp/backup/cron/deploy 4,00 KB Directory Included - - MC_DEF
/tmp/backup/cron/databases 0 B - Excluded /.../* "/web/conf/tsm/inclexcl.list" -
/tmp/backup/cron/deploy/databases 0 B - Excluded /.../* "/web/conf/tsm/inclexcl.list" -
/tmp/backup/data/home 4,00 KB Directory Included - - MC_DEF
/tmp/backup/data/databases 0 B - Excluded /.../* "/web/conf/tsm/inclexcl.list" -
/tmp/backup/data/home/exchange 4,00 KB Directory Included - - MC_DEF
/tmp/backup/data/home/mysql 4,00 KB Directory Included - - MC_DEF
/tmp/backup/data/home/web 4,00 KB Directory Included - - MC_DEF
/tmp/backup/data/home/databases 0 B - Excluded /.../* "/web/conf/tsm/inclexcl.list" -
/tmp/backup/data/home/exchange/databases 0 B - Excluded /.../* "/web/conf/tsm/inclexcl.list" -
/tmp/backup/data/home/mysql/databases 0 B - Excluded /.../* "/web/conf/tsm/inclexcl.list" -
/tmp/backup/data/home/web/.ssh 4,00 KB Directory Included - - MC_DEF
/tmp/backup/data/home/web/databases 0 B - Excluded /.../* "/web/conf/tsm/inclexcl.list" -
/tmp/backup/data/home/web/.ssh/databases 0 B - Excluded /.../* "/web/conf/tsm/inclexcl.list" -

/tmp/backup/databases/mongodb 4,00 KB Directory Included - - MC_DEF
/tmp/backup/databases/databases 0 B - Excluded /.../* "/web/conf/tsm/inclexcl.list" -
/tmp/backup/databases/mongodb/journal 4,00 KB Directory Included - - MC_DEF
/tmp/backup/databases/mongodb/databases 0 B - Excluded /.../* "/web/conf/tsm/inclexcl.list" -
/tmp/backup/databases/mongodb/journal/databases 0 B - Excluded /.../* "/web/conf/tsm/inclexcl.list" -

/tmp/backup/docroot/databases 0 B - Excluded /.../* "/web/conf/tsm/inclexcl.list" -
/tmp/backup/logfiles/haproxy 4,00 KB Directory Included - - MC_DEF
/tmp/backup/logfiles/mongodb 4,00 KB Directory Included - - MC_DEF
/tmp/backup/logfiles/syslog 4,00 KB Directory Included - - MC_DEF
/tmp/backup/logfiles/tsm 4,00 KB Directory Included - - MC_DEF
/tmp/backup/logfiles/databases 0 B - Excluded /.../* "/web/conf/tsm/inclexcl.list" -
/tmp/backup/logfiles/haproxy/databases 0 B - Excluded /.../* "/web/conf/tsm/inclexcl.list" -
/tmp/backup/logfiles/mongodb/databases 0 B - Excluded /.../* "/web/conf/tsm/inclexcl.list" -
/tmp/backup/logfiles/syslog/databases 0 B - Excluded /.../* "/web/conf/tsm/inclexcl.list" -
/tmp/backup/logfiles/tsm/databases 0 B - Excluded /.../* "/web/conf/tsm/inclexcl.list" -
/tmp/backup/lost+found/databases 0 B - Excluded /.../* "/web/conf/tsm/inclexcl.list" -
/tmp/backup/tmp/databases 0 B - Excluded /.../* "/web/conf/tsm/inclexcl.list" -

WTF !!!!! What happens here ???????
Why are directories, that I want to EXCLUDE included ?????
Why are files that I want to INCLUDE excluded ????

TSM drives me near to a collapse.......

 

[LED888]

When the changes were made in the dsm.opt/dsm.sys.
Did we stop and restart the schedule daemon/service?

Good Luck,
Sias

 

[marclant]

If it's a scheduled backup, easy:
define schedule ... ... object="/tmp/backup/databases/*" option="-su=yes"

Why are directories, that I want to EXCLUDE included ?????

It's like that by design. Include/exclude are for files. Exclude.dir for directories, but no wildcard.

 

[obiwan2]

@LED888
My INCLUDE/EXCLUDE's are in inclexcl.list (under RedHat Linux)...not in dsm.opt/dsm.sys

@marclant
No...it's not a scheduled job. The backup-script will be started by a cronjob.

Does that mean I have to exclude each directory separately, that I don't want to be backued-up ?

 

[obiwan2]

OK....now I have the following content in inclexcl.list:
----------------------------------------------------------------
exclude /*
exclude /.../*


exclude.dir /tmp/.ICE-unix
exclude.dir /tmp/atop.d
exclude.dir /tmp/clone
exclude.dir /tmp/backup/apps
exclude.dir /tmp/backup/backup
exclude.dir /tmp/backup/conf
exclude.dir /tmp/backup/cron
exclude.dir /tmp/backup/data
exclude.dir /tmp/backup/docroot
exclude.dir /tmp/backup/logfiles
exclude.dir /tmp/backup/lost+found
exclude.dir /tmp/backup/tmp

* save only /tmp/backup/databases (and it's content(s))
include tmp/backup/databases
-----------------------------------------------------------------
This is the result of dsmc preview backup /tmp/backup/databases:

Name: Size: Type: Status: Pattern: Source: Mgmt Class:
/tmp/backup/apps 4,00 KB Directory Excluded /tmp/backup/apps "/web/conf/tsm/inclexcl.list" MC_DEF
/tmp/backup/backup 4,00 KB Directory Excluded /tmp/backup/backup "/web/conf/tsm/inclexcl.list" MC_DEF
/tmp/backup/conf 4,00 KB Directory Excluded /tmp/backup/conf "/web/conf/tsm/inclexcl.list" MC_DEF
/tmp/backup/cron 4,00 KB Directory Excluded /tmp/backup/cron "/web/conf/tsm/inclexcl.list" MC_DEF
/tmp/backup/data 4,00 KB Directory Excluded /tmp/backup/data "/web/conf/tsm/inclexcl.list" MC_DEF
/tmp/backup/databases 4,00 KB Directory Included - - MC_DEF
/tmp/backup/docroot 4,00 KB Directory Excluded /tmp/backup/docroot "/web/conf/tsm/inclexcl.list" MC_DEF
/tmp/backup/logfiles 4,00 KB Directory Excluded /tmp/backup/logfiles "/web/conf/tsm/inclexcl.list" MC_DEF
/tmp/backup/lost+found 16,00 KB Directory Excluded /tmp/backup/lost+found "/web/conf/tsm/inclexcl.list" MC_DEF
/tmp/backup/tmp 4,00 KB Directory Excluded /tmp/backup/tmp "/web/conf/tsm/inclexcl.list" MC_DEF
/tmp/backup/databases/mongodb 4,00 KB Directory Included - - MC_DEF
/tmp/backup/databases/databases 0 B - Excluded /.../* "/web/conf/tsm/inclexcl.list" -
/tmp/backup/databases/mongodb/journal 4,00 KB Directory Included - - MC_DEF
/tmp/backup/databases/mongodb/databases 0 B - Excluded /.../* "/web/conf/tsm/inclexcl.list" -
/tmp/backup/databases/mongodb/journal/databases 0 B - Excluded /.../* "/web/conf/tsm/inclexcl.list" -

This is the directory-listing (ls -al):
root@dprod4031:tsm $ cd /tmp/backup/databases
root@dprod4031:databases $ ls -al
total 12
drwxrwxr-x 3 deploy itb 4096 Dec 1 07:47 .
drwxr-xr-x 12 root root 4096 Dec 1 07:46 ..
drwxrwxr-x 3 web web 4096 May 28 05:53 mongodb

There is NO /tmp/backup/databases/databases, NO /tmp/backup/databases/mongodb/databases and NO /tmp/backup/databases/mongodb/journal/databases directory !!!???

AND.....why didn't TSM save the content of /tmp/backup/databases/mongodb ????
root@dprod4031:tsm $ cd /tmp/backup/databases/mongodb
root@dprod4031:mongodb $ ls -al
total 222636692
drwxrwxr-x 3 web web 4096 May 30 04:57 .
drwxrwxr-x 3 deploy itb 4096 Dec 1 07:47 ..
-rw-r--r-- 1 web web 36864 May 27 15:05 collection-0-1438192027942448184.wt
-rw-r--r-- 1 web web 16384 May 27 15:05 collection-0-2302523387310451583.wt
-rw-r--r-- 1 web web 36864 May 25 20:01 collection-0-7360129749054254776.wt
-rw-r--r-- 1 web web 36864 May 27 15:05 collection-2-2302523387310451583.wt
-rw-r--r-- 1 web web 215458381824 May 26 10:04 collection-2-7360129749054254776.wt
-rw-r--r-- 1 web web 4791676928 May 28 05:51 collection-4-2302523387310451583.wt
-rw-r--r-- 1 web web 7714283520 May 28 05:51 collection-4-7360129749054254776.wt
-rw-r--r-- 1 web web 36864 May 27 15:05 index-1-1438192027942448184.wt
-rw-r--r-- 1 web web 16384 May 27 15:05 index-1-2302523387310451583.wt
-rw-r--r-- 1 web web 16384 May 25 20:01 index-1-7360129749054254776.wt
-rw-r--r-- 1 web web 16384 May 27 15:05 index-3-2302523387310451583.wt
-rw-r--r-- 1 web web 14827520 May 26 10:04 index-3-7360129749054254776.wt
-rw-r--r-- 1 web web 344064 May 28 05:51 index-5-7360129749054254776.wt
drwxr-xr-x 2 web web 4096 May 28 05:51 journal
-rw-r--r-- 1 web web 36864 May 26 10:24 _mdb_catalog.wt
-rwxr-xr-x 1 web web 6 May 25 15:21 mongod.lock
-rw-r--r-- 1 web web 45056 May 28 05:52 sizeStorer.wt
-rw-r--r-- 1 web web 95 Dec 14 15:40 storage.bson
-rw-r--r-- 1 web web 46 Dec 14 15:40 WiredTiger
-rw-r--r-- 1 web web 495 Dec 14 15:40 WiredTiger.basecfg
-rw-r--r-- 1 web web 21 Dec 14 15:40 WiredTiger.lock
-rw-r--r-- 1 web web 901 May 28 05:53 WiredTiger.turtle
-rw-r--r-- 1 web web 53248 May 28 05:53 WiredTiger.wt

 

[obiwan2]

Unbelievable......only a "/" makes TSM doing things different....

preview backup /tmp/backup/databases:
Preview generated on 30.05.2016 10:13:30.
Name: Size: Type: Status: Pattern: Source: Mgmt Class:
/tmp/backup/apps 4,00 KB Directory Excluded /tmp/backup/apps "/web/conf/tsm/inclexcl.list" MC_DEF
/tmp/backup/backup 4,00 KB Directory Excluded /tmp/backup/backup "/web/conf/tsm/inclexcl.list" MC_DEF
/tmp/backup/conf 4,00 KB Directory Excluded /tmp/backup/conf "/web/conf/tsm/inclexcl.list" MC_DEF
/tmp/backup/cron 4,00 KB Directory Excluded /tmp/backup/cron "/web/conf/tsm/inclexcl.list" MC_DEF
/tmp/backup/data 4,00 KB Directory Excluded /tmp/backup/data "/web/conf/tsm/inclexcl.list" MC_DEF
/tmp/backup/databases 4,00 KB Directory Included - - MC_DEF
/tmp/backup/docroot 4,00 KB Directory Excluded /tmp/backup/docroot "/web/conf/tsm/inclexcl.list" MC_DEF
/tmp/backup/logfiles 4,00 KB Directory Excluded /tmp/backup/logfiles "/web/conf/tsm/inclexcl.list" MC_DEF
/tmp/backup/lost+found 16,00 KB Directory Excluded /tmp/backup/lost+found "/web/conf/tsm/inclexcl.list" MC_DEF
/tmp/backup/tmp 4,00 KB Directory Excluded /tmp/backup/tmp "/web/conf/tsm/inclexcl.list" MC_DEF
/tmp/backup/databases/mongodb 4,00 KB Directory Included - - MC_DEF
/tmp/backup/databases/databases 0 B - Excluded - - -
/tmp/backup/databases/mongodb/journal 4,00 KB Directory Included - - MC_DEF
/tmp/backup/databases/mongodb/databases 0 B - Excluded - - -
/tmp/backup/databases/mongodb/journal/databases 0 B - Excluded - - -




preview backup /tmp/backup/databases/:
Preview generated on 30.05.2016 10:13:59.
Name: Size: Type: Status: Pattern: Source: Mgmt Class:
/tmp/backup/databases/mongodb 4,00 KB Directory Included - - MC_DEF
/tmp/backup/databases/mongodb/journal 4,00 KB Directory Included - - MC_DEF
/tmp/backup/databases/mongodb/index-5-7360129749054254776.wt 336,00 KB .wt Included /.../tmp/backup/databases/.../..
./*.* "/web/conf/tsm/inclexcl.list" DEFAULT
/tmp/backup/databases/mongodb/index-3-2302523387310451583.wt 16,00 KB .wt Included /.../tmp/backup/databases/.../..
./*.* "/web/conf/tsm/inclexcl.list" DEFAULT
/tmp/backup/databases/mongodb/index-1-7360129749054254776.wt 16,00 KB .wt Included /.../tmp/backup/databases/.../..
./*.* "/web/conf/tsm/inclexcl.list" DEFAULT
/tmp/backup/databases/mongodb/sizeStorer.wt 44,00 KB .wt Included /.../tmp/backup/databases/.../.../*.* "/web/co
nf/tsm/inclexcl.list" DEFAULT
/tmp/backup/databases/mongodb/collection-2-2302523387310451583.wt 36,00 KB .wt Included /.../tmp/backup/database
s/.../.../*.* "/web/conf/tsm/inclexcl.list" DEFAULT
/tmp/backup/databases/mongodb/collection-4-2302523387310451583.wt 4,46 GB .wt Included /.../tmp/backup/databases/.../..
./*.* "/web/conf/tsm/inclexcl.list" DEFAULT
/tmp/backup/databases/mongodb/_mdb_catalog.wt 36,00 KB .wt Included /.../tmp/backup/databases/.../.../*.* "/web/co
nf/tsm/inclexcl.list" DEFAULT
/tmp/backup/databases/mongodb/collection-2-7360129749054254776.wt 200,66 GB .wt Included /.../tmp/backup/database
s/.../.../*.* "/web/conf/tsm/inclexcl.list" DEFAULT
/tmp/backup/databases/mongodb/collection-4-7360129749054254776.wt 7,18 GB .wt Included /.../tmp/backup/databases/.../..
./*.* "/web/conf/tsm/inclexcl.list" DEFAULT
/tmp/backup/databases/mongodb/collection-0-7360129749054254776.wt 36,00 KB .wt Included /.../tmp/backup/database
s/.../.../*.* "/web/conf/tsm/inclexcl.list" DEFAULT
/tmp/backup/databases/mongodb/collection-0-2302523387310451583.wt 16,00 KB .wt Included /.../tmp/backup/database
s/.../.../*.* "/web/conf/tsm/inclexcl.list" DEFAULT
/tmp/backup/databases/mongodb/index-3-7360129749054254776.wt 14,14 MB .wt Included /.../tmp/backup/databases/.../..
./*.* "/web/conf/tsm/inclexcl.list" DEFAULT
/tmp/backup/databases/mongodb/collection-0-1438192027942448184.wt 36,00 KB .wt Included /.../tmp/backup/database
s/.../.../*.* "/web/conf/tsm/inclexcl.list" DEFAULT
/tmp/backup/databases/mongodb/WiredTiger 46 B - Included - - DEFAULT
/tmp/backup/databases/mongodb/index-1-2302523387310451583.wt 16,00 KB .wt Included /.../tmp/backup/databases/.../..
./*.* "/web/conf/tsm/inclexcl.list" DEFAULT
/tmp/backup/databases/mongodb/storage.bson 95 B .bson Included /.../tmp/backup/databases/.../.../*.* "/web/conf/tsm/i
nclexcl.list" DEFAULT
/tmp/backup/databases/mongodb/mongod.lock 6 B .lock Included /.../tmp/backup/databases/.../.../*.* "/web/conf/tsm/i
nclexcl.list" DEFAULT
/tmp/backup/databases/mongodb/WiredTiger.wt 52,00 KB .wt Included /.../tmp/backup/databases/.../.../*.* "/web/co
nf/tsm/inclexcl.list" DEFAULT
/tmp/backup/databases/mongodb/WiredTiger.turtle 901 B .turtle Included /.../tmp/backup/databases/.../.../*.* "/web/conf/tsm/i
nclexcl.list" DEFAULT
/tmp/backup/databases/mongodb/index-1-1438192027942448184.wt 36,00 KB .wt Included /.../tmp/backup/databases/.../..
./*.* "/web/conf/tsm/inclexcl.list" DEFAULT
/tmp/backup/databases/mongodb/WiredTiger.lock 21 B .lock Included /.../tmp/backup/databases/.../.../*.* "/web/conf/tsm/i
nclexcl.list" DEFAULT
/tmp/backup/databases/mongodb/WiredTiger.basecfg 495 B .basecfg Included /.../tmp/backup/databases/.../.../*.*
"/web/conf/tsm/inclexcl.list" DEFAULT
/tmp/backup/databases/mongodb/journal/WiredTigerPreplog.0000004123 128 B .0000004123 Included /.../tmp/backup/database
s/.../.../*.* "/web/conf/tsm/inclexcl.list" DEFAULT
/tmp/backup/databases/mongodb/journal/WiredTigerLog.0000027962 12,36 MB .0000027962 Included /.../tmp/backup/database
s/.../.../*.* "/web/conf/tsm/inclexcl.list" DEFAULT