Search String: Display: Description: Sort:

Results:

References: [ +subject:/^(?:^\s*(re|sv|fwd|fw)[\[\]\d]*[:>-]+\s*)*\[ADSM\-L\]\s+million\s+files\s+backup\s*$/: 13 ]

Total 13 documents matching your query.

1. [ADSM-L] million files backup (score: 1)
Author: Jorge Amil <jorgeamil AT HOTMAIL DOT COM>
Date: Thu, 2 Feb 2012 15:30:28 +0100
Hi everybody, Does anyone know what is the best way to make a filesystem backup than contains million files? Backup image is not posible because is a GPFS filesystem and is not supported. Thanks in a
/usr/local/webapp/mharc-adsm.org/html/ADSM-L/2012-02/msg00009.html (11,515 bytes)

2. Re: [ADSM-L] million files backup (score: 1)
Author: "Schneider, Jim" <jschneider AT USSCO DOT COM>
Date: Thu, 2 Feb 2012 08:47:24 -0600
Jorge, On Unix systems: I've done it in two steps. Create a tar file of the file system and zip it. Create a second file listing all the files in the tarred directory. The tar extract command allows
/usr/local/webapp/mharc-adsm.org/html/ADSM-L/2012-02/msg00010.html (12,549 bytes)

3. Re: [ADSM-L] million files backup (score: 1)
Author: "Lee, Gary" <GLEE AT BSU DOT EDU>
Date: Thu, 2 Feb 2012 09:50:25 -0500
Is it organized into subdirectory trees? If so, virtual mountpoints might be a way to go. Gary Lee Senior System Programmer Ball State University phone: 765-285-1310 --Original Message-- From: ADSM:
/usr/local/webapp/mharc-adsm.org/html/ADSM-L/2012-02/msg00011.html (12,512 bytes)

4. Re: [ADSM-L] million files backup (score: 1)
Author: Jorge Amil <jorgeamil AT HOTMAIL DOT COM>
Date: Thu, 2 Feb 2012 16:05:54 +0100
Hi Jim, thank you very much for your answer. Actually we are doing what you say. Filesystem .tar. It was a great solution when the filesystem was 500Gb-1Tb but actually our filesystem is 14Tb. The ta
/usr/local/webapp/mharc-adsm.org/html/ADSM-L/2012-02/msg00012.html (13,740 bytes)

5. Re: [ADSM-L] million files backup (score: 1)
Author: Richard Sims <rbs AT BU DOT EDU>
Date: Thu, 2 Feb 2012 10:11:01 -0500
Be sure to check the mail archives (www.adsm.org or www.mail-archive.com/adsm-l AT vm.marist DOT edu/) for common issues having been discussed in the past. A lot of people have contributed a lot of i
/usr/local/webapp/mharc-adsm.org/html/ADSM-L/2012-02/msg00013.html (12,227 bytes)

6. Re: [ADSM-L] million files backup (score: 1)
Author: Rainer Wolf <rainer.wolf AT UNI-ULM DOT DE>
Date: Thu, 2 Feb 2012 16:31:04 +0100
Hi , it depends on how many changes happens daily and the other thing is how fast can the tsm-client scan the filesystem. We have some clients with > 30Mio files and they can scan with tsm more than
/usr/local/webapp/mharc-adsm.org/html/ADSM-L/2012-02/msg00014.html (14,150 bytes)

7. Re: [ADSM-L] million files backup (score: 1)
Author: Skylar Thompson <skylar2 AT U.WASHINGTON DOT EDU>
Date: Thu, 2 Feb 2012 08:11:54 -0800
One million files shouldn't be a problem with some planning; we have a GPFS filesystem with 31 million files that we can backup in 18 hours. We have some other non-GPFS filesystems with several times
/usr/local/webapp/mharc-adsm.org/html/ADSM-L/2012-02/msg00018.html (13,473 bytes)

8. Re: [ADSM-L] million files backup (score: 1)
Author: Remco Post <r.post AT PLCS DOT NL>
Date: Thu, 2 Feb 2012 17:27:26 +0100
GPFS, so use mmbackup with TSM, there is some white/blue/redpaper or a wiki somewhere about that. -- Met vriendelijke groeten/Kind Regards, Remco Post r.post AT plcs DOT nl +31 6 248 21 622
/usr/local/webapp/mharc-adsm.org/html/ADSM-L/2012-02/msg00019.html (12,197 bytes)

9. Re: [ADSM-L] million files backup (score: 1)
Author: "Robert A. Clark" <robert.a.clark AT DAIMLER DOT COM>
Date: Thu, 2 Feb 2012 08:58:10 -0800
I find that "incrbydate" is often a win in making the first pass across a filesystem with a large count of files to be backed up. Doing a "dirsonly" pass is sometimes a win as well. Thanks, [RC] jorg
/usr/local/webapp/mharc-adsm.org/html/ADSM-L/2012-02/msg00021.html (12,286 bytes)

10. Re: [ADSM-L] million files backup (score: 1)
Author: Howard Coles <Howard.Coles AT ARDENTHEALTH DOT COM>
Date: Thu, 2 Feb 2012 17:11:07 +0000
Have you tried using the memoryefficient=diskcache method? I'm assuming you have. Takes a while, but on fast systems I've had pretty decent results. You may need to go the virtual mount point route t
/usr/local/webapp/mharc-adsm.org/html/ADSM-L/2012-02/msg00022.html (15,219 bytes)

11. Re: [ADSM-L] million files backup (score: 1)
Author: Dan Olson <dolson AT MCS.ANL DOT GOV>
Date: Thu, 2 Feb 2012 11:40:03 -0600
I'm able to backup several systems with 100's of millions of files with the diskcache method. If your backup is running that slow on a gpfs filesystem, you probably have a performance problem with th
/usr/local/webapp/mharc-adsm.org/html/ADSM-L/2012-02/msg00024.html (15,710 bytes)

12. Re: [ADSM-L] million files backup (score: 1)
Author: "Gretchen L. Thiele" <gretchen AT PRINCETON DOT EDU>
Date: Thu, 2 Feb 2012 15:23:01 +0000
If you are not using HSM, the virtual mountpoint approach is a good one. Since we do have an integrated TSM/HSM system on GPFS, we can't do that. It takes a bit over 3 days to wade through 130+ milli
/usr/local/webapp/mharc-adsm.org/html/ADSM-L/2012-02/msg00026.html (13,551 bytes)

13. Re: [ADSM-L] million files backup (score: 1)
Author: Jorge Amil <jorgeamil AT HOTMAIL DOT COM>
Date: Fri, 3 Feb 2012 08:22:02 +0100
Thank you very much for all your answers.I´m going to read carefully all your mail to valorate the best solution. Thanks Jorge
/usr/local/webapp/mharc-adsm.org/html/ADSM-L/2012-02/msg00039.html (12,074 bytes)


This search system is powered by Namazu