Networker

Re: [Networker] recommendation to backup 1.5 million small files?

2008-02-03 22:47:43
Subject: Re: [Networker] recommendation to backup 1.5 million small files?
From: Craig Worthington <craig.worthington AT NRM.QLD.GOV DOT AU>
To: NETWORKER AT LISTSERV.TEMPLE DOT EDU
Date: Mon, 4 Feb 2008 13:41:50 +1000
When I asked EMC sales directly and got no reply, I gather snapimage
isn't supported anymore. powersnap is but it doesn't help in my
situation.

CraigW

On Sun, 2008-02-03 at 12:19, Tim Mooney wrote:
> In regard to: Re: [Networker] recommendation to backup 1.5 million small...:
> 
> > yes, that's 1 one directory. It takes days to backup, even 3 million
> > files takes 30+ hours to backup. I know it's the worst way to organise
> > data but it was given to us by a external programmer.
> 
> Hopefully that external programmer has been educated, perhaps in a
> painful way.
> 
> > so is there a way using legato to bypass the filesystem layer ?
> 
> Using some of the add-on products that Rob Sterba and others have talked
> about, you can bypass the filesystem layer.
> 
> Even without those products, there may be ways to do it, but I've
> never been faced with a problem like you are, so I have no experience with
> making it work and where the pitfalls would be.  The general idea
> involves splitting a raid1 mirror and backing up the block device for the
> half of the mirror that's no longer changing, but restores are where
> things would get very tricky.  Hence the benefits of a product like
> SnapImage.
> 
> PS: how long does an ls take in that directory -- I would love to know!
> ;-)
> 
>       cd /your/obscene/directory
>       time ls > /dev/null
> 
> Tim
> -- 
> Tim Mooney                                        Tim.Mooney AT ndsu DOT edu
> Information Technology Services                   (701) 231-1076 (Voice)
> Room 242-J6, IACC Building                        (701) 231-8541 (Fax)
> North Dakota State University, Fargo, ND 58105-5164
> 
> To sign off this list, send email to listserv AT listserv.temple DOT edu and 
> type "signoff networker" in the body of the email. Please write to 
> networker-request AT listserv.temple DOT edu if you have any problems with 
> this list. You can access the archives at 
> http://listserv.temple.edu/archives/networker.html or
> via RSS at http://listserv.temple.edu/cgi-bin/wa?RSS&L=NETWORKER


************************************************************************
The information in this email together with any attachments is
intended only for the person or entity to which it is addressed
and may contain confidential and/or privileged material.
Any form of review, disclosure, modification, distribution
and/or publication of this email message is prohibited, unless
as a necessary part of Departmental business.
If you have received this message in error, you are asked to
inform the sender as quickly as possible and delete this message
and any copies of this message from your computer and/or your
computer system network.
************************************************************************

To sign off this list, send email to listserv AT listserv.temple DOT edu and 
type "signoff networker" in the body of the email. Please write to 
networker-request AT listserv.temple DOT edu if you have any problems with this 
list. You can access the archives at 
http://listserv.temple.edu/archives/networker.html or
via RSS at http://listserv.temple.edu/cgi-bin/wa?RSS&L=NETWORKER