|
Re: [BackupPC-users] rsync never starts transferring files (but does something)
2012-12-05 09:19:44
Markus <universe AT truemetal DOT org> wrote on 11/19/2012
04:03:03 PM:
> For fun, here's the output of find / | wc -l:
>
> 24478753
>
> real 490m35.602s
> user 0m21.013s
> sys 1m23.305s
>
> 25 million files! OMG. find took 8 hours to complete. Nice, hm? :-)
Wow. If a simple "find" took 8 hours
to complete, rsync's gonna take even longer to create the file list! :)
> I started another full backup on Friday 21:00 CET and it's still
> running, but it started to transfer files after a day or so, finally!
Good for you!
> Another box of the same customer has 2.5 files and took 29 hours for
the
> first full backup. That means the 25 million box' full backup should
be
> done within 12 days. :-) But if I understand correctly all
future full
> backups will be faster. No idea what BackupPC will do after these
12
> days, start directly with another full backup? Well, we will see...
In one case for me, my first full backup took 9000
minutes (almost a full week). Subsequent fulls still took over 4000
minutes, so the speedup for future fulls was only double that of the first
full. (I ended up optimizing things a bit more and getting it down
to about 3000 minutes, which I'm currently living wth.)
> a) Different profiles with aliases
> b) Different shares
I am looking at doing the same here, just to break
up the fulls so they can run on different days. (Thanks, Les!)
> c) tar
Personally, I find that tar takes no real less time
than rsync for fulls.
> Unforunately almost all of the files are located in /home in thousands
> of subdirectories, so I can't just say "backup /home or /home/1,
> /home/2, /home/3 in another profile", but if tar won't work I
guess I
> will have to dig deeper into the subdirectories for profiles/shares
> splitting.
Wow. 25 *million* files saved in home directories?
That kind of defeats the purpose of shared data! I thought
my users were bad about that... :)
Tim Massey
------------------------------------------------------------------------------
LogMeIn Rescue: Anywhere, Anytime Remote support for IT. Free Trial
Remotely access PCs and mobile devices and provide instant support
Improve your efficiency, and focus on delivering more value-add services
Discover what IT Professionals Know. Rescue delivers
http://p.sf.net/sfu/logmein_12329d2d _______________________________________________
BackupPC-users mailing list
BackupPC-users AT lists.sourceforge DOT net
List: https://lists.sourceforge.net/lists/listinfo/backuppc-users
Wiki: http://backuppc.wiki.sourceforge.net
Project: http://backuppc.sourceforge.net/
|
| <Prev in Thread] |
Current Thread |
[Next in Thread>
|
- Re: [BackupPC-users] rsync never starts transferring files (but does something),
Timothy J Massey <=
|
|
|
