Re: [Bacula-users] Why it takes so much to "Building directory tree"

Hello,

2015-07-05 1:17 GMT+02:00 <f-otake AT kinryokai DOT net>:

Many thanks for Heitor Faria(Mr./Ms.) and Randoslaw
Koreniewski(Mr./Ms)
Mysql DB was MyISAM therefore changed to InnoDB.
and also inserted few lines as suggested on http://bacula.us/tuning/
as follows
sort_buffer_size = 2MB
innodb_buffer_pool_size = 128MB
innodb_flush_log_at_trx_commit = 0
innodb_flush_method = O_DIRECT
then "Bulding directory tree" finish almost immidiatly.
FYI following case take only less than 30seconds

I can guess there are a plenty space for tunning.

# time echo restore client=radekk fileset=\"MacOSX Server Full Set\" select current done|bconsole

Using Catalog "BackupCatalog"

+--------+-------+-----------+---------------+---------------------+------------+

+--------+-------+-----------+---------------+---------------------+------------+

| 34,154 | F | 2,258,200 | 749,116,220 | 2015-05-09 20:10:38 | 0029C |

| 34,161 | I | 26,263 | 561,273,244 | 2015-05-12 20:14:14 | 006D9 |

| 34,182 | I | 5,690 | 434,817,665 | 2015-05-13 20:13:12 | 001B9 |

| 34,201 | I | 3,813 | 253,870,636 | 2015-05-14 20:16:03 | 001A9 |

| 34,220 | I | 6,890 | 303,529,259 | 2015-05-15 20:14:16 | 00013 |

| 34,257 | I | 2,466 | 90,700,158 | 2015-05-17 20:14:16 | 00550 |

| 34,288 | I | 17,622 | 542,569,957 | 2015-05-18 20:25:34 | 0005B |

| 34,306 | I | 9,959 | 177,332,163 | 2015-05-19 20:20:44 | 00149 |

| 34,324 | I | 4,495 | 352,862,913 | 2015-05-20 20:20:45 | 0029E |

| 34,342 | I | 11,945 | 544,958,861 | 2015-05-21 20:21:43 | 006C7 |

| 34,386 | I | 83,163 | 4,344,990,138 | 2015-06-28 21:44:03 | 0038C |

| 34,410 | I | 2,679 | 2,420,709,204 | 2015-06-29 20:00:00 | 00357 |

| 34,431 | I | 8,877 | 307,858,068 | 2015-06-30 20:00:01 | 000B4 |

| 34,456 | I | 2,391 | 286,562,783 | 2015-07-01 20:00:00 | 0017F |

| 34,501 | I | 8,843 | 680,933,784 | 2015-07-03 20:00:01 | 001EC |

| 34,522 | I | 2,008 | 164,777,395 | 2015-07-04 20:00:00 | 001D2 |

+--------+-------+-----------+---------------+---------------------+------------+

You have selected the following JobIds: 34154,34161,34182,34201,34220,34257,34288,34306,34324,34342,34386,34410,34431,34456,34501,34522

Building directory tree for JobId(s) 34154,34161,34182,34201,34220,34257,34288,34306,34324,34342,34386,34410,34431,34456,34501,34522 ... ++++++++++++++++++++++++++++++++++++++++++

1,906,548 files inserted into the tree.

No files selected to be restored.

You have messages.

real 0m24.743s

user 0m0.028s

sys 0m0.000s

So it took 24 seconds to handle almost 2M files restore. It is a 5Y old small server with a postgresql database.

best regards

Radosław Korzeniewski
radoslaw AT korzeniewski DOT net

------------------------------------------------------------------------------
Don't Limit Your Business. Reach for the Cloud.
GigeNET's Cloud Solutions provide you with the tools and support that
you need to offload your IT needs and focus on growing your business.
Configured For All Businesses. Start Your Cloud Today.
https://www.gigenetcloud.com/

_______________________________________________
Bacula-users mailing list
Bacula-users AT lists.sourceforge DOT net
https://lists.sourceforge.net/lists/listinfo/bacula-users