On Wed, Apr 07, 2010 at 09:58:51AM -0700, ebollengier wrote:
>
>
> ebollengier wrote:
> >
> >
> > Graham Keeling wrote:
> >>
> >> On Wed, Apr 07, 2010 at 08:22:09AM -0700, ebollengier wrote:
> >>> I tweaked my test to compare both queries, and it shows no difference
> >>> with
> >>> and without base job part... If you want to test queries on your side
> >>> with
> >>> your data, you can download my tool (accurate-test.pl) on
> >>> http://bacula.git.sourceforge.net/git/gitweb.cgi?p=bacula/docs;a=tree;f=docs/techlogs;hb=HEAD
> >>>
> >>> If you can tweak my script to reproduce your problem, i would be able to
> >>> fix
> >>> things.
> >>>
> >>> http://old.nabble.com/file/p28166612/diff-with-without-basejob.png
> >>
> >> I'm currently running your script to generate the test database. I think
> >> that is going to take a long time, so I'll leave it overnight.
> >>
> >>
> >
> > This is your first problem, on my server (just a workstation), it takes
> > less
> > than 10s to add 200,000 records...
> >
> >
>
> In fact, it's 4seconds, here...
>
> JobId=15 files=20000
> Insert takes 4secs for 200000 records
> JobId=16 files=50000
> Insert takes 11secs for 500000 records
> JobId=20 files=200000
> Insert takes 43secs for 2000000 records
I was running these three simultaneously, as described in the script.
I assume that fill_table.pl is the same as docs_techlogs_accurate-test.pl.
# filename=1 ./fill_table.pl &
# path=1 ./fill_table.pl &
# file=1 ./fill_table.pl &
However, I was also not running it on the machine that I did my original tests
on because it didn't have pwgen and the perl DBD-mysql thing installed.
But I have installed them now, so I will switch back to that machine.
Running one instance looks comparable with yours:
tserv tmp # file=1 docs_techlogs_accurate-test.pl
JobId=1 files=20000
Insert takes 9secs for 200000 records
JobId=2 files=20000
Insert takes 6secs for 200000 records
JobId=3 files=20000
Insert takes 8secs for 200000 records
JobId=4 files=20000
(but I think it is still going to take some time)
------------------------------------------------------------------------------
Download Intel® Parallel Studio Eval
Try the new software tools for yourself. Speed compiling, find bugs
proactively, and fine-tune applications for parallel performance.
See why Intel Parallel Studio got high marks during beta.
http://p.sf.net/sfu/intel-sw-dev
_______________________________________________
Bacula-users mailing list
Bacula-users AT lists.sourceforge DOT net
https://lists.sourceforge.net/lists/listinfo/bacula-users
|
