Re: [Virtuoso-users] speeding up SPARQL query

2014-04-18 Thread Hugh Williams
Hi Bart, The explain command whilst useful only provide the compile into,, where the new v7 "profile(0" function provided both compile and execute info. and it was I requested ie profile('select * from table where field = ''text'''); The plans will be analysed by development ... Best

Re: [Virtuoso-users] Tips to prevent hanging TTLP_MT?

2014-04-18 Thread Hugh Williams
Hi Frans, You definitely should use the rdf_loader_run() buik loader function for loading multiple files. You did not provide the isql "status();" and "top" command outputs when the ttlp function was apparently hanging so we can see the state of the server at that point ? Best Regards Hugh Wi

Re: [Virtuoso-users] speeding up SPARQL query

2014-04-18 Thread Bart Vandewoestyne
On 2014-04-18 12:53, Hugh Williams wrote: > Hi Bart, > > If you cannot provide the data then the next best thing would be to get > the "profile" for the problem queries ie the compiler and execution > plans for analysis as detailed at: > > http://virtuoso.openlinksw.com/dataspace/doc/dav/wiki/Main/

Re: [Virtuoso-users] Tips to prevent hanging TTLP_MT?

2014-04-18 Thread Frans Knibbe | Geodan
Hi Hugh, I am calling TTLP_MT() on the isql command line at the moment. I keep the file size under 1 Gb and limit the number of lines (or triples) to 5 million. My system has a modest memory of 4Gb. I have just had a hang situation again, this time with a really small file: 44 Mb and 300,000

Re: [Virtuoso-users] speeding up SPARQL query

2014-04-18 Thread Bart Vandewoestyne
On 2014-04-18 04:50, Hugh Williams wrote: > > [Hugh] I note that you do not appear to have any of the parameters the new v7 > vectored execution set in your INI file , these being: > > MaxQueryMem= 2G ; memory allocated to query processor > VectorSize = 1000

Re: [Virtuoso-users] speeding up SPARQL query

2014-04-18 Thread Hugh Williams
Hi Bart, If you cannot provide the data then the next best thing would be to get the "profile" for the problem queries ie the compiler and execution plans for analysis as detailed at: http://virtuoso.openlinksw.com/dataspace/doc/dav/wiki/Main/VirtTipsAndTricksAanalyzingSPARQLQuery

Re: [Virtuoso-users] Tips to prevent hanging TTLP_MT?

2014-04-18 Thread Hugh Williams
Hi Frans, How are you calling the TTLP_MT() function to load multiple files and when you says these file are small what is there typical size or number of lines/triples ? For loading of large number of files I would expect you to be using the rdf_loader_run() bulk loader function which calls tt

Re: [Virtuoso-users] speeding up SPARQL query

2014-04-18 Thread Bart Vandewoestyne
On 2014-04-18 04:50, Hugh Williams wrote: > >> What else could I try? Do you need any further info from my side? > > [Hugh] I note that you do not appear to have any of the parameters the new v7 > vectored execution set in your INI file , these being: > > MaxQueryMem= 2G ; m

[Virtuoso-users] Tips to prevent hanging TTLP_MT?

2014-04-18 Thread Frans Knibbe | Geodan
Hello, I am using the function TTLP_MT to load ntriple files in Virtuoso 7.1. Even though I take care to have reasonably small files (splitting the files by line numbers if necessary) TTLP_MT still frequently hangs. I have to restart Virtuoso, remove the partial load results and start over. T