Re: [Virtuoso-users] query timings: can you explain this behaviour?

On 2014-09-17 15:20, Hugh Williams wrote: > Hi Bart, > > This is indeed strange behaviour and would appear to be network related > as you indicate the spikes about every 100 query executions only occur > when the script is run on the machine hosting Virtuoso and the > "physical" IP address it used

Re: [Virtuoso-users] query timings: can you explain this behaviour?

On 2014-09-15 16:24, Bart Vandewoestyne wrote: > On 2014-09-15 14:28, Bart Vandewoestyne wrote: >> [...] >> The experiment was the following: repeat a SPARQL query 1000 times (by >> sending 1000 HTTP curl requests containing a certain SPARQL query to >> Virtuoso) an

Re: [Virtuoso-users] query timings: can you explain this behaviour?

On 2014-09-15 14:28, Bart Vandewoestyne wrote: > [...] > The experiment was the following: repeat a SPARQL query 1000 times (by > sending 1000 HTTP curl requests containing a certain SPARQL query to > Virtuoso) and time its execution (using time_total from curl). As you > can s

Re: [Virtuoso-users] query timings: can you explain this behaviour?

On 2014-09-02 04:34, Hugh Williams wrote: > Hi Bart, > > It would be interesting to see the compiler statistics for running this > sequence of queries which can be obtained by running the command: > > exp_stat_to_file ('stat.dv'); > > as detailed at: > > > http://virtuoso.openlinksw.c

[Virtuoso-users] query timings: can you explain this behaviour?

Hello list, I have a SPARQL query file with the following structure: PREFIX disq: SELECT ?id ?label ?term ?type WHERE { { ?id disq:preferredLabel ?label ; disq:hasSearchTerm ?term ; a ?type FILTER (?id in ( , , ..., )) } UNION { ?id

Re: [Virtuoso-users] 'Too many arguments' error

On 2014-08-28 14:19, Rumi wrote: > Hi Bart, > > On 28-Aug-14 1:56 PM, Bart Vandewoestyne wrote: >> On 2014-07-16 10:34, Alexey Zakhlestin wrote: >>> On 14 Jul 2014, at 17:37, Bart Vandewoestyne >>> wrote: >>> >>>> Our problem is the followin

Re: [Virtuoso-users] 'Too many arguments' error

On 2014-07-16 10:34, Alexey Zakhlestin wrote: > > On 14 Jul 2014, at 17:37, Bart Vandewoestyne > wrote: > >> Our problem is the following: we observed that certain of our SPARQL >> queries have subqueries (that return IDs) that run rather slow (because >> of a slow

Re: [Virtuoso-users] 'Too many arguments' error

On 2014-08-26 16:40, Rumi wrote: >> [...] >> Am I right if I say that using an expression like >> >> ?id IN(1,2,3) >> >> is a Virtuoso-specific extension to the SPARQL standard? > > It is indeed part of the SPARQL 1.1 Specification: -- > http://www.w3.org/TR/sparql11-query/#func-in Thanks Rumi

Re: [Virtuoso-users] 'Too many arguments' error

On 2014-07-16 10:34, Alexey Zakhlestin wrote: > > On 14 Jul 2014, at 17:37, Bart Vandewoestyne > wrote: > >> Our problem is the following: we observed that certain of our SPARQL >> queries have subqueries (that return IDs) that run rather slow (because >> of a slow

Re: [Virtuoso-users] 'Too many arguments' error

gt; I have been able to recreate this and reported to development for > comment. How many such Id's are you seeking to "inject" in the FILTER > statement ? > > Best Regards > Hugh Williams > > On 10 Jul 2014, at 15:01, Bart Vandewoestyne > mailto:bart.vandewoest..

[Virtuoso-users] 'Too many arguments' error

Hello list, I have a SPARQL query that gets constructed as follows: first, using some other technology, i obtain a comma-separated list of id's and 'inject' them in the FILTER statement of a SPARQL query, something like this: FILTER (?id in (,

[Virtuoso-users] bif:contains behavior

Hello list, According to the example at http://docs.openlinksw.com/virtuoso/sparqlextensions.html#rdfsparqlrulefulltext using things like ?name bif:contains "'rich*'" would match if ?name STARTS with Rich. However, I have a query that has ?searchterm bif:contains "'homo*'" . and it also

[Virtuoso-users] question about locks

Hello list, A student of mine is doing a performance test with Virtuoso, and he asked me to pose the following question to this mailing list: "How are row and page level locks handled when querying the triplestore (only read stuff with SPARQL, no data inserts or SPARUL)? Is it possible to get

Re: [Virtuoso-users] Using column store structure for exiting data

On 2014-05-18 16:11, Hugh Williams wrote: > Hi Sumit > > Ah, didn't realise you started with a v6 row store database, thus how > did you upgrade to v7 ? > > As if you simply check pointed and restarted the v6 database with a v7 > binary then it would be automatically upgraded but all the tables > i

Re: [Virtuoso-users] Using column store structure for exiting data

On 2014-05-22 14:33, Bart Vandewoestyne wrote: > > Hugh and list, > > I just wanted to report my findings with this first option: > > I have a virtuoso.db file of 142 GB and it took one night to dump it to > .ttl and .graph files. The .ttl and .graph files together take 242 G

Re: [Virtuoso-users] Using column store structure for exiting data

On 2014-05-18 16:11, Hugh Williams wrote: > Hi Sumit > > Ah, didn't realise you started with a v6 row store database, thus how > did you upgrade to v7 ? > > As if you simply check pointed and restarted the v6 database with a v7 > binary then it would be automatically upgraded but all the tables > i

Re: [Virtuoso-users] Using column store structure for exiting data

On 2014-05-21 00:03, Hugh Williams wrote: > Hi Summit/Bart, > > The sys_keys table can then be queried to verify if the index type of the > table is column, row (index, or bitmap) wise: > > SQL> SELECT TOP 10 KEY_TABLE, sys_sql_val_print (KEY_OPTIONS) >FROM sys_keys >WHERE KEY_TABLE = 'DB

Re: [Virtuoso-users] Using column store structure for exiting data

On 2014-05-18 16:11, Hugh Williams wrote: > Hi Sumit > > Ah, didn't realise you started with a v6 row store database, thus how > did you upgrade to v7 ? > > As if you simply check pointed and restarted the v6 database with a v7 > binary then it would be automatically upgraded but all the tables > i

Re: [Virtuoso-users] same query, different results

On 2014-05-09 15:20, Bart Vandewoestyne wrote: > On 2014-05-09 15:05, Kingsley Idehen wrote: >> [...] >> Are you using /sparql or isql command-line to perform these queries? > > I am using OpenLink Interactive SQL (Virtuoso), version 0.9849b. in both > interactive and b

Re: [Virtuoso-users] same query, different results

On 2014-05-09 15:05, Kingsley Idehen wrote: > [...] > Are you using /sparql or isql command-line to perform these queries? I am using OpenLink Interactive SQL (Virtuoso), version 0.9849b. in both interactive and batch mode. > How many triples to you have in the Virtuoso Quad Store? SQL> sparql

Re: [Virtuoso-users] same query, different results

On 2014-05-07 12:52, Kingsley Idehen wrote: > On 5/7/14 4:37 AM, Bart Vandewoestyne wrote: >> Hello list, >> >> I'm confused. I have a SPARQL-query of the following form (slightly >> obfuscated because of NDA-restrictions): >> >> SELECT ?val (COUN

[Virtuoso-users] same query, different results

Hello list, I'm confused. I have a SPARQL-query of the following form (slightly obfuscated because of NDA-restrictions): SELECT ?val (COUNT(?id) as ?vc) WHERE { ?id ?val. ?id . } GROUP

[Virtuoso-users] seeing what parameters are in effect

Hello list, For some parameters in the virtuoso.ini file, the documentation on http://docs.openlinksw.com/virtuoso/databaseadmsrv.html#VIRTINI does not mention their default value (for example UseAIO). Is there a way to see what parameter values are in effect for a running virtuoso instance?

Re: [Virtuoso-users] speeding up SPARQL query

On 2014-04-24 17:59, Hugh Williams wrote: > Hi Bart, > > Hmmm, note sure why you would need to run as root to get the profile > plan, especially if it was not required for explain ? Could it have to do with file/directory permissions? The directory from which I start virtuoso has the following p

Re: [Virtuoso-users] speeding up SPARQL query

On 2014-04-24 16:45, Bart Vandewoestyne wrote: > > I'm still struggling to get this profiling going... After starting up > my Virtuoso, i immediately try profiling from within ISQL but I get no > output: > > bart@hp-g7-02:~$ isql > OpenLink Interactive SQL (Virtuoso), ve

Re: [Virtuoso-users] speeding up SPARQL query

On 2014-04-24 15:16, Hugh Williams wrote: > Hi Bart, > > Is seems the "set profile on" option is not implemented in the VOS isql > program, so will have to make a request to have that option added as > it is in the commercial version. But you still can just run the profile > command with the quer

Re: [Virtuoso-users] speeding up SPARQL query

On 2014-04-23 14:55, Hugh Williams wrote: > Hi Bart, > > You still have not provided the "profile" for each query. You can do > this by running "SET PROFILE ON/OFF" as did for the explain plans ... Hugh, I'm confused here. I am following the instructions on http://virtuoso.openlinksw.com/datas

[Virtuoso-users] first query run takes longer than subsequent runs

Hello list, I noticed that for most (if not all) of my queries, the first time the query is run (right after i started the virtuoso server), it takes much longer than all subsequent runs. See e.g. my query timings at https://dl.dropboxusercontent.com/u/32340538/long_first_query.png Using dsta

Re: [Virtuoso-users] speeding up SPARQL query

On 2014-04-18 19:19, Hugh Williams wrote: > Hi Bart, > > The explain command whilst useful only provide the compile into,, where > the new v7 "profile(0" function provided both compile and execute info. > and it was I requested ie > > profile('select * from table where field = ''text'''); > > The p

[Virtuoso-users] MaxCheckpointRemap parameter

Hello list, I have a question regarding the MaxCheckpointRemap parameter. On http://docs.openlinksw.com/virtuoso/databaseadmsrv.html#VIRTINI this parameter is explained under the [Parameters] section, but in some example virtuoso.ini files, e.g. the one at http://virtuoso.openlinksw.com/datas

Re: [Virtuoso-users] speeding up SPARQL query

On 2014-04-18 12:53, Hugh Williams wrote: > Hi Bart, > > If you cannot provide the data then the next best thing would be to get > the "profile" for the problem queries ie the compiler and execution > plans for analysis as detailed at: > > http://virtuoso.openlinksw.com/dataspace/doc/dav/wiki/Main/

Re: [Virtuoso-users] speeding up SPARQL query

On 2014-04-18 04:50, Hugh Williams wrote: > > [Hugh] I note that you do not appear to have any of the parameters the new v7 > vectored execution set in your INI file , these being: > > MaxQueryMem= 2G ; memory allocated to query processor > VectorSize = 1000

Re: [Virtuoso-users] speeding up SPARQL query

On 2014-04-18 04:50, Hugh Williams wrote: > >> What else could I try? Do you need any further info from my side? > > [Hugh] I note that you do not appear to have any of the parameters the new v7 > vectored execution set in your INI file , these being: > > MaxQueryMem= 2G ; m

Re: [Virtuoso-users] speeding up SPARQL query

On 2014-04-17 15:04, Hugh Williams wrote: > Hi Bart, > > I note your Virtuoso version is reported as "Version > 07.00.3203-pthreads for Linux as of Mar 26 2014" which despite having > been be built in March 2014, a 3203 build is about the original 7.0 > release code from a year ago. The latest bui

Re: [Virtuoso-users] speeding up SPARQL query

On 2014-04-17 15:04, Hugh Williams wrote: > Hi Bart, > > I note your Virtuoso version is reported as "Version > 07.00.3203-pthreads for Linux as of Mar 26 2014" which despite having > been be built in March 2014, a 3203 build is about the original 7.0 > release code from a year ago. The latest bui

Re: [Virtuoso-users] speeding up SPARQL query

On 2014-04-16 11:43, Hugh Williams wrote: > Hi Bart, > > Your status(''); output shows that the default Buffers size of 2 is > being allocated on server startup and all quickly used due to the size > of your dataset, with the "NumberOfBuffers" setting of 200 in the > INI file not being pick

[Virtuoso-users] speeding up SPARQL query

Hello list, I have the following query: SELECT ?val (COUNT(DISTINCT ?id) as ?vc) WHERE { ?id ?val ; ?property1 ?property_value1 ; ?property2 ?property_value2 . ?property_value1 bif:contains "'foo'" . ?property_value2 bif:

Re: [Virtuoso-users] speeding up a query

On 2014-04-03 15:00, Kingsley Idehen wrote: > On 4/3/14 7:47 AM, Bart Vandewoestyne wrote: >> Hello list, >> >> INITIAL REMARK: if this is not the appropriate mailing list for this >> question, please let me know the best place to ask questions regarding >> SPAR

[Virtuoso-users] speeding up a query

Hello list, INITIAL REMARK: if this is not the appropriate mailing list for this question, please let me know the best place to ask questions regarding SPARQL queries and their optimization. I'm a beginner when it comes to writing SPARQL queries. I am trying to speed up a certain query that I

[Virtuoso-users] MaxCheckpointRemap set correct?

Hello list, The virtuoso.ini file has a MaxCheckpointRemap parameter for both the [Database] and the [TempDatabase] section. Concerning this parameter, the documentation says: "Also, if running with a large database, setting MaxCheckpointRemap to 1/4th of the database size is recommended. This

Re: [Virtuoso-users] NumberOfBuffers confusion

On 2014-04-01 11:35, Hugh Williams wrote: > Hi Bart, > > You should set the NumberOfBuffers based on the amount of free memory > available on the system , thus about 7.1GB * 0.66 / 8K (each buffer is > 8K) = 585750 buffers ... Thanks for clarifying this, Hugh. However, after a discussion with a

[Virtuoso-users] NumberOfBuffers confusion

Hello list, I'm confused on how to set the NumberOfBUffers parameter. I have a machine which gives the following memory information in the top-command when virtuoso is not running: Mem: 24680200k total, 17571268k used, 7108932k free,58764k buffers Swap: 542716k total,14732k used,