Hi Hugh, We use OpenLink Virtuoso VDB Server 07.10.3209 and the platform is Mac OS X.
The times taken to generate results from the query were: 45 sec, 45 sec, 47 sec as recorded from 3 consecutive runs. I used the command status('rhck') to generate the reports in the following format: 1. Baseline (Not running the SPARQL query) 2. First Run of the SPARQL query (3 status results during the course of running the query) 3. Second Run of the SPARQL query (3 status results during the course of running the query) Please see the details below: 1. Baseline: OpenLink Virtuoso VDB Server Version 07.10.3209-pthreads for Darwin as of Apr 22 2014 (Personal Edition, 10 connections) Started on: 2014-10-30 12:28 GMT-4 CPU%: 73.31 Database Status: File size 0, 85504 pages, 36963 free. 170000 buffers, 28364 used, 2 dirty 0 wired down, repl age 0 0 w. io 0 w/crsr. Disk Usage: 26478 reads avg 0 msec, 0% r 0% w last 19 s, 69542 writes flush 49.11 MB, 168 read ahead, batch = 125. Autocompact 425 in 275 out, 35% saved col ac: 70265 in 25% saved. Gate: 456 2nd in reads, 0 gate write waits, 0 in while read 0 busy scrap. Log = virtuoso.trx, 1514 bytes VDB: 0 exec 0 fetch 0 transact 0 error 42568 pages have been changed since last backup (in checkpoint state) Current backup timestamp: 0x0000-0x00-0x00 Last backup date: unknown Clients: 3 connects, max 1 concurrent RPC: 126 calls, -1 pending, 1 max until now, 0 queued, 0 burst reads (0%), 0 second 4M large, 49M max Checkpoint Remap 5928 pages, 0 mapped back. 5 s atomic time. DB master 85504 total 36963 free 5928 remap 2 mapped back temp 1024 total 1019 free Lock Status: 0 deadlocks of which 0 2r1w, 168 waits, Currently 1 threads running 0 threads waiting 0 threads in vdb. Pending: Client 1111:3: Account: dba, 7192 bytes in, 166804 bytes out, 1 stmts. PID: 14297, OS: unix, Application: unknown, IP#: 127.0.0.1 Transaction status: PENDING, 1 threads. Locks: Running Statements: Time (msec) Text 7 status('rhck') Replication Status: Server db-HOSTNAMEREPLACEME. db-HOSTNAMEREPLACEME db-HOSTNAMEREPLACEME 0 OFF. Index Usage: Table Index Touches Reads Miss Locks Waits W n-dead DB.DBA.VSPX_SESSION VSPX_SESSION 16 1 5% 12 0 0% 0 WS.WS.SYS_DAV_QUEUE SYS_DAV_QUEUE 1360 1 0% 9904 168 1% 0 WS.WS.SYS_DAV_QUEUE_LCK SYS_DAV_QUEUE_LCK 1717 1 0% 5148 0 0% 0 VAD.DBA.VAD_REGISTRY VAD_REGISTRY 455 6 1% 0 0 0% 0 VAD.DBA.VAD_REGISTRY VAD_REGISTRY_CHDIR 1123 3 0% 0 0 0% 0 VAD.DBA.VAD_REGISTRY VAD_REGISTRY_KEY 726 3 0% 0 0 0% 0 VAD.DBA.VAD_HELP VAD_HELP 46 1 2% 46 0 0% 0 PUMP.DBA.DBPUMP_HELP DBPUMP_HELP 88 1 1% 0 0 0% 0 DB.DBA.RDF_PREFIX RDF_PREFIX 19 1 5% 0 0 0% 0 DB.DBA.RDF_PREFIX DB_DBA_RDF_PREFIX_UNQC_RP_ID 280 1 0% 0 0 0% 0 DB.DBA.RDF_IRI RDF_IRI 1880627 2421 0% 13 0 0% 0 DB.DBA.RDF_IRI DB_DBA_RDF_IRI_UNQC_RI_ID 6881732 2372 0% 6 0 0% 0 DB.DBA.RDF_QUAD RDF_QUAD 57280634 4002 0% 4541855 0 0% 0 DB.DBA.RDF_QUAD RDF_QUAD_SP 5504212 778 0% 0 0 0% 0 DB.DBA.RDF_QUAD RDF_QUAD_POGS 16159509 3019 0% 10657400 0 0% 0 DB.DBA.RDF_QUAD RDF_QUAD_GS 700769 90 0% 528680 0 0% 0 DB.DBA.RDF_QUAD RDF_QUAD_OP 140270 211 0% 0 0 0% 0 DB.DBA.RDF_OBJ RDF_OBJ 1790506 11545 0% 0 0 0% 0 DB.DBA.RDF_OBJ RO_VAL 1 997 49850% 0 0 0% 0 DB.DBA.RDF_DATATYPE RDF_DATATYPE 356905 1 0% 0 0 0% 0 DB.DBA.RDF_DATATYPE DB_DBA_RDF_DATATYPE_UNQC_RDT_TWOBYTE 356662 1 0% 0 0 0% 0 DB.DBA.RDF_LANGUAGE DB_DBA_RDF_LANGUAGE_UNQC_RL_TWOBYTE 30123 1 0% 0 0 0% 0 DB.DBA.LDLOCK LDLOCK 1 1 50% 0 0 0% 0 WS.WS.SYS_DAV_COL SYS_DAV_COL 882 1 0% 560 0 0% 0 WS.WS.SYS_DAV_COL SYS_DAV_COL_PARENT_ID 798 1 0% 559 0 0% 0 WS.WS.SYS_DAV_COL SYS_DAV_COL_ID 120 1 0% 0 0 0% 0 WS.WS.SYS_DAV_RES SYS_DAV_RES 443 210 47% 146 0 0% 0 WS.WS.SYS_DAV_RES SYS_DAV_RES_COL 12 3 23% 10 0 0% 0 WS.WS.SYS_DAV_RES SYS_DAV_RES_FULL_PATH 244 4 1% 22 0 0% 0 WS.WS.SYS_DAV_PROP SYS_DAV_PROP_ID 4 1 20% 0 0 0% 0 WS.WS.SYS_DAV_RES_TYPES SYS_DAV_RES_TYPES 843 5 0% 10 0 0% 0 DB.DBA.HTTP_PATH HTTP_PATH 30 1 3% 17 0 0% 0 WS.WS.RLOG_SYS_DAV_RES RLOG_SYS_DAV_RES 24 6 24% 22 0 0% 0 Hash indexes 81 Rows. -- 7 msec. 2. First Run OpenLink Virtuoso VDB Server Version 07.10.3209-pthreads for Darwin as of Apr 22 2014 (Personal Edition, 10 connections) Started on: 2014-10-30 12:28 GMT-4 CPU%: 174.18 Database Status: File size 0, 85504 pages, 36963 free. 170000 buffers, 28364 used, 2 dirty 0 wired down, repl age 0 0 w. io 3 w/crsr. Disk Usage: 26478 reads avg 0 msec, 0% r 0% w last 88 s, 69542 writes flush 49.11 MB, 168 read ahead, batch = 125. Autocompact 425 in 275 out, 35% saved col ac: 70265 in 25% saved. Gate: 456 2nd in reads, 0 gate write waits, 0 in while read 0 busy scrap. Log = virtuoso.trx, 1514 bytes VDB: 0 exec 0 fetch 0 transact 0 error 42568 pages have been changed since last backup (in checkpoint state) Current backup timestamp: 0x0000-0x00-0x00 Last backup date: unknown Clients: 3 connects, max 1 concurrent RPC: 128 calls, -1 pending, 1 max until now, 0 queued, 0 burst reads (0%), 0 second 6M large, 49M max Checkpoint Remap 5928 pages, 0 mapped back. 5 s atomic time. DB master 85504 total 36963 free 5928 remap 2 mapped back temp 1024 total 1019 free Lock Status: 0 deadlocks of which 0 2r1w, 168 waits, Currently 2 threads running 0 threads waiting 0 threads in vdb. Pending: Client 1111:3: Account: dba, 7327 bytes in, 172995 bytes out, 1 stmts. PID: 14297, OS: unix, Application: unknown, IP#: 127.0.0.1 Transaction status: PENDING, 1 threads. Locks: Running Statements: Time (msec) Text 7 status('rhck') Replication Status: Server db-HOSTNAMEREPLACEME. db-HOSTNAMEREPLACEME db-HOSTNAMEREPLACEME 0 OFF. Index Usage: Table Index Touches Reads Miss Locks Waits W n-dead DB.DBA.VSPX_SESSION VSPX_SESSION 16 1 5% 12 0 0% 0 WS.WS.SYS_DAV_QUEUE SYS_DAV_QUEUE 1360 1 0% 9904 168 1% 0 WS.WS.SYS_DAV_QUEUE_LCK SYS_DAV_QUEUE_LCK 1717 1 0% 5148 0 0% 0 VAD.DBA.VAD_REGISTRY VAD_REGISTRY 455 6 1% 0 0 0% 0 VAD.DBA.VAD_REGISTRY VAD_REGISTRY_CHDIR 1123 3 0% 0 0 0% 0 VAD.DBA.VAD_REGISTRY VAD_REGISTRY_KEY 726 3 0% 0 0 0% 0 VAD.DBA.VAD_HELP VAD_HELP 46 1 2% 46 0 0% 0 PUMP.DBA.DBPUMP_HELP DBPUMP_HELP 88 1 1% 0 0 0% 0 DB.DBA.RDF_PREFIX RDF_PREFIX 19 1 5% 0 0 0% 0 DB.DBA.RDF_PREFIX DB_DBA_RDF_PREFIX_UNQC_RP_ID 280 1 0% 0 0 0% 0 DB.DBA.RDF_IRI RDF_IRI 1881104 2421 0% 13 0 0% 0 DB.DBA.RDF_IRI DB_DBA_RDF_IRI_UNQC_RI_ID 6883897 2372 0% 6 0 0% 0 DB.DBA.RDF_QUAD RDF_QUAD 57491193 4002 0% 4541855 0 0% 0 DB.DBA.RDF_QUAD RDF_QUAD_SP 5513597 778 0% 0 0 0% 0 DB.DBA.RDF_QUAD RDF_QUAD_POGS 16956779 3019 0% 10657400 0 0% 0 DB.DBA.RDF_QUAD RDF_QUAD_GS 700769 90 0% 528680 0 0% 0 DB.DBA.RDF_QUAD RDF_QUAD_OP 140437 211 0% 0 0 0% 0 DB.DBA.RDF_OBJ RDF_OBJ 1793187 11545 0% 0 0 0% 0 DB.DBA.RDF_OBJ RO_VAL 1 997 49850% 0 0 0% 0 DB.DBA.RDF_DATATYPE RDF_DATATYPE 356905 1 0% 0 0 0% 0 DB.DBA.RDF_DATATYPE DB_DBA_RDF_DATATYPE_UNQC_RDT_TWOBYTE 356662 1 0% 0 0 0% 0 DB.DBA.RDF_LANGUAGE DB_DBA_RDF_LANGUAGE_UNQC_RL_TWOBYTE 30123 1 0% 0 0 0% 0 DB.DBA.LDLOCK LDLOCK 1 1 50% 0 0 0% 0 WS.WS.SYS_DAV_COL SYS_DAV_COL 882 1 0% 560 0 0% 0 WS.WS.SYS_DAV_COL SYS_DAV_COL_PARENT_ID 798 1 0% 559 0 0% 0 WS.WS.SYS_DAV_COL SYS_DAV_COL_ID 120 1 0% 0 0 0% 0 WS.WS.SYS_DAV_RES SYS_DAV_RES 443 210 47% 146 0 0% 0 WS.WS.SYS_DAV_RES SYS_DAV_RES_COL 12 3 23% 10 0 0% 0 WS.WS.SYS_DAV_RES SYS_DAV_RES_FULL_PATH 244 4 1% 22 0 0% 0 WS.WS.SYS_DAV_PROP SYS_DAV_PROP_ID 4 1 20% 0 0 0% 0 WS.WS.SYS_DAV_RES_TYPES SYS_DAV_RES_TYPES 843 5 0% 10 0 0% 0 DB.DBA.HTTP_PATH HTTP_PATH 30 1 3% 17 0 0% 0 WS.WS.RLOG_SYS_DAV_RES RLOG_SYS_DAV_RES 24 6 24% 22 0 0% 0 Hash indexes 81 Rows. -- 8 msec. ============ OpenLink Virtuoso VDB Server Version 07.10.3209-pthreads for Darwin as of Apr 22 2014 (Personal Edition, 10 connections) Started on: 2014-10-30 12:28 GMT-4 CPU%: 173.95 Database Status: File size 0, 85504 pages, 36963 free. 170000 buffers, 28364 used, 2 dirty 0 wired down, repl age 0 0 w. io 3 w/crsr. Disk Usage: 26478 reads avg 0 msec, 0% r 0% w last 5 s, 69542 writes flush 49.11 MB, 168 read ahead, batch = 125. Autocompact 425 in 275 out, 35% saved col ac: 70265 in 25% saved. Gate: 456 2nd in reads, 0 gate write waits, 0 in while read 0 busy scrap. Log = virtuoso.trx, 1514 bytes VDB: 0 exec 0 fetch 0 transact 0 error 42568 pages have been changed since last backup (in checkpoint state) Current backup timestamp: 0x0000-0x00-0x00 Last backup date: unknown Clients: 3 connects, max 1 concurrent RPC: 134 calls, -1 pending, 1 max until now, 0 queued, 0 burst reads (0%), 0 second 10M large, 49M max Checkpoint Remap 5928 pages, 0 mapped back. 5 s atomic time. DB master 85504 total 36963 free 5928 remap 2 mapped back temp 1024 total 1019 free Lock Status: 0 deadlocks of which 0 2r1w, 168 waits, Currently 3 threads running 0 threads waiting 0 threads in vdb. Pending: Client 1111:3: Account: dba, 7732 bytes in, 191570 bytes out, 1 stmts. PID: 14297, OS: unix, Application: unknown, IP#: 127.0.0.1 Transaction status: PENDING, 1 threads. Locks: Running Statements: Time (msec) Text 8 status('rhck') Replication Status: Server db-HOSTNAMEREPLACEME. db-HOSTNAMEREPLACEME db-HOSTNAMEREPLACEME 0 OFF. Index Usage: Table Index Touches Reads Miss Locks Waits W n-dead DB.DBA.VSPX_SESSION VSPX_SESSION 16 1 5% 12 0 0% 0 WS.WS.SYS_DAV_QUEUE SYS_DAV_QUEUE 1360 1 0% 9904 168 1% 0 WS.WS.SYS_DAV_QUEUE_LCK SYS_DAV_QUEUE_LCK 1717 1 0% 5148 0 0% 0 VAD.DBA.VAD_REGISTRY VAD_REGISTRY 455 6 1% 0 0 0% 0 VAD.DBA.VAD_REGISTRY VAD_REGISTRY_CHDIR 1123 3 0% 0 0 0% 0 VAD.DBA.VAD_REGISTRY VAD_REGISTRY_KEY 726 3 0% 0 0 0% 0 VAD.DBA.VAD_HELP VAD_HELP 46 1 2% 46 0 0% 0 PUMP.DBA.DBPUMP_HELP DBPUMP_HELP 88 1 1% 0 0 0% 0 DB.DBA.RDF_PREFIX RDF_PREFIX 19 1 5% 0 0 0% 0 DB.DBA.RDF_PREFIX DB_DBA_RDF_PREFIX_UNQC_RP_ID 280 1 0% 0 0 0% 0 DB.DBA.RDF_IRI RDF_IRI 1881190 2421 0% 13 0 0% 0 DB.DBA.RDF_IRI DB_DBA_RDF_IRI_UNQC_RI_ID 6883934 2372 0% 6 0 0% 0 DB.DBA.RDF_QUAD RDF_QUAD 57798673 4002 0% 4541855 0 0% 0 DB.DBA.RDF_QUAD RDF_QUAD_SP 5522502 778 0% 0 0 0% 0 DB.DBA.RDF_QUAD RDF_QUAD_POGS 16956922 3019 0% 10657400 0 0% 0 DB.DBA.RDF_QUAD RDF_QUAD_GS 700769 90 0% 528680 0 0% 0 DB.DBA.RDF_QUAD RDF_QUAD_OP 140459 211 0% 0 0 0% 0 DB.DBA.RDF_OBJ RDF_OBJ 1797064 11545 0% 0 0 0% 0 DB.DBA.RDF_OBJ RO_VAL 1 997 49850% 0 0 0% 0 DB.DBA.RDF_DATATYPE RDF_DATATYPE 356905 1 0% 0 0 0% 0 DB.DBA.RDF_DATATYPE DB_DBA_RDF_DATATYPE_UNQC_RDT_TWOBYTE 356662 1 0% 0 0 0% 0 DB.DBA.RDF_LANGUAGE DB_DBA_RDF_LANGUAGE_UNQC_RL_TWOBYTE 30123 1 0% 0 0 0% 0 DB.DBA.LDLOCK LDLOCK 1 1 50% 0 0 0% 0 WS.WS.SYS_DAV_COL SYS_DAV_COL 882 1 0% 560 0 0% 0 WS.WS.SYS_DAV_COL SYS_DAV_COL_PARENT_ID 798 1 0% 559 0 0% 0 WS.WS.SYS_DAV_COL SYS_DAV_COL_ID 120 1 0% 0 0 0% 0 WS.WS.SYS_DAV_RES SYS_DAV_RES 443 210 47% 146 0 0% 0 WS.WS.SYS_DAV_RES SYS_DAV_RES_COL 12 3 23% 10 0 0% 0 WS.WS.SYS_DAV_RES SYS_DAV_RES_FULL_PATH 244 4 1% 22 0 0% 0 WS.WS.SYS_DAV_PROP SYS_DAV_PROP_ID 4 1 20% 0 0 0% 0 WS.WS.SYS_DAV_RES_TYPES SYS_DAV_RES_TYPES 843 5 0% 10 0 0% 0 DB.DBA.HTTP_PATH HTTP_PATH 30 1 3% 17 0 0% 0 WS.WS.RLOG_SYS_DAV_RES RLOG_SYS_DAV_RES 24 6 24% 22 0 0% 0 Hash indexes 81 Rows. -- 9 msec. ============ OpenLink Virtuoso VDB Server Version 07.10.3209-pthreads for Darwin as of Apr 22 2014 (Personal Edition, 10 connections) Started on: 2014-10-30 12:28 GMT-4 CPU%: 174.65 Database Status: File size 0, 85504 pages, 36963 free. 170000 buffers, 28364 used, 2 dirty 0 wired down, repl age 0 0 w. io 2 w/crsr. Disk Usage: 26478 reads avg 0 msec, 0% r 0% w last 4 s, 69542 writes flush 49.11 MB, 168 read ahead, batch = 125. Autocompact 425 in 275 out, 35% saved col ac: 70265 in 25% saved. Gate: 456 2nd in reads, 0 gate write waits, 0 in while read 0 busy scrap. Log = virtuoso.trx, 1514 bytes VDB: 0 exec 0 fetch 0 transact 0 error 42568 pages have been changed since last backup (in checkpoint state) Current backup timestamp: 0x0000-0x00-0x00 Last backup date: unknown Clients: 3 connects, max 1 concurrent RPC: 142 calls, -1 pending, 1 max until now, 0 queued, 0 burst reads (0%), 0 second 10M large, 49M max Checkpoint Remap 5928 pages, 0 mapped back. 5 s atomic time. DB master 85504 total 36963 free 5928 remap 2 mapped back temp 1024 total 1019 free Lock Status: 0 deadlocks of which 0 2r1w, 168 waits, Currently 3 threads running 0 threads waiting 0 threads in vdb. Pending: Client 1111:3: Account: dba, 8281 bytes in, 216595 bytes out, 1 stmts. PID: 14297, OS: unix, Application: unknown, IP#: 127.0.0.1 Transaction status: PENDING, 1 threads. Locks: Running Statements: Time (msec) Text 7 status('rhck') Replication Status: Server db-HOSTNAMEREPLACEME. db-HOSTNAMEREPLACEME db-HOSTNAMEREPLACEME 0 OFF. Index Usage: Table Index Touches Reads Miss Locks Waits W n-dead DB.DBA.VSPX_SESSION VSPX_SESSION 16 1 5% 12 0 0% 0 WS.WS.SYS_DAV_QUEUE SYS_DAV_QUEUE 1360 1 0% 9904 168 1% 0 WS.WS.SYS_DAV_QUEUE_LCK SYS_DAV_QUEUE_LCK 1717 1 0% 5148 0 0% 0 VAD.DBA.VAD_REGISTRY VAD_REGISTRY 455 6 1% 0 0 0% 0 VAD.DBA.VAD_REGISTRY VAD_REGISTRY_CHDIR 1123 3 0% 0 0 0% 0 VAD.DBA.VAD_REGISTRY VAD_REGISTRY_KEY 726 3 0% 0 0 0% 0 VAD.DBA.VAD_HELP VAD_HELP 46 1 2% 46 0 0% 0 PUMP.DBA.DBPUMP_HELP DBPUMP_HELP 88 1 1% 0 0 0% 0 DB.DBA.RDF_PREFIX RDF_PREFIX 19 1 5% 0 0 0% 0 DB.DBA.RDF_PREFIX DB_DBA_RDF_PREFIX_UNQC_RP_ID 280 1 0% 0 0 0% 0 DB.DBA.RDF_IRI RDF_IRI 1881283 2421 0% 13 0 0% 0 DB.DBA.RDF_IRI DB_DBA_RDF_IRI_UNQC_RI_ID 6883995 2372 0% 6 0 0% 0 DB.DBA.RDF_QUAD RDF_QUAD 58139880 4002 0% 4541855 0 0% 0 DB.DBA.RDF_QUAD RDF_QUAD_SP 5530644 778 0% 0 0 0% 0 DB.DBA.RDF_QUAD RDF_QUAD_POGS 16957125 3019 0% 10657400 0 0% 0 DB.DBA.RDF_QUAD RDF_QUAD_GS 700769 90 0% 528680 0 0% 0 DB.DBA.RDF_QUAD RDF_QUAD_OP 140490 211 0% 0 0 0% 0 DB.DBA.RDF_OBJ RDF_OBJ 1800815 11545 0% 0 0 0% 0 DB.DBA.RDF_OBJ RO_VAL 1 997 49850% 0 0 0% 0 DB.DBA.RDF_DATATYPE RDF_DATATYPE 356905 1 0% 0 0 0% 0 DB.DBA.RDF_DATATYPE DB_DBA_RDF_DATATYPE_UNQC_RDT_TWOBYTE 356662 1 0% 0 0 0% 0 DB.DBA.RDF_LANGUAGE DB_DBA_RDF_LANGUAGE_UNQC_RL_TWOBYTE 30123 1 0% 0 0 0% 0 DB.DBA.LDLOCK LDLOCK 1 1 50% 0 0 0% 0 WS.WS.SYS_DAV_COL SYS_DAV_COL 882 1 0% 560 0 0% 0 WS.WS.SYS_DAV_COL SYS_DAV_COL_PARENT_ID 798 1 0% 559 0 0% 0 WS.WS.SYS_DAV_COL SYS_DAV_COL_ID 120 1 0% 0 0 0% 0 WS.WS.SYS_DAV_RES SYS_DAV_RES 443 210 47% 146 0 0% 0 WS.WS.SYS_DAV_RES SYS_DAV_RES_COL 12 3 23% 10 0 0% 0 WS.WS.SYS_DAV_RES SYS_DAV_RES_FULL_PATH 244 4 1% 22 0 0% 0 WS.WS.SYS_DAV_PROP SYS_DAV_PROP_ID 4 1 20% 0 0 0% 0 WS.WS.SYS_DAV_RES_TYPES SYS_DAV_RES_TYPES 843 5 0% 10 0 0% 0 DB.DBA.HTTP_PATH HTTP_PATH 30 1 3% 17 0 0% 0 WS.WS.RLOG_SYS_DAV_RES RLOG_SYS_DAV_RES 24 6 24% 22 0 0% 0 Hash indexes 81 Rows. -- 8 msec. 3. Second Run OpenLink Virtuoso VDB Server Version 07.10.3209-pthreads for Darwin as of Apr 22 2014 (Personal Edition, 10 connections) Started on: 2014-10-30 12:28 GMT-4 CPU%: 173.58 Database Status: File size 0, 85504 pages, 36963 free. 170000 buffers, 28364 used, 2 dirty 0 wired down, repl age 0 0 w. io 3 w/crsr. Disk Usage: 26478 reads avg 0 msec, 0% r 0% w last 21 s, 69542 writes flush 49.11 MB, 168 read ahead, batch = 125. Autocompact 425 in 275 out, 35% saved col ac: 70265 in 25% saved. Gate: 456 2nd in reads, 0 gate write waits, 0 in while read 0 busy scrap. Log = virtuoso.trx, 1514 bytes VDB: 0 exec 0 fetch 0 transact 0 error 42568 pages have been changed since last backup (in checkpoint state) Current backup timestamp: 0x0000-0x00-0x00 Last backup date: unknown Clients: 3 connects, max 1 concurrent RPC: 146 calls, -1 pending, 1 max until now, 0 queued, 0 burst reads (0%), 0 second 6M large, 49M max Checkpoint Remap 5928 pages, 0 mapped back. 5 s atomic time. DB master 85504 total 36963 free 5928 remap 2 mapped back temp 1024 total 1019 free Lock Status: 0 deadlocks of which 0 2r1w, 168 waits, Currently 2 threads running 0 threads waiting 0 threads in vdb. Pending: Client 1111:3: Account: dba, 8563 bytes in, 229495 bytes out, 1 stmts. PID: 14297, OS: unix, Application: unknown, IP#: 127.0.0.1 Transaction status: PENDING, 1 threads. Locks: Running Statements: Time (msec) Text 6 status('rhck') Replication Status: Server db-HOSTNAMEREPLACEME. db-HOSTNAMEREPLACEME db-HOSTNAMEREPLACEME 0 OFF. Index Usage: Table Index Touches Reads Miss Locks Waits W n-dead DB.DBA.VSPX_SESSION VSPX_SESSION 16 1 5% 12 0 0% 0 WS.WS.SYS_DAV_QUEUE SYS_DAV_QUEUE 1360 1 0% 9904 168 1% 0 WS.WS.SYS_DAV_QUEUE_LCK SYS_DAV_QUEUE_LCK 1717 1 0% 5148 0 0% 0 VAD.DBA.VAD_REGISTRY VAD_REGISTRY 455 6 1% 0 0 0% 0 VAD.DBA.VAD_REGISTRY VAD_REGISTRY_CHDIR 1123 3 0% 0 0 0% 0 VAD.DBA.VAD_REGISTRY VAD_REGISTRY_KEY 726 3 0% 0 0 0% 0 VAD.DBA.VAD_HELP VAD_HELP 46 1 2% 46 0 0% 0 PUMP.DBA.DBPUMP_HELP DBPUMP_HELP 88 1 1% 0 0 0% 0 DB.DBA.RDF_PREFIX RDF_PREFIX 19 1 5% 0 0 0% 0 DB.DBA.RDF_PREFIX DB_DBA_RDF_PREFIX_UNQC_RP_ID 280 1 0% 0 0 0% 0 DB.DBA.RDF_IRI RDF_IRI 1882163 2421 0% 13 0 0% 0 DB.DBA.RDF_IRI DB_DBA_RDF_IRI_UNQC_RI_ID 6986101 2372 0% 6 0 0% 0 DB.DBA.RDF_QUAD RDF_QUAD 58466347 4002 0% 4541855 0 0% 0 DB.DBA.RDF_QUAD RDF_QUAD_SP 5541932 778 0% 0 0 0% 0 DB.DBA.RDF_QUAD RDF_QUAD_POGS 17000146 3019 0% 10657400 0 0% 0 DB.DBA.RDF_QUAD RDF_QUAD_GS 700769 90 0% 528680 0 0% 0 DB.DBA.RDF_QUAD RDF_QUAD_OP 140764 211 0% 0 0 0% 0 DB.DBA.RDF_OBJ RDF_OBJ 1804630 11545 0% 0 0 0% 0 DB.DBA.RDF_OBJ RO_VAL 1 997 49850% 0 0 0% 0 DB.DBA.RDF_DATATYPE RDF_DATATYPE 356905 1 0% 0 0 0% 0 DB.DBA.RDF_DATATYPE DB_DBA_RDF_DATATYPE_UNQC_RDT_TWOBYTE 356662 1 0% 0 0 0% 0 DB.DBA.RDF_LANGUAGE DB_DBA_RDF_LANGUAGE_UNQC_RL_TWOBYTE 30123 1 0% 0 0 0% 0 DB.DBA.LDLOCK LDLOCK 1 1 50% 0 0 0% 0 WS.WS.SYS_DAV_COL SYS_DAV_COL 882 1 0% 560 0 0% 0 WS.WS.SYS_DAV_COL SYS_DAV_COL_PARENT_ID 798 1 0% 559 0 0% 0 WS.WS.SYS_DAV_COL SYS_DAV_COL_ID 120 1 0% 0 0 0% 0 WS.WS.SYS_DAV_RES SYS_DAV_RES 443 210 47% 146 0 0% 0 WS.WS.SYS_DAV_RES SYS_DAV_RES_COL 12 3 23% 10 0 0% 0 WS.WS.SYS_DAV_RES SYS_DAV_RES_FULL_PATH 244 4 1% 22 0 0% 0 WS.WS.SYS_DAV_PROP SYS_DAV_PROP_ID 4 1 20% 0 0 0% 0 WS.WS.SYS_DAV_RES_TYPES SYS_DAV_RES_TYPES 843 5 0% 10 0 0% 0 DB.DBA.HTTP_PATH HTTP_PATH 30 1 3% 17 0 0% 0 WS.WS.RLOG_SYS_DAV_RES RLOG_SYS_DAV_RES 24 6 24% 22 0 0% 0 Hash indexes 81 Rows. -- 8 msec. ============ OpenLink Virtuoso VDB Server Version 07.10.3209-pthreads for Darwin as of Apr 22 2014 (Personal Edition, 10 connections) Started on: 2014-10-30 12:28 GMT-4 CPU%: 174.61 Database Status: File size 0, 85504 pages, 36963 free. 170000 buffers, 28364 used, 2 dirty 0 wired down, repl age 0 0 w. io 3 w/crsr. Disk Usage: 26478 reads avg 0 msec, 0% r 0% w last 5 s, 69542 writes flush 49.11 MB, 168 read ahead, batch = 125. Autocompact 425 in 275 out, 35% saved col ac: 70265 in 25% saved. Gate: 456 2nd in reads, 0 gate write waits, 0 in while read 0 busy scrap. Log = virtuoso.trx, 1514 bytes VDB: 0 exec 0 fetch 0 transact 0 error 42568 pages have been changed since last backup (in checkpoint state) Current backup timestamp: 0x0000-0x00-0x00 Last backup date: unknown Clients: 3 connects, max 1 concurrent RPC: 152 calls, -1 pending, 1 max until now, 0 queued, 0 burst reads (0%), 0 second 10M large, 49M max Checkpoint Remap 5928 pages, 0 mapped back. 5 s atomic time. DB master 85504 total 36963 free 5928 remap 2 mapped back temp 1024 total 1019 free Lock Status: 0 deadlocks of which 0 2r1w, 168 waits, Currently 3 threads running 0 threads waiting 0 threads in vdb. Pending: Client 1111:3: Account: dba, 8986 bytes in, 248843 bytes out, 1 stmts. PID: 14297, OS: unix, Application: unknown, IP#: 127.0.0.1 Transaction status: PENDING, 1 threads. Locks: Running Statements: Time (msec) Text 9 status('rhck') Replication Status: Server db-HOSTNAMEREPLACEME. db-HOSTNAMEREPLACEME db-HOSTNAMEREPLACEME 0 OFF. Index Usage: Table Index Touches Reads Miss Locks Waits W n-dead DB.DBA.VSPX_SESSION VSPX_SESSION 16 1 5% 12 0 0% 0 WS.WS.SYS_DAV_QUEUE SYS_DAV_QUEUE 1360 1 0% 9904 168 1% 0 WS.WS.SYS_DAV_QUEUE_LCK SYS_DAV_QUEUE_LCK 1717 1 0% 5148 0 0% 0 VAD.DBA.VAD_REGISTRY VAD_REGISTRY 455 6 1% 0 0 0% 0 VAD.DBA.VAD_REGISTRY VAD_REGISTRY_CHDIR 1123 3 0% 0 0 0% 0 VAD.DBA.VAD_REGISTRY VAD_REGISTRY_KEY 726 3 0% 0 0 0% 0 VAD.DBA.VAD_HELP VAD_HELP 46 1 2% 46 0 0% 0 PUMP.DBA.DBPUMP_HELP DBPUMP_HELP 88 1 1% 0 0 0% 0 DB.DBA.RDF_PREFIX RDF_PREFIX 19 1 5% 0 0 0% 0 DB.DBA.RDF_PREFIX DB_DBA_RDF_PREFIX_UNQC_RP_ID 280 1 0% 0 0 0% 0 DB.DBA.RDF_IRI RDF_IRI 1882233 2421 0% 13 0 0% 0 DB.DBA.RDF_IRI DB_DBA_RDF_IRI_UNQC_RI_ID 6986163 2372 0% 6 0 0% 0 DB.DBA.RDF_QUAD RDF_QUAD 58712690 4002 0% 4541855 0 0% 0 DB.DBA.RDF_QUAD RDF_QUAD_SP 5549897 778 0% 0 0 0% 0 DB.DBA.RDF_QUAD RDF_QUAD_POGS 17000310 3019 0% 10657400 0 0% 0 DB.DBA.RDF_QUAD RDF_QUAD_GS 700769 90 0% 528680 0 0% 0 DB.DBA.RDF_QUAD RDF_QUAD_OP 140788 211 0% 0 0 0% 0 DB.DBA.RDF_OBJ RDF_OBJ 1808368 11545 0% 0 0 0% 0 DB.DBA.RDF_OBJ RO_VAL 1 997 49850% 0 0 0% 0 DB.DBA.RDF_DATATYPE RDF_DATATYPE 356905 1 0% 0 0 0% 0 DB.DBA.RDF_DATATYPE DB_DBA_RDF_DATATYPE_UNQC_RDT_TWOBYTE 356662 1 0% 0 0 0% 0 DB.DBA.RDF_LANGUAGE DB_DBA_RDF_LANGUAGE_UNQC_RL_TWOBYTE 30123 1 0% 0 0 0% 0 DB.DBA.LDLOCK LDLOCK 1 1 50% 0 0 0% 0 WS.WS.SYS_DAV_COL SYS_DAV_COL 882 1 0% 560 0 0% 0 WS.WS.SYS_DAV_COL SYS_DAV_COL_PARENT_ID 798 1 0% 559 0 0% 0 WS.WS.SYS_DAV_COL SYS_DAV_COL_ID 120 1 0% 0 0 0% 0 WS.WS.SYS_DAV_RES SYS_DAV_RES 443 210 47% 146 0 0% 0 WS.WS.SYS_DAV_RES SYS_DAV_RES_COL 12 3 23% 10 0 0% 0 WS.WS.SYS_DAV_RES SYS_DAV_RES_FULL_PATH 244 4 1% 22 0 0% 0 WS.WS.SYS_DAV_PROP SYS_DAV_PROP_ID 4 1 20% 0 0 0% 0 WS.WS.SYS_DAV_RES_TYPES SYS_DAV_RES_TYPES 843 5 0% 10 0 0% 0 DB.DBA.HTTP_PATH HTTP_PATH 30 1 3% 17 0 0% 0 WS.WS.RLOG_SYS_DAV_RES RLOG_SYS_DAV_RES 24 6 24% 22 0 0% 0 Hash indexes 81 Rows. -- 10 msec. ============ OpenLink Virtuoso VDB Server Version 07.10.3209-pthreads for Darwin as of Apr 22 2014 (Personal Edition, 10 connections) Started on: 2014-10-30 12:28 GMT-4 CPU%: 174.95 Database Status: File size 0, 85504 pages, 36963 free. 170000 buffers, 28364 used, 2 dirty 0 wired down, repl age 0 0 w. io 0 w/crsr. Disk Usage: 26478 reads avg 0 msec, 0% r 0% w last 4 s, 69542 writes flush 49.11 MB, 168 read ahead, batch = 125. Autocompact 425 in 275 out, 35% saved col ac: 70265 in 25% saved. Gate: 456 2nd in reads, 0 gate write waits, 0 in while read 0 busy scrap. Log = virtuoso.trx, 1514 bytes VDB: 0 exec 0 fetch 0 transact 0 error 42568 pages have been changed since last backup (in checkpoint state) Current backup timestamp: 0x0000-0x00-0x00 Last backup date: unknown Clients: 3 connects, max 1 concurrent RPC: 162 calls, -1 pending, 1 max until now, 0 queued, 0 burst reads (0%), 0 second 8M large, 49M max Checkpoint Remap 5928 pages, 0 mapped back. 5 s atomic time. DB master 85504 total 36963 free 5928 remap 2 mapped back temp 1024 total 1019 free Lock Status: 0 deadlocks of which 0 2r1w, 168 waits, Currently 3 threads running 0 threads waiting 0 threads in vdb. Pending: Client 1111:3: Account: dba, 9691 bytes in, 281092 bytes out, 1 stmts. PID: 14297, OS: unix, Application: unknown, IP#: 127.0.0.1 Transaction status: PENDING, 1 threads. Locks: Running Statements: Time (msec) Text 7 status('rhck') Replication Status: Server db-HOSTNAMEREPLACEME. db-HOSTNAMEREPLACEME db-HOSTNAMEREPLACEME 0 OFF. Index Usage: Table Index Touches Reads Miss Locks Waits W n-dead DB.DBA.VSPX_SESSION VSPX_SESSION 16 1 5% 12 0 0% 0 WS.WS.SYS_DAV_QUEUE SYS_DAV_QUEUE 1360 1 0% 9904 168 1% 0 WS.WS.SYS_DAV_QUEUE_LCK SYS_DAV_QUEUE_LCK 1717 1 0% 5148 0 0% 0 VAD.DBA.VAD_REGISTRY VAD_REGISTRY 455 6 1% 0 0 0% 0 VAD.DBA.VAD_REGISTRY VAD_REGISTRY_CHDIR 1123 3 0% 0 0 0% 0 VAD.DBA.VAD_REGISTRY VAD_REGISTRY_KEY 726 3 0% 0 0 0% 0 VAD.DBA.VAD_HELP VAD_HELP 46 1 2% 46 0 0% 0 PUMP.DBA.DBPUMP_HELP DBPUMP_HELP 88 1 1% 0 0 0% 0 DB.DBA.RDF_PREFIX RDF_PREFIX 19 1 5% 0 0 0% 0 DB.DBA.RDF_PREFIX DB_DBA_RDF_PREFIX_UNQC_RP_ID 280 1 0% 0 0 0% 0 DB.DBA.RDF_IRI RDF_IRI 1882355 2421 0% 13 0 0% 0 DB.DBA.RDF_IRI DB_DBA_RDF_IRI_UNQC_RI_ID 6994294 2372 0% 6 0 0% 0 DB.DBA.RDF_QUAD RDF_QUAD 59133421 4002 0% 4541855 0 0% 0 DB.DBA.RDF_QUAD RDF_QUAD_SP 5560792 778 0% 0 0 0% 0 DB.DBA.RDF_QUAD RDF_QUAD_POGS 17000509 3019 0% 10657400 0 0% 0 DB.DBA.RDF_QUAD RDF_QUAD_GS 700769 90 0% 528680 0 0% 0 DB.DBA.RDF_QUAD RDF_QUAD_OP 140814 211 0% 0 0 0% 0 DB.DBA.RDF_OBJ RDF_OBJ 1813392 11545 0% 0 0 0% 0 DB.DBA.RDF_OBJ RO_VAL 1 997 49850% 0 0 0% 0 DB.DBA.RDF_DATATYPE RDF_DATATYPE 356905 1 0% 0 0 0% 0 DB.DBA.RDF_DATATYPE DB_DBA_RDF_DATATYPE_UNQC_RDT_TWOBYTE 356662 1 0% 0 0 0% 0 DB.DBA.RDF_LANGUAGE DB_DBA_RDF_LANGUAGE_UNQC_RL_TWOBYTE 30123 1 0% 0 0 0% 0 DB.DBA.LDLOCK LDLOCK 1 1 50% 0 0 0% 0 WS.WS.SYS_DAV_COL SYS_DAV_COL 882 1 0% 560 0 0% 0 WS.WS.SYS_DAV_COL SYS_DAV_COL_PARENT_ID 798 1 0% 559 0 0% 0 WS.WS.SYS_DAV_COL SYS_DAV_COL_ID 120 1 0% 0 0 0% 0 WS.WS.SYS_DAV_RES SYS_DAV_RES 443 210 47% 146 0 0% 0 WS.WS.SYS_DAV_RES SYS_DAV_RES_COL 12 3 23% 10 0 0% 0 WS.WS.SYS_DAV_RES SYS_DAV_RES_FULL_PATH 244 4 1% 22 0 0% 0 WS.WS.SYS_DAV_PROP SYS_DAV_PROP_ID 4 1 20% 0 0 0% 0 WS.WS.SYS_DAV_RES_TYPES SYS_DAV_RES_TYPES 843 5 0% 10 0 0% 0 DB.DBA.HTTP_PATH HTTP_PATH 30 1 3% 17 0 0% 0 WS.WS.RLOG_SYS_DAV_RES RLOG_SYS_DAV_RES 24 6 24% 22 0 0% 0 Hash indexes 81 Rows. -- 8 msec. It'd be great if you could help interpret the status reports and recommend on how the performance could be tuned. Thank you so much for your help. Regards, Eliza From: Hugh Williams <hwilli...@openlinksw.com<mailto:hwilli...@openlinksw.com>> Date: Thursday, October 30, 2014 9:59 PM To: Eliza Chan <elc2...@med.cornell.edu<mailto:elc2...@med.cornell.edu>> Cc: "virtuoso-users@lists.sourceforge.net<mailto:virtuoso-users@lists.sourceforge.net>" <virtuoso-users@lists.sourceforge.net<mailto:virtuoso-users@lists.sourceforge.net>> Subject: Re: [Virtuoso-users] Ways to speeding up a large query Hi Eliza, The default indexes in place should suffice for most use cases, thus cause of the slow running query needs to be determined. How long does the query take to execute when cold ie first run and when warmed up ie on consecutive runs ? Please provide the output of running the "status();" command run from the isql command line tool What is the version of Virtuoso being used "virtuoso-t -?" ? it would also be useful to obtain the "profile" for the query to see whether the time is being spent compiling or executing the query, which be done with the "profile" function as detailed at: http://virtuoso.openlinksw.com/dataspace/doc/dav/wiki/Main/VirtTipsAndTricksAanalyzingSPARQLQuery http://docs.openlinksw.com/virtuoso/databaseadmsrv.html#readingqueryprofile Best Regards Hugh Williams Professional Services OpenLink Software, Inc. // http://www.openlinksw.com/ Weblog -- http://www.openlinksw.com/blogs/ LinkedIn -- http://www.linkedin.com/company/openlink-software/ Twitter -- http://twitter.com/OpenLink Google+ -- http://plus.google.com/100570109519069333827/ Facebook -- http://www.facebook.com/OpenLinkSoftware Universal Data Access, Integration, and Management Technology Providers On 30 Oct 2014, at 17:45, Eliza Chan <elc2...@med.cornell.edu<mailto:elc2...@med.cornell.edu>> wrote: Hi, I have a SPARQL query that took more than 25 sec to return with some results. Our database size is 700 MB, with about 2 GB of free memory. Our data are stored in multiple graphs. The virtuoso.ini file was configured as follows: NumberOfBuffers = 170000 MaxDirtyBuffers = 130000 MaxCheckpointRemap = 20000 However, the changes in the ini file didn't seem to improve the speed. Is there a way to improve the performance by changing the index scheme? I saw the instructions but not sure about the best index setting for our particular query. Please see below an example of our large query: PREFIX core: <http://vivoweb.org/ontology/core#<http://vivoweb.org/ontology/core#>> PREFIX rdfs: <http://www.w3.org/2000/01/rdf-schema#<http://www.w3.org/2000/01/rdf-schema#>> PREFIX bibo: <http://purl.org/ontology/bibo/<http://purl.org/ontology/bibo/>> PREFIX foaf: <http://xmlns.com/foaf/0.1/<http://xmlns.com/foaf/0.1/>> CONSTRUCT { <http://mydomain.edu/individual/<http://mydomain.edu/individual/>userid> <http://vivoweb.org/ontology/core#relatedBy> ?authorship . ?authorship a core:Authorship . ?authorship ?authorshipProperty ?authorshipValue . ?authorship core:relates ?infoResource . ?infoResource a <http://purl.obolibrary.org/<http://purl.obolibrary.org/>obo/IAO_0000030> . ?infoResource ?infoResourceProperty ?infoResourceValue . ?infoResource bibo:reproducedIn ?appearsInObj . ?infoResource core:publisher ?publisherObj . ?infoResource core:relatedBy ?editorship . ?editorship a core:Editorship . ?editorship core:relates ?editorObj . ?editorObj a foaf:Person . ?infoResource <http://purl.obolibrary.org/<http://purl.obolibrary.org/>obo/BFO_0000050> ?partOfObj . ?appearsInObj rdfs:label ?appearsIn . ?publisherObj rdfs:label ?publisher . ?editorObj rdfs:label ?editor . ?partOfObj rdfs:label ?partOf } WHERE { { <http://mydomain.edu/individual/userid<http://mydomain.edu/individual/userid>> <http://vivoweb.org/ontology/core#relatedBy> ?authorship . ?authorship a core:Authorship } UNION { <http://mydomain.edu/individual/<http://mydomain.edu/individual/>userid> <http://vivoweb.org/ontology/core#relatedBy> ?authorship . ?authorship a core:Authorship . ?authorship ?authorshipProperty ?authorshipValue } UNION { <http://mydomain.edu/individual/<http://mydomain.edu/individual/>userid> <http://vivoweb.org/ontology/core#relatedBy> ?authorship . ?authorship a core:Authorship . ?authorship core:relates ?infoResource . ?infoResource a <http://purl.obolibrary.org/obo/IAO_0000030<http://purl.obolibrary.org/obo/IAO_0000030>> . } UNION { <http://mydomain.edu/individual/<http://mydomain.edu/individual/>userid> <http://vivoweb.org/ontology/core#relatedBy> ?authorship . ?authorship a core:Authorship . ?authorship core:relates ?infoResource . ?infoResource a <http://purl.obolibrary.org/<http://purl.obolibrary.org/>obo/IAO_0000030> . ?infoResource ?infoResourceProperty ?infoResourceValue } UNION { <http://mydomain.edu/individual/<http://mydomain.edu/individual/>userid> <http://vivoweb.org/ontology/core#relatedBy> ?authorship . ?authorship a core:Authorship . ?authorship core:relates ?infoResource . ?infoResource a <http://purl.obolibrary.org/<http://purl.obolibrary.org/>obo/IAO_0000030> . ?infoResource bibo:reproducedIn ?appearsInObj . ?appearsInObj rdfs:label ?appearsIn } UNION { <http://mydomain.edu/individual/<http://mydomain.edu/individual/>userid> <http://vivoweb.org/ontology/core#relatedBy> ?authorship . ?authorship a core:Authorship . ?authorship core:relates ?infoResource . ?infoResource a <http://purl.obolibrary.org/<http://purl.obolibrary.org/>obo/IAO_0000030> . ?infoResource core:publisher ?publisherObj . ?publisherObj rdfs:label ?publisher } UNION { <http://mydomain.edu/individual/<http://mydomain.edu/individual/>userid> <http://vivoweb.org/ontology/core#relatedBy> ?authorship . ?authorship a core:Authorship . ?authorship core:relates ?infoResource . ?infoResource a <http://purl.obolibrary.org/<http://purl.obolibrary.org/>obo/IAO_0000030> . ?infoResource core:relatedBy ?editorship . ?editorship a core:Editorship . ?editorship core:relates ?editorObj . ?editorObj a foaf:Person . ?editorObj rdfs:label ?editor } UNION { <http://mydomain.edu/individual/<http://mydomain.edu/individual/>userid> <http://vivoweb.org/ontology/core#relatedBy> ?authorship . ?authorship a core:Authorship . ?authorship core:relates ?infoResource . ?infoResource a <http://purl.obolibrary.org/obo/IAO_0000030<http://purl.obolibrary.org/obo/IAO_0000030>> . ?infoResource <http://purl.obolibrary.org/<http://purl.obolibrary.org/>obo/BFO_0000050> ?partOfObj . ?partOfObj rdfs:label ?partOf } } Unfortunately I cannot modify the query because it's part of the application. So I can only modify any possible settings in Virtuoso to improve the performance. Any suggestion is greatly appreciated. Thank you so much for your help. Regards, Eliza ------------------------------------------------------------------------------ _______________________________________________ Virtuoso-users mailing list Virtuoso-users@lists.sourceforge.net<mailto:Virtuoso-users@lists.sourceforge.net> https://lists.sourceforge.net/lists/listinfo/virtuoso-users
------------------------------------------------------------------------------
_______________________________________________ Virtuoso-users mailing list Virtuoso-users@lists.sourceforge.net https://lists.sourceforge.net/lists/listinfo/virtuoso-users