Hi Armin,
I know you have read the performance tuning guide below but have you
also read the performance diagnostic one below:
http://docs.openlinksw.com/virtuoso/rdfperformancetuning.html
http://docs.openlinksw.com/virtuoso/databaseadmsrv.html#perfdiag
Looking at your server configuration setting the values for
NumberOfBuffers and MaxCheckpointRemap seem reasonable.
Can you please provide the following information for one of the
problem queries using the command line isql tool:
1. The explain() output for one of the queries which provide details
of the SQL statement the SPARQL query is broken down to:
http://docs.openlinksw.com/virtuoso/fn_explain.html
2. The indexes on the RDF_QUAD table by running:
statistics RDF_QUAD
3. The server status() output after running one of these queries which
will provide information on the NumberOfBuffers allocated and
NumberOfBuffers used
How does the performance of one of these problem queries compare
running against your servers SPARQL endpoint and the live dbpedia
instance at http://dbpedia.org/sparql
Adding more memory will ultimately increase performance if the server
is reconfigured to make use of it, but we should first determine if
your server is configured correctly in its current state ...
Best Regards
Hugh Williams
Professional Services
OpenLink Software
Web: http://www.openlinksw.com
Support: http://support.openlinksw.com
Forums: http://boards.openlinksw.com/support
On 5 Oct 2009, at 14:08, Armin Nagel wrote:
Hi,
I loaded dbpedia 3.3 en + de into virtuoso 5.0.11 os successfully.
DBsize is 27Gb. My box is a Suse 11.1 64 bit with 4core Intel Cpu and
8GB Ram and 1 HDD.
Queries are very slow, I need some tips to speed up.
Examplequerie:
PREFIX rdfs: <http://www.w3.org/2000/01/rdf-schema#>
PREFIX d_owl: <http://dbpedia.org/ontology/>
PREFIX foaf: <http://xmlns.com/foaf/0.1/>
SELECT ?s_label count(?linked_res) as ?rank
WHERE {
?s a d_owl:Person .
?s rdfs:label ?s_label .
FILTER (lang(?s_label)="de")
### retrieve rank ###
?linked_res ?link ?s .
}
ORDER BY DESC (?rank)
LIMIT 100
OFFSET 0
Here are my ini settings:
[Database]
DatabaseFile = data/dbpedia3_3.db
ErrorLogFile = data/dbpedia3_3.log
LockFile = data/dbpedia3_3.lck
TransactionFile = data/dbpedia3_3.trx
xa_persistent_file = data/dbpedia3_3.pxa
ErrorLogLevel = 7
FileExtend = 200
MaxCheckpointRemap = 1000000
Striping = 0
TempStorage = TempDatabase
[Parameters]
ServerPort = 1111
LiteMode = 0
DisableUnixSocket = 1
DisableTcpSocket = 0
;SSLServerPort = 2111
;SSLCertificate = cert.pem
;SSLPrivateKey = pk.pem
;X509ClientVerify = 0
;X509ClientVerifyDepth = 0
;X509ClientVerifyCAFile = ca.pem
ServerThreads = 20
CheckpointInterval = 600
O_DIRECT = 0
NumberOfBuffers = 700000
MaxDirtyBuffers = 320000
CaseMode = 2
MaxStaticCursorRows = 5000
CheckpointAuditTrail = 0
AllowOSCalls = 0
SchedulerInterval = 10
DirsAllowed = .,
ThreadCleanupInterval = 0
ThreadThreshold = 10
ResourcesCleanupInterval = 0
FreeTextBatchSize = 100000
SingleCPU = 0
VADInstallDir = ..
PrefixResultNames = 0
RdfFreeTextRulesSize = 100
IndexTreeMaps = 256
DefaultIsolation = 2
StopCompilerWhenXOverRunTime = 1
MaxMemPoolSize = 0
What can I do with my hardware, more ram and a stripe set of hdd`s?
what
will give most effect?
Can I tune the parameters or build indices by myself? What are the
positives if I build some extra indices? What indices creates virtuoso
automaticly?
I read this http://docs.openlinksw.com/virtuoso/rdfperformancetuning.html
and now I think my box is a little to small for this massive data.
thanks for help
--
Armin Nagel
Softwareentwickler
neofonie
Technologieentwicklung und
Informationsmanagement GmbH
Robert-Koch-Platz 4
10115 Berlin
fon: +49.30 24627 257
fax: +49.30 24627 120
armin.na...@neofonie.de
http://www.neofonie.de
Handelsregister
Berlin-Charlottenburg: HRB 67460
Geschaeftsfuehrung
Helmut Hoffer von Ankershoffen
(Sprecher der Geschaeftsfuehrung)
Nurhan Yildirim
________________________________
Die erste Web 2.0 Suchmaschine jetzt auf http://www.wefind.de .
Unterwegs immer bestens informiert mit WeFind Mobile für iPhone und
jetzt auch mit WeFind Mobile für Android: kostenloser Download im
iTunes
AppStore und im Android Market.
------------------------------------------------------------------------------
Come build with us! The BlackBerry® Developer Conference in SF, CA
is the only developer event you need to attend this year. Jumpstart
your
developing skills, take BlackBerry mobile applications to market and
stay
ahead of the curve. Join us from November 9-12, 2009. Register
now!
http://p.sf.net/sfu/devconf
_______________________________________________
Virtuoso-users mailing list
Virtuoso-users@lists.sourceforge.net
https://lists.sourceforge.net/lists/listinfo/virtuoso-users
