Hi,
I loaded dbpedia 3.3 en + de into virtuoso 5.0.11 os successfully.
DBsize is 27Gb. My box is a Suse 11.1 64 bit with 4core Intel Cpu and
8GB Ram and 1 HDD.
Queries are very slow, I need some tips to speed up.
Examplequerie:
PREFIX rdfs: <http://www.w3.org/2000/01/rdf-schema#>
PREFIX d_owl: <http://dbpedia.org/ontology/>
PREFIX foaf: <http://xmlns.com/foaf/0.1/>
SELECT ?s_label count(?linked_res) as ?rank
WHERE {
?s a d_owl:Person .
?s rdfs:label ?s_label .
FILTER (lang(?s_label)="de")
### retrieve rank ###
?linked_res ?link ?s .
}
ORDER BY DESC (?rank)
LIMIT 100
OFFSET 0
Here are my ini settings:
[Database]
DatabaseFile = data/dbpedia3_3.db
ErrorLogFile = data/dbpedia3_3.log
LockFile = data/dbpedia3_3.lck
TransactionFile = data/dbpedia3_3.trx
xa_persistent_file = data/dbpedia3_3.pxa
ErrorLogLevel = 7
FileExtend = 200
MaxCheckpointRemap = 1000000
Striping = 0
TempStorage = TempDatabase
[Parameters]
ServerPort = 1111
LiteMode = 0
DisableUnixSocket = 1
DisableTcpSocket = 0
;SSLServerPort = 2111
;SSLCertificate = cert.pem
;SSLPrivateKey = pk.pem
;X509ClientVerify = 0
;X509ClientVerifyDepth = 0
;X509ClientVerifyCAFile = ca.pem
ServerThreads = 20
CheckpointInterval = 600
O_DIRECT = 0
NumberOfBuffers = 700000
MaxDirtyBuffers = 320000
CaseMode = 2
MaxStaticCursorRows = 5000
CheckpointAuditTrail = 0
AllowOSCalls = 0
SchedulerInterval = 10
DirsAllowed = .,
ThreadCleanupInterval = 0
ThreadThreshold = 10
ResourcesCleanupInterval = 0
FreeTextBatchSize = 100000
SingleCPU = 0
VADInstallDir = ..
PrefixResultNames = 0
RdfFreeTextRulesSize = 100
IndexTreeMaps = 256
DefaultIsolation = 2
StopCompilerWhenXOverRunTime = 1
MaxMemPoolSize = 0
What can I do with my hardware, more ram and a stripe set of hdd`s? what
will give most effect?
Can I tune the parameters or build indices by myself? What are the
positives if I build some extra indices? What indices creates virtuoso
automaticly?
I read this http://docs.openlinksw.com/virtuoso/rdfperformancetuning.html
and now I think my box is a little to small for this massive data.
thanks for help
--
Armin Nagel
Softwareentwickler
neofonie
Technologieentwicklung und
Informationsmanagement GmbH
Robert-Koch-Platz 4
10115 Berlin
fon: +49.30 24627 257
fax: +49.30 24627 120
armin.na...@neofonie.de
http://www.neofonie.de
Handelsregister
Berlin-Charlottenburg: HRB 67460
Geschaeftsfuehrung
Helmut Hoffer von Ankershoffen
(Sprecher der Geschaeftsfuehrung)
Nurhan Yildirim
________________________________
Die erste Web 2.0 Suchmaschine jetzt auf http://www.wefind.de .
Unterwegs immer bestens informiert mit WeFind Mobile für iPhone und
jetzt auch mit WeFind Mobile für Android: kostenloser Download im iTunes
AppStore und im Android Market.