[Virtuoso-users] How to load a billion of triples

2008-05-06 Thread saad saad
Hello, To test Virtuoso Open Source 5.0.5 performances, I want to load a billion of triples (which are stored in RDF files). And I don't have any idea about the best and the fast way to do this. In fact, I know how I can generate a billion of triples, but I am looking for the fast way to load

Re: [Virtuoso-users] huge file loading

2008-05-06 Thread Erick Antezana
Hi Ivan, thanks for the suggestions. I launched about two hours ago once again the loading process. It has run for about 2 hours. and, after the first 5 minutes the load of the system reached 40! It just stopped again. I set the number of buffers to 125 (I have 16GB fo RAM) and I used DB

Re: [Virtuoso-users] huge file loading

2008-05-06 Thread Ivan Mikhailov
Eric, I've loaded Uniprot (both reviewed and not-reviewed parts, all 14.2Gb) into a database that was some about 5Gb before the loading. I've used DB.DBA.RDF_LOAD_RDFXML_MT without any splitting into parts. It was a bit slower than I've expected but there were no hangs. I've set checkpoint_interva

[Virtuoso-users] huge file loading

2008-05-06 Thread Erick Antezana
Hello, I am trying to upload a very huge file (uniprot.rdf) Its size is about 45GB!! (the compressed file (3.5GB) can be found in: ftp://ftp.uniprot.org/pub/databases/uniprot/current_release/rdf/). I have adapted a bit the virtuoso.ini file setting the striping options (about 100GB reserved