Andrejs,
On 9 Apr 2014, at 12:17, Andrejs Abele wrote:
> Hi Hugh,
> 1. yes it was client side loader that crashes
[Hugh] Why does the java client app crash if all it is really doing is activate
the "rdf_loader_run()" function on the Virtuoso server ?
> 2. we run only one loader, to keep our
Hi Hugh,
1. yes it was client side loader that crashes
2. we run only one loader, to keep our client side loader as simple as
possible. But based on your recommendation we increased number of loaders
and speed improved a little bit.
3. Cloud you pleas clarify what do you mean with swapping? Does
Andrejs,
On 8 Apr 2014, at 22:36, Andrejs Abele wrote:
> Hi Hugh,
> Thank you for your comments.
> When the loader fails, I continue from the point it failed.
> I want to clarify, that virtuoso server, was not crashing, but the loader.
[Hugh] So it is your client side loader program that is cra
Hi Hugh,
Thank you for your comments.
When the loader fails, I continue from the point it failed.
I want to clarify, that virtuoso server, was not crashing, but the loader.
Our custom loader uses only one thread. We submit one file at time,
that contains 10 000 000 triples
When I increased waiting
Hi Andrejs,
So you are basically saying the Freebase RDF dataset dump has been split into
files of 10,000,000 triples each which you are loading with the Virtuoso RDF
Bulk loader (rdf_loader_run) under the control of a Java application, and 120
ie 1.2 billion triples of the datasets are loadi
Read 300 IOPS 120 MB/s 180 MB/s
Write 1500 IOPS 90 MB/s 120 MB/s
Hi,
I'm running virtuoso 07.10.3207 in google cloud.
Instance : 8VCPU, 30 GB memmory (n1-standard-8), 10 GB boot disk + 2x 1000
GB storage disks.
Using batch loading, I'm trying to load freebase.
One batch contains 10 000 000 tripl
