Hi Hugh,
1. yes it was client side loader that crashes
2. we run only one loader, to keep our client side loader as simple as
possible. But based on your recommendation we increased number of loaders
and speed improved a little bit.
3. Cloud you pleas clarify what do you mean with swapping? Does
Hi Hugh,
Thank you for your comments.
When the loader fails, I continue from the point it failed.
I want to clarify, that virtuoso server, was not crashing, but the loader.
Our custom loader uses only one thread. We submit one file at time,
that contains 10 000 000 triples
When I increased waiting
Read 300 IOPS 120 MB/s 180 MB/s
Write 1500 IOPS 90 MB/s 120 MB/s
Hi,
I'm running virtuoso 07.10.3207 in google cloud.
Instance : 8VCPU, 30 GB memmory (n1-standard-8), 10 GB boot disk + 2x 1000
GB storage disks.
Using batch loading, I'm trying to load freebase.
One batch contains 10 000 000 tripl
