Re: [Virtuoso-users] RAM requirements

2015-01-08 Thread Hugh Williams
Hi Balazs, With Virtuoso 7 you get 3 times the compression running in Column Store mode, which the RDF Quad Store runs in by default, so 10 bytes per Quad on average … Best Regards Hugh Williams Professional Services OpenLink Software, Inc. // http://www.openlinksw.com/ Weblog

Re: [Virtuoso-users] RAM requirements

2015-01-08 Thread Balazs Varhegyi
Hi Hugh, Would like to know if the 31bytes/triplet is true for Virtuoso 7 too? Thank you in advance, Balazs Varhegyi -- Dive into the World of Parallel Programming! The Go Parallel Website, sponsored by Intel and develop

Re: [Virtuoso-users] RAM requirements

2013-06-28 Thread Hugh Williams
Hi Alexey, Can you also please provide the output of running the following commands: sysctl -a;;; provides details on system cpu/cores, ram & hdd etc. df -T;;; provides details of file system types in use and a

Re: [Virtuoso-users] RAM requirements

2013-06-28 Thread Hugh Williams
Hi Alexey, Can you try to an empty database please ? Best Regards Hugh Williams Professional Services OpenLink Software, Inc. // http://www.openlinksw.com/ Weblog -- http://www.openlinksw.com/blogs/ LinkedIn -- http://www.linkedin.com/company/openlink-software/ Twitter -- htt

Re: [Virtuoso-users] RAM requirements

2013-06-28 Thread Todd DeLuca
Hi Alexy and Hugh, As a reference point, I recently loaded about 65 million triples in about 12 minutes with Virtuoso 7. This was done on a Ubuntu 13.04 EC2 instance, an m2.4xlarge (68 GB RAM, 8 CPUs), running on a 100GB EBS volume. I installed the virtuoso-opensource develop/7 branch from gith

Re: [Virtuoso-users] RAM requirements

2013-06-28 Thread Alexey Zakhlestin
On 28.06.2013, at 17:40, Hugh Williams wrote: > Hi Alexey, > > Can you try setting "DefaultIsolation = 2" in the "[Parameters]" section of > the INI file, restart the server and repeat the load test with an empty > database. DefaultIsolation = 2 sets the isolation level to read committed >

Re: [Virtuoso-users] RAM requirements

2013-06-28 Thread Alexey Zakhlestin
On 28.06.2013, at 17:40, Hugh Williams wrote: > Hi Alexey, > > Can you try setting "DefaultIsolation = 2" in the "[Parameters]" section of > the INI file, restart the server and repeat the load test with an empty > database. DefaultIsolation = 2 sets the isolation level to read committed >

Re: [Virtuoso-users] RAM requirements

2013-06-28 Thread Hugh Williams
Hi Alexey, Yes, you can start from there also ... Best Regards Hugh Williams Professional Services OpenLink Software, Inc. // http://www.openlinksw.com/ Weblog -- http://www.openlinksw.com/blogs/ LinkedIn -- http://www.linkedin.com/company/openlink-software/ Twitter -- http:/

Re: [Virtuoso-users] RAM requirements

2013-06-28 Thread Hugh Williams
Hi Alexey, Can you try setting "DefaultIsolation = 2" in the "[Parameters]" section of the INI file, restart the server and repeat the load test with an empty database. DefaultIsolation = 2 sets the isolation level to read committed which minimises occurrence of locks during read/write operati

Re: [Virtuoso-users] RAM requirements

2013-06-28 Thread Alexey Zakhlestin
On 28.06.2013, at 17:00, Hugh Williams wrote: > Hi Alexey, > > How much memory is on your server as I thought you said it was 2GB > previously, yet I see your buffers are set to 200 from the status output: > > 200 buffers, 1918813 used > > Which is way to high for a 2GB RAM system wh

Re: [Virtuoso-users] RAM requirements

2013-06-28 Thread Hugh Williams
Hi Alexey, How much memory is on your server as I thought you said it was 2GB previously, yet I see your buffers are set to 200 from the status output: 200 buffers, 1918813 used Which is way to high for a 2GB RAM system which should have about 17 allocated as detailed at:

Re: [Virtuoso-users] RAM requirements

2013-06-28 Thread Alexey Zakhlestin
On 28.06.2013, at 2:26, Hugh Williams wrote: > The ld_meter function can also be used for monitoring the process of the bulk > loader operation including load rates as detailed at: > > > http://virtuoso.openlinksw.com/dataspace/doc/dav/wiki/Main/VirtTipsAndTricksGuideLDMeterUtility Her

Re: [Virtuoso-users] RAM requirements

2013-06-28 Thread Alexey Zakhlestin
On 28.06.2013, at 2:26, Hugh Williams wrote: > Hi Alexey, > > We need to see the status(''); output either for the v6 or v7 instance being > used. Here's the recent status(); https://gist.github.com/indeyets/799ba18f1da5ac77354f Import was running for 12 hours approximately. CPU load was gre

Re: [Virtuoso-users] RAM requirements

2013-06-27 Thread Hugh Williams
Hi Alexey, We need to see the status(''); output either for the v6 or v7 instance being used. Also, where did you see these "rollback" messages ? Using the Bulk loader the load_list table shows the status of the load of datasets and any errors reported loading them to you see any ? The ld_

Re: [Virtuoso-users] RAM requirements

2013-06-27 Thread Alexey Zakhlestin
On 28.06.2013, at 0:39, Hugh Williams wrote: > Hi Alexey, > > For Virtuoso 6 the average size of a triple is about 31bytes, with the > default index schema as detailed in the followng FAQ document: > > > http://virtuoso.openlinksw.com/dataspace/doc/dav/wiki/Main/VOSVirtuoso6FAQ#What%20

Re: [Virtuoso-users] RAM requirements

2013-06-27 Thread Hugh Williams
Hi Alexey, For Virtuoso 6 the average size of a triple is about 31bytes, with the default index schema as detailed in the followng FAQ document: http://virtuoso.openlinksw.com/dataspace/doc/dav/wiki/Main/VOSVirtuoso6FAQ#What%20is%20the%20storage%20cost%20per%20triple? What method are y

[Virtuoso-users] RAM requirements

2013-06-27 Thread Alexey Zakhlestin
Is there some approximate table on reasonable RAM-requirements depending on number of triples? I see that import of data has almost stopped after 30M triples on server with 2Gb of RAM running latest Virtuoso/6. (NumberOfBuffers and MaxDirtyBuffers are set per http://virtuoso.openlinksw.com/dataspa