Hi Alexy and Hugh,
As a reference point, I recently loaded about 65 million triples in about
12 minutes with Virtuoso 7. This was done on a Ubuntu 13.04 EC2 instance,
an m2.4xlarge (68 GB RAM, 8 CPUs), running on a 100GB EBS volume. I
installed the virtuoso-opensource develop/7 branch from github, following
the instruction at https://github.com/openlink/virtuoso-opensource. Then I
allotted 24 GB to Virtuoso 7:
;; Uncomment next two lines if there is 24 GB system memory free
NumberOfBuffers = 2040000
MaxDirtyBuffers = 1500000
I am using the bulk loading functions ld_dir() and rdf_loader_run() to load
the data, which is mostly n-triples and some rdf/xml files. N-triples
files with 500,000 triples take about 5 seconds to load using the bulk
loader.
Hope that helps,
Todd
On Fri, Jun 28, 2013 at 9:52 AM, Hugh Williams <hwilli...@openlinksw.com>wrote:
> Hi Alexey,
>
> Yes, you can start from there also ...
>
> Best Regards
> Hugh Williams
> Professional Services
> OpenLink Software, Inc. // http://www.openlinksw.com/
> Weblog -- http://www.openlinksw.com/blogs/
> LinkedIn -- http://www.linkedin.com/company/openlink-software/
> Twitter -- http://twitter.com/OpenLink
> Google+ -- http://plus.google.com/100570109519069333827/
> Facebook -- http://www.facebook.com/OpenLinkSoftware
> Universal Data Access, Integration, and Management Technology Providers
>
> On 28 Jun 2013, at 14:39, Alexey Zakhlestin <indey...@gmail.com> wrote:
>
>
> On 28.06.2013, at 17:40, Hugh Williams <hwilli...@openlinksw.com> wrote:
>
> Hi Alexey,
>
> Can you try setting "DefaultIsolation = 2" in the "[Parameters]" section
> of the INI file, restart the server and repeat the load test with an empty
> database. DefaultIsolation = 2 sets the isolation level to read committed
> which minimises occurrence of locks during read/write operations, as
> detailed at :
>
>
> http://wikis.openlinksw.com/dataspace/owiki/wiki/VirtuosoWikiWeb/ChangeVirtuosoSDefaultTransactionIsolationLevel
>
>
> Does it have to be absolutely empty?
> Can I start from my pre-import snapshot?
>
>
>
>
> ------------------------------------------------------------------------------
> This SF.net email is sponsored by Windows:
>
> Build for Windows Store.
>
> http://p.sf.net/sfu/windows-dev2dev
> _______________________________________________
> Virtuoso-users mailing list
> Virtuoso-users@lists.sourceforge.net
> https://lists.sourceforge.net/lists/listinfo/virtuoso-users
>
>
--
Todd DeLuca
Scientific Programmer
Wall Lab, CBMI, Harvard Medical School
http://todddeluca.com
http://wall.hms.harvard.edu/
------------------------------------------------------------------------------
This SF.net email is sponsored by Windows:
Build for Windows Store.
http://p.sf.net/sfu/windows-dev2dev
_______________________________________________
Virtuoso-users mailing list
Virtuoso-users@lists.sourceforge.net
https://lists.sourceforge.net/lists/listinfo/virtuoso-users
