[Virtuoso-users] Moving data between Virtuoso instances

2014-05-22 Thread Nicola Vitucci
Hi all, in one of the last messages Hugh suggested to use the dumping/loading scripts as explained here: http://virtuoso.openlinksw.com/dataspace/doc/dav/wiki/Main/VirtRDFDatasetDump to move data between Virtuoso instances. When the database is "big" though this can be less practical than just m

Re: [Virtuoso-users] Using column store structure for exiting data

2014-05-22 Thread Bart Vandewoestyne
On 2014-05-18 16:11, Hugh Williams wrote: > Hi Sumit > > Ah, didn't realise you started with a v6 row store database, thus how > did you upgrade to v7 ? > > As if you simply check pointed and restarted the v6 database with a v7 > binary then it would be automatically upgraded but all the tables > i

Re: [Virtuoso-users] Using column store structure for exiting data

2014-05-22 Thread Bart Vandewoestyne
On 2014-05-22 14:33, Bart Vandewoestyne wrote: > > Hugh and list, > > I just wanted to report my findings with this first option: > > I have a virtuoso.db file of 142 GB and it took one night to dump it to > .ttl and .graph files. The .ttl and .graph files together take 242 GB. > > Re-loading the

Re: [Virtuoso-users] Using column store structure for exiting data

2014-05-22 Thread Kingsley Idehen
On 5/22/14 8:33 AM, Bart Vandewoestyne wrote: On 2014-05-18 16:11, Hugh Williams wrote: >Hi Sumit > >Ah, didn't realise you started with a v6 row store database, thus how >did you upgrade to v7 ? > >As if you simply check pointed and restarted the v6 database with a v7 >binary then it would be a

Re: [Virtuoso-users] Using column store structure for exiting data

2014-05-22 Thread Kingsley Idehen
On 5/22/14 9:50 AM, Kingsley Idehen wrote: Is it normal that re-loading the data takes significantly more time than dumping it? Regards, Bart Yes, for the following reasons: 1. Exporting is just about writing to files 2. Importing is about indexing and writing to internal identifiers (named

Re: [Virtuoso-users] Using column store structure for exiting data

2014-05-22 Thread Purohit, Sumit
Thanks Kingsley and entire community for this meaning full discussion, After this discussion, I have 2 follow-up question. 1. How do I create a new empty database in my existing virtuoso and start loading RDF data into that by default. I think this way I will be using column-wise structure. 2.

Re: [Virtuoso-users] Using column store structure for exiting data

2014-05-22 Thread Hugh Williams
Hi Sumit, Question 1: When you start a new/empty Virtuoso 7 database the initialisation process automatically creates the RDF_QUAD table and indexes in column-wise mode as this is considered to be the best default for RDF work loads, mainly due to the 3 times better data compression achieved i

Re: [Virtuoso-users] Using column store structure for exiting data

2014-05-22 Thread Hugh Williams
Hi Sumit, Question 1: When you start a new/empty Virtuoso 7 database the initialisation process automatically creates the RDF_QUAD table and indexes in column-wise mode as this is considered to be the best default for RDF work loads, mainly due to the 3 times better data compression achieved i

Re: [Virtuoso-users] RDFEasy: scalable Freebase SPARQL queries in the AWS cloud

2014-05-22 Thread Kingsley Idehen
On 5/22/14 5:19 PM, Paul Houle wrote: he first RDFEasy product is ready. RDFEasy BaseKB Gold Compact Edition is a SPARQL database based on the Compact Edition of :BaseKB https://github.com/paulhoule/RDFeasy/wiki/Compact-Edition which is a good set of facts to work from if you are interested in