Hi Erich,

Ah, you should not really be using that bitmap  index with the default v7 
indexes which are for column store. I tried that myself just now and my server 
crashed on Mac loading datasets, which it should not even if the indexes are 
mismatched, so I have reported to development. The docs also need some clean 
ups to make this difference clearer ...

Best Regards
Hugh Williams
Professional Services
OpenLink Software, Inc.      //              http://www.openlinksw.com/
Weblog   -- http://www.openlinksw.com/blogs/
LinkedIn -- http://www.linkedin.com/company/openlink-software/
Twitter  -- http://twitter.com/OpenLink
Google+  -- http://plus.google.com/100570109519069333827/
Facebook -- http://www.facebook.com/OpenLinkSoftware
Universal Data Access, Integration, and Management Technology Providers

On 15 Oct 2013, at 06:32, Erich Bremer <er...@ebremer.com> wrote:

> Hi Hugh,
> 
> Reason #1: The Virtuoso tuning guide suggested:
> 
> "If predicate and graph are given but subject is not, then it is 
> sometimes useful to add:
> CREATE BITMAP INDEX RDF_QUAD_PGOS ON DB.DBA.RDF_QUAD (G, P, O, S) 
> PARTITION (O VARCHAR (-1, 0hexffff));"
> 
> The instructions did not indicate for this index, that any prior indexes need 
> to be dropped, so, I did not drop any.
> 
> SQL> STATISTICS DB.DBA.RDF_QUAD;
> Showing SQLStatistics of table(s) 'DB.DBA.RDF_QUAD'
> TABLE_QUALIFIER  TABLE_OWNER      TABLE_NAME       NON_UNIQUE  
> INDEX_QUALIFIER  INDEX_NAME       TYPE        SEQ_IN_INDEX  COLUMN_NAME      
> COLLATION  CARDINALITY  PAGES       FILTER_CONDITION
> VARCHAR          VARCHAR          VARCHAR          SMALLINT    VARCHAR        
>   VARCHAR          SMALLINT    SMALLINT    VARCHAR          VARCHAR  INTEGER  
>    INTEGER     VARCHAR
> _______________________________________________________________________________
> 
> DB               DBA              RDF_QUAD         NULL        NULL           
>   NULL             0           NULL        NULL             NULL     NULL     
>    NULL        NULL
> DB               DBA              RDF_QUAD         0           DB             
>   RDF_QUAD         3           1           P                NULL     NULL     
>    NULL        NULL
> DB               DBA              RDF_QUAD         0           DB             
>   RDF_QUAD         3           2           S                NULL     NULL     
>    NULL        NULL
> DB               DBA              RDF_QUAD         0           DB             
>   RDF_QUAD         3           3           O                NULL     NULL     
>    NULL        NULL
> DB               DBA              RDF_QUAD         0           DB             
>   RDF_QUAD         3           4           G                NULL     NULL     
>    NULL        NULL
> DB               DBA              RDF_QUAD         1           DB             
>   RDF_QUAD_GS      3           1           G                NULL     NULL     
>    NULL        NULL
> DB               DBA              RDF_QUAD         1           DB             
>   RDF_QUAD_GS      3           2           S                NULL     NULL     
>    NULL        NULL
> DB               DBA              RDF_QUAD         1           DB             
>   RDF_QUAD_OP      3           1           O                NULL     NULL     
>    NULL        NULL
> DB               DBA              RDF_QUAD         1           DB             
>   RDF_QUAD_OP      3           2           P                NULL     NULL     
>    NULL        NULL
> DB               DBA              RDF_QUAD         1           DB             
>   RDF_QUAD_POGS    3           1           P                NULL     NULL     
>    NULL        NULL
> DB               DBA              RDF_QUAD         1           DB             
>   RDF_QUAD_POGS    3           2           O                NULL     NULL     
>    NULL        NULL
> DB               DBA              RDF_QUAD         1           DB             
>   RDF_QUAD_POGS    3           3           S                NULL     NULL     
>    NULL        NULL
> DB               DBA              RDF_QUAD         1           DB             
>   RDF_QUAD_POGS    3           4           G                NULL     NULL     
>    NULL        NULL
> DB               DBA              RDF_QUAD         1           DB             
>   RDF_QUAD_SP      3           1           S                NULL     NULL     
>    NULL        NULL
> DB               DBA              RDF_QUAD         1           DB             
>   RDF_QUAD_SP      3           2           P                NULL     NULL     
>    NULL        NULL
> 
> Reason #2: The manual (the same URL actually) indicates that sometimes the 
> indexes can become "polluted" and that "Dropping and recreating the index 
> will remedy this situation." So, therefore, I am
> experimenting/hacking/playing so that I can become stronger with the Force. 
> ;-)
> 
> In any event, was there anything I needed to do prior to adding the above 
> index?  I had performed the test with a newly created database.  - Erich
> 
> Erich Bremer
> http://www.ebremer.com
> 
> 
> 
> On 10/14/2013 10:53 PM, Hugh Williams wrote:
>> Hi Erich,
>> 
>> Why are you creating these additional indexes and if you did were the 
>> defaults dropped first ? What does the the following query return:
>> 
>>      STATISTICS DB.DBA.RDF_QUAD;
>> 
>> Which should return a list of indexes on the RDF_QUAD table ...
>> 
>> As indicated in the performance tuning guide the default indexes should 
>> suffice for most use cases, thus you should not have to create additional 
>> indexes ...
>> 
>> Best Regards
>> Hugh Williams
>> Professional Services
>> OpenLink Software, Inc.      //              http://www.openlinksw.com/
>> Weblog   -- http://www.openlinksw.com/blogs/
>> LinkedIn -- http://www.linkedin.com/company/openlink-software/
>> Twitter  -- http://twitter.com/OpenLink
>> Google+  -- http://plus.google.com/100570109519069333827/
>> Facebook -- http://www.facebook.com/OpenLinkSoftware
>> Universal Data Access, Integration, and Management Technology Providers
>> 
>> On 14 Oct 2013, at 13:56, Erich Bremer <er...@ebremer.com> wrote:
>> 
>>> Either way, I get the following error when starting my bulk load:
>>> *** glibc detected *** virtuoso-t: double free or corruption (out):
>>> 0x00007f6b710f2000 ***
>>> Segmentation fault
>>> 
>>>     - Erich
>>> 
>>> Erich Bremer
>>> http://www.ebremer.com
>>> 
>>> The default schema as per the below URL is:
>>> CREATE DISTINCT NO PRIMARY KEY REF BITMAP INDEX RDF_QUAD_SP
>>>   ON RDF_QUAD (S, P)
>>>   PARTITION (S INT (0hexffff00));
>>> 
>>> CREATE BITMAP INDEX RDF_QUAD_POGS
>>>   ON RDF_QUAD (P, O, G, S)
>>>   PARTITION (O VARCHAR (-1, 0hexffff));
>>> 
>>> CREATE DISTINCT NO PRIMARY KEY REF BITMAP INDEX RDF_QUAD_GS
>>>   ON RDF_QUAD (G, S)
>>>   PARTITION (S INT (0hexffff00));
>>> 
>>> CREATE DISTINCT NO PRIMARY KEY REF INDEX RDF_QUAD_OP
>>>   ON RDF_QUAD (O, P)
>>>   PARTITION (O VARCHAR (-1, 0hexffff));
>>> 
>>> Given this, I noticed that the below index PGOS uses DB.DBA.RDF_QUAD (G,
>>> P, O, S), shouldn't that be DB.DBA.RDF_QUAD (P, G, O, S)?
>>> 
>>>                     - Erich
>>> 
>>> Hi,
>>> 
>>>     I tried creating the index as per the page:
>>> 
>>> http://virtuoso.openlinksw.com/dataspace/doc/dav/wiki/Main/VirtRDFPerformanceTuning
>>> 
>>> CREATE BITMAP INDEX RDF_QUAD_PGOS ON DB.DBA.RDF_QUAD (G, P, O, S)
>>> PARTITION (O VARCHAR (-1, 0hexffff));
>>> 
>>> which successfully creates via ISQL (seemingly), but when I go to
>>> execute a bulk load across 8 cores, Virtuoso
>>> dies with a segmentation core dump.  The same bulk load works fine
>>> without creating the above index.
>>> Did I miss something in the creation of the index?  - Erich
>>> 
>>> Erich Bremer
>>> http://www.ebremer.com
>>> 
>>> 
>>> 
>>> ------------------------------------------------------------------------------
>>> October Webinars: Code for Performance
>>> Free Intel webinars can help you accelerate application performance.
>>> Explore tips for MPI, OpenMP, advanced profiling, and more. Get the most 
>>> from
>>> the latest Intel processors and coprocessors. See abstracts and register >
>>> http://pubads.g.doubleclick.net/gampad/clk?id=60134071&iu=/4140/ostg.clktrk
>>> _______________________________________________
>>> Virtuoso-users mailing list
>>> Virtuoso-users@lists.sourceforge.net
>>> https://lists.sourceforge.net/lists/listinfo/virtuoso-users
> 
> 
> ------------------------------------------------------------------------------
> October Webinars: Code for Performance
> Free Intel webinars can help you accelerate application performance.
> Explore tips for MPI, OpenMP, advanced profiling, and more. Get the most from 
> the latest Intel processors and coprocessors. See abstracts and register >
> http://pubads.g.doubleclick.net/gampad/clk?id=60135031&iu=/4140/ostg.clktrk
> _______________________________________________
> Virtuoso-users mailing list
> Virtuoso-users@lists.sourceforge.net
> https://lists.sourceforge.net/lists/listinfo/virtuoso-users

Attachment: smime.p7s
Description: S/MIME cryptographic signature

------------------------------------------------------------------------------
October Webinars: Code for Performance
Free Intel webinars can help you accelerate application performance.
Explore tips for MPI, OpenMP, advanced profiling, and more. Get the most from 
the latest Intel processors and coprocessors. See abstracts and register >
http://pubads.g.doubleclick.net/gampad/clk?id=60135031&iu=/4140/ostg.clktrk
_______________________________________________
Virtuoso-users mailing list
Virtuoso-users@lists.sourceforge.net
https://lists.sourceforge.net/lists/listinfo/virtuoso-users

Reply via email to