Hi James,
What i did:
* build a jar from the patch
* downloaded the BDB library
* added them to my classpath
* download a nightly 4.1 Sol build
* created a db config according to:
http://svn.apache.org/repos/asf/lucene/dev/branches/branch_4x/solr/contrib/dataimporthandler/src/test/org/apache/solr/handler/dataimport/TestEphemeralCache.java
although i got things working, after 2 hours of indexing i stopped the
proces. For that amount of data it took endeca 1h15. After looking at some
of the tests in the patch i configured the data-config.xml as follows:
<document>
<entity name="END_FRG_PRODUCTS_VW"
processor="SqlEntityProcessor"
persistCacheImpl="org.apache.solr.handler.dataimport.BerkleyBackedCache"
persistCacheName="END_FRG_PRODUCTS_VW"
persistCachePartitionNumber="0"
persistCacheBaseDir="d:\cacheloc"
berkleyInternalCacheSize="1000000"
berkleyInternalShared="true"
query="select PDT_ID, SEARCH_TITLE from
END_FRG_PRODUCTS_VW">
<entity name="END_FRG_FEATURES_VW"
processor="SqlEntityProcessor"
persistCacheImpl="org.apache.solr.handler.dataimport.BerkleyBackedCache"
persistCacheName="FEATURE"
cacheKey="PDT_ID"
cacheLookup="END_FRG_PRODUCTS_VW.PDT_ID"
berkleyInternalCacheSize="1000000"
berkleyInternalShared="true"
persistCacheBaseDir="d:\cacheloc"
query="select * from END_FRG_FEATURES_VW"/>
</entity>
</document>
Although different in behaviour:
[snapshot from the indexing after 8 minutes: Requests: 2899, Fetched:
28974398, Skipped: 0, Processed: 2258] it was still slow and the parameter
'persistCacheBaseDir' has no effect. The difference in behaviour from the
previous is that it had only 2 requests and hadn't processed anything after
2 hours.
Hope you can help me.
Thanks,
Maarten
--
View this message in context:
http://lucene.472066.n3.nabble.com/DIH-nested-entities-don-t-work-tp4015514p4019223.html
Sent from the Solr - User mailing list archive at Nabble.com.
