RE: Speed up import of Hierarchical Data

2013-05-22 Thread O. Olson
Just an update for others reading this thread: I had some CachedSqlEntityProcessor and had it addressed in the thread How do I use CachedSqlEntityProcessor? (http://lucene.472066.n3.nabble.com/How-do-I-use-CachedSqlEntityProcessor-td4064919.html) I basically had to declare the child entities in th

RE: Speed up import of Hierarchical Data

2013-05-17 Thread O. Olson
Thank you James. I think I got this to work using CachedSqlEntityProcessor – and it seems extremely fast. I will try SortedMapBackedCache on Monday :-). Thank you, O. O. Dyer, James-2 wrote > Using SqlEntityProcessor with cacheImpl="SortedMapBackedCache" is the same > as specifying "CachedSqlEn

RE: Speed up import of Hierarchical Data

2013-05-17 Thread Dyer, James
hoo.it] Sent: Thursday, May 16, 2013 5:06 PM To: solr-user@lucene.apache.org Subject: RE: Speed up import of Hierarchical Data Thank you James. Are there any examples of SortedMapBackedCache? I am new to Solr and I do not find many tutorials in this regard. I just modified the examples and the

RE: Speed up import of Hierarchical Data

2013-05-16 Thread O. Olson
Thank you James. Are there any examples of SortedMapBackedCache? I am new to Solr and I do not find many tutorials in this regard. I just modified the examples and they worked for me. What is a good way to learn these basics? O. O. Dyer, James-2 wrote > See https://issues.apache.org/jira/browse

Re: Speed up import of Hierarchical Data

2013-05-16 Thread O. Olson
Thank you Stefan. I am new to Solr and I would need to read up more on CachedSqlEntityProcessor. Do you have any clue where to begin? There do not seem to be any tutorials online. The link you provided seems to have a very short and unclear explanation. After “Example 1” you have “The usage is exa

RE: Speed up import of Hierarchical Data

2013-05-16 Thread Dyer, James
See https://issues.apache.org/jira/browse/SOLR-2943 . You can set up 2 DIH handlers. The first would query the "CAT_TABLE" and save it to a disk-backed cache, using DIHCacheWriter. You then would replace your 3 child entities in the 2nd DIH handler to use DIHCacheProcessor to read back the ca

Re: Speed up import of Hierarchical Data

2013-05-16 Thread Stefan Matheis
That sounds like a perfect match for http://wiki.apache.org/solr/DataImportHandler#CachedSqlEntityProcessor :) On Thursday, May 16, 2013 at 6:01 PM, O. Olson wrote: > I am using the DataImportHandler to Query a SQL Server and populate Solr. > Unfortunately, SQL does not have an understanding of