Re: Getting error while excuting full import

2017-04-19 Thread Shawn Heisey
On 4/18/2017 11:21 PM, ankur.168 wrote: > I thought DIH does parallel db request for all the entities defined in a > document. I do not know anything about that. It *could* be possible for all the sub-entities just below another entity to run in parallel, but I've got no idea whether this is the

Re: Getting error while excuting full import

2017-04-18 Thread ankur.168
Thanks for enlightening, Shawn :) I thought DIH does parallel db request for all the entities defined in a document. I do believe that DIH is easier to use that's why I am trying to find a way to use this in my current system. But as I explained above since I have so many sub entities,each retu

Re: Getting error while excuting full import

2017-04-18 Thread Mikhail Khludnev
Ok. I've checked AbstractSqlEntityProcessorTestCase. Please make the next attempt with where="PROPERTY_ID=propertiesList.PROPERTY_ID" On Tue, Apr 18, 2017 at 4:35 PM, ankur.168 wrote: > Yes, both column names are same. But if we just use property_id=property_id > in child entity, then how zipp

Re: Getting error while excuting full import

2017-04-18 Thread Shawn Heisey
On 4/18/2017 12:58 AM, ankur.168 wrote: > Hi Erick, > > Thanks for replying, As you suggest I can use solrJ to map RDBMS fetched > data and index/search it later on. but DIH gives multi db connection for > full import and other benefits. > Does solrJ supports this or we need to put efforts to make

Re: Getting error while excuting full import

2017-04-18 Thread ankur.168
Yes, both column names are same. But if we just use property_id=property_id in child entity, then how zipper gets to know which child document to merge with which parent? Any how I just tried with ur suggested where condition which result in arrayindexoutofbound exception, here are the logs Cause

Re: Getting error while excuting full import

2017-04-18 Thread Mikhail Khludnev
Hello, Shouldn't it just be where="PROPERTY_ID=PROPERTY_ID'" since fields are named the same in both tables. On Tue, Apr 18, 2017 at 4:02 PM, ankur.168 wrote: > Hi Mikhail, > > I tried with a simplest zipper entity. Here are the config details- > > > query="SELECT > PROPERTY_ID FROM

Re: Getting error while excuting full import

2017-04-18 Thread ankur.168
Hi Mikhail, I tried with a simplest zipper entity. Here are the config details- Here child entity have multiple records for a given property id. Hence I believe ful

Re: Getting error while excuting full import

2017-04-18 Thread ankur.168
Hi Mikhail, Thanks for replying, I am currently trying to use zipper join but getting null pointer exception as given below stacktrace 2017-04-18 09:11:51.154 INFO (qtp1348949648-13) [ x:sample_content] o.a.s.u.p.LogUpdateProcessorFactory [sample_content] webapp=/solr path=/dataimport params

Re: Getting error while excuting full import

2017-04-17 Thread ankur.168
Hi Erick, Thanks for replying, As you suggest I can use solrJ to map RDBMS fetched data and index/search it later on. but DIH gives multi db connection for full import and other benefits. Does solrJ supports this or we need to put efforts to make a multithreaded connection pool similar to DIH?

Re: Getting error while excuting full import

2017-04-17 Thread Mikhail Khludnev
Hello, Ankur, You probably can set clean=false&commit=false and do clean&commit in the controlling code. See https://cwiki.apache.org/confluence/display/solr/Uploading+Structured+Data+Store+Data+with+the+Data+Import+Handler One of thrilling DIH features is merging sorted children and parents with

Re: Getting error while excuting full import

2017-04-17 Thread Erick Erickson
I usually prefer SolrJ, here's an article explaining why and providing sample code. https://lucidworks.com/2012/02/14/indexing-with-solrj/ You can take the Tika bit out, they're unnecessary for importing from a DB. Best, Erick On Mon, Apr 17, 2017 at 5:45 AM, ankur.168 wrote: > Thanks for repl

Re: Getting error while excuting full import

2017-04-17 Thread ankur.168
Thanks for replying Shawn, There was an issue with the db connection url, silly mistake. I am facing one another problem, do not know if should post in the same thread or as a new post. Anyways posting here only, let me know if needs to be posted as new one. I am using DIH as you know. I have pr

Re: Getting error while excuting full import

2017-04-12 Thread Shawn Heisey
On 4/10/2017 3:47 AM, ankur.168 wrote: > Hi All,I am trying to use solr with 2 cores interacting with 2 different > databases, one core is executing full-import successfully where as when I am > running for 2nd one it is throwing table or view not found exception. If I > am using the query directly