Re: Delta import not working with Oracle in Solr

2018-07-10 Thread Erick Erickson
It's actually quite easy to index from a DB to Solr via SolrJ, here's an example. https://lucidworks.com/2012/02/14/indexing-with-solrj/ On Tue, Jul 10, 2018 at 6:06 AM, Shawn Heisey wrote: > On 7/8/2018 9:44 AM, shruti suri wrote: >> >> I am using solr-6.1.0 version. This is the response I am g

Re: Delta import not working with Oracle in Solr

2018-07-10 Thread Shawn Heisey
On 7/8/2018 9:44 AM, shruti suri wrote: I am using solr-6.1.0 version. This is the response I am getting. But every time I run delta import , it fetches same number of records but didn't commit them. 0:0:42.255 2 10208 0 0 2018-07-08 15:37:31 2018-07-08 15:37:31 2018-07-08 15:38:13 2018-07-08 1

Re: Delta import not working with Oracle in Solr

2018-07-10 Thread Rahul Singh
Agreed. DIH is not an industrial grade ETL tool.. may want to consider other options. May want to look into Kafka Connect as an alternative. It has connectors for JDBC into Kafka, and from Kafka into Solr. -- Rahul Singh rahul.si...@anant.us Anant Corporation On Jul 9, 2018, 6:14 AM -0500, Alex

Re: Delta import not working with Oracle in Solr

2018-07-09 Thread Alexandre Rafalovitch
I think you are moving so fast it is hard to understand where you need help. Can you setup one clean smallest issue (maybe as test) and try our original suggestions. Otherwise, nobody has enough attention energy to figure out what is happening. And even then, this list is voluntary help, we are

Re: Delta import not working with Oracle in Solr

2018-07-08 Thread shruti suri
Still not working, same issue documents are not getting pushed to index. - Regards Shruti -- Sent from: http://lucene.472066.n3.nabble.com/Solr-User-f472068.html

Re: Delta import not working with Oracle in Solr

2018-07-08 Thread Karthik S
I have as well faced the problem when we have composite primary key in the table, so below is how have went with workaround. deltaQuery retrieve concat value with time criteria (that should retrieves only modified rows) and use it in deltaImportQuery with where clause. On Sun, Jul 8, 2

Re: Delta import not working with Oracle in Solr

2018-07-08 Thread shruti suri
Dataconfig I am using now *managed-schema* data_id - Regards Shruti -- Sent from: http://lucene.472066.n3.nabble.com/Solr-User-f472068.html

Re: Delta import not working with Oracle in Solr

2018-07-08 Thread shruti suri
My oracle table doesn't have any primary key and delta import requires a primary key, that's why I am creating it by concatenating 2 columns. For now just for testing I am using only one column. I am using solr-6.1.0 version. This is the response I am getting. But every time I run delta import , i

Re: Delta import not working with Oracle in Solr

2018-07-07 Thread Karthik S
Could you try something like this.? deltaQuery="select CONCAT(cast(col1 as varchar(10)) , name) as ID FROM MyTable WHERE UPDATED_DATE > '${dih.last_index_time}'" deltaImportQuery="select CONCAT(cast(col1 as varchar(10)) , name) as ID, * from MyTable WHERE CONCAT(cast(col1 as varchar(10)) , name) =

Delta import not working with Oracle in Solr

2018-07-07 Thread shruti suri
HI, Please help me with delta import form one oracle table into solr. I don't have any primary key in the table. We need to use composite key using (LOCAL_MASTER_ID,LOCAL_ID). - Regards Shruti -- Sent from: http://lucene.472066.n3.nabble.com/Solr-User-f472068.html

Re: Delta import not working with Oracle in Solr

2018-07-06 Thread Shawn Heisey
On 7/6/2018 5:53 AM, shruti suri wrote: > Please help me with delta import form one oracle table into solr. I don't > have any primary key in the table. We need to use composite key using > (LOCAL_MASTER_ID,LOCAL_ID). > > > query="select * from dat

Re: Delta import not working with Oracle in Solr

2018-07-06 Thread Alexandre Rafalovitch
Which version of Solr is it and in which way is it not working. And should not the deltaQuery and deltaImportQuery both have "as ID" part? Regards, Alex. On 6 July 2018 at 07:53, shruti suri wrote: > HI, > > Please help me with delta import form one oracle table into solr. I don't > have any

Delta import not working with Oracle in Solr

2018-07-06 Thread shruti suri
HI, Please help me with delta import form one oracle table into solr. I don't have any primary key in the table. We need to use composite key using (LOCAL_MASTER_ID,LOCAL_ID). - Regards Shruti -- Sent from: http://lucene.472066.n3.nabble.com/Solr-User-f472068.html