Re: DIH deleting documents

2013-02-25 Thread cveres
Thanks Arcadius, Excellent suggestion about the view.I'll try to simplify things and see how I go. thanks, Csaba -- View this message in context: http://lucene.472066.n3.nabble.com/DIH-deleting-documents-tp4041811p4042663.html Sent from the Solr - User mailing list archive at Nabble.com.

Re: DIH deleting documents

2013-02-23 Thread Arcadius Ahouansou
Hello Cveres. I know you said the IDs are unique, but having a look at your config, your id is defined as CONCAT(CAST('${book_chapter.title}' AS CHAR),'-',CAST(chapter AS CHAR)) as solr_id There are many books out there with the same title and most of them have a chapter titled "Introduction". So

Re: DIH deleting documents

2013-02-23 Thread cveres
Thanks Gora. I do not have optimise automatically enabled, but I am new to Solr so I am not 100% familiar with all the steps that go on. I will try your suggestion, but I was hoping first that I could get the data straight from Solr. thanks, Csaba -- View this message in context: http://luce

Re: DIH deleting documents

2013-02-22 Thread Gora Mohanty
On 22 February 2013 12:11, cveres wrote: > I should also add that some of the books don't have chapters, so the query > won't succeed for these books. > But in this case I expected that the document won't be added at all .. > rather than first added then deleted (which I am now suspecting is the >

Re: DIH deleting documents

2013-02-21 Thread cveres
I should also add that some of the books don't have chapters, so the query won't succeed for these books. But in this case I expected that the document won't be added at all .. rather than first added then deleted (which I am now suspecting is the case). It would be very helpful if I could see a li

Re: DIH deleting documents

2013-02-21 Thread cveres
Hi Gora and Arcadius, Thanks for your help. I'll try and answer both your questions here. I am interested in three database tables. "Book" contains information about books, "page" has the content of each book page by page, and "chapter" contains the title of each chapter in every book, and the pa

Re: DIH deleting documents

2013-02-21 Thread Arcadius Ahouansou
Hi Csaba. Would you mind posting your DIHconfig/data-config.xml and the command you use for the import? Thanks. Arcadius. On 21 February 2013 17:55, Gora Mohanty wrote: > On 21 February 2013 19:30, cveres wrote: >> Thanks Gora, >> >> Sorry I might not have been sufficiently clear. >> >> I st

Re: DIH deleting documents

2013-02-21 Thread Gora Mohanty
On 21 February 2013 19:30, cveres wrote: > Thanks Gora, > > Sorry I might not have been sufficiently clear. > > I start with an empty index, then add documents. > 9000 are added and 6000 immediately deleted again, leaving 3000. > I assume this can only happen with duplicate IDs, but that should no

Re: DIH deleting documents

2013-02-21 Thread cveres
Thanks Gora, Sorry I might not have been sufficiently clear. I start with an empty index, then add documents. 9000 are added and 6000 immediately deleted again, leaving 3000. I assume this can only happen with duplicate IDs, but that should not be possible! So I wanted to get a list of deleted do

Re: DIH deleting documents

2013-02-21 Thread Gora Mohanty
On 21 February 2013 14:27, cveres wrote: > I am adding documents with data import handler from a mysql database. I > create a unique id for each document by concatenating a couple of fields in > the database. Every id is unique. > > After the import, over half the documents which were imported are

Re: DIH - deleting documents, high performance (delta) imports, and passing parameters

2010-08-30 Thread Tommy Chheng
Thanks for the section on "Passing "parameters" to DIH config:" I'm going to try the parameter passing to allow the DIH to index different DBs based on the system environment(local dev machine or production machine) @tommychheng Programmer and UC Irvine Graduate Student Find a great grad sch

Re: DIH - Deleting documents

2010-03-23 Thread André Maldonado
In my case I will sove the problem with postImportDeleteQuery Thank's "Então aproximaram-se os que estavam no barco, e adoraram-no, dizendo: És verdadeiramente o Filho de Deus." (Mateus 14:33) On Tue, Mar 23, 2010 at 15:29, blargy wrote: > > Are there any examples out there for using these sp

Re: DIH - Deleting documents

2010-03-23 Thread blargy
Are there any examples out there for using these special commands? Im not quite sure of the syntax. Any simple example will suffice. Thanks mausch wrote: > > Take a look at the DIH special commands: > http://wiki.apache.org/solr/DataImportHandler#Special_Commands >

Re: DIH - Deleting documents

2010-03-23 Thread Mauricio Scheffer
Take a look at the DIH special commands: http://wiki.apache.org/solr/DataImportHandler#Special_Commands Some other options: http://stackoverflow.com/questions/1555610/solr-dih-how-to-handle-deleted-documents Cheers, Mauricio 2010/3/2