Where is the OOM coming from? One of the usual problems is that your database connection is set up to retrieve the entire results set at once rather than process it in chunks. Search the mail archive for DIH and/or memory and you'll find this discussed numerous times...
HTH Erick On Thu, Mar 25, 2010 at 11:56 PM, Lance Norskog <goks...@gmail.com> wrote: > There is no feature in Lucene that allows it to append new fields to > an existing document. You have to re-index the entire thing. > > On Thu, Mar 25, 2010 at 6:56 PM, bbarani <bbar...@gmail.com> wrote: > > > > Hi, > > > > I have a peculiar situation, > > > > I am having my DIH dataconfig file as below > > > > <entity x query="select * from x"> ---> object > > <entity y query="select * from y" processor="cachedSqlEntityprocessor" > > cachekey=y.id cachevalue=x.id> --> object properties > > > > Now since I am using Cachedsql entity processor I am getting in to out of > > memory exception very often so to tackle the issue I thought of adding a > > filter criteria to my entity Y in such a way that only few properties are > > indexed at one point of time. > > > > I thought of running these queries again with another 2 properties after > my > > first indexing is complete. My issue now is that the I want the > properties > > to get appended (in each document) after each indexing is complete. As > of > > now the documents itself is getting replace instead I want to append new > > fields to the documents. I searched the nabble forum to find out a > solution > > for this issue but couldnt find any useful suggestions / tips. It would > be > > great if someone can provide pointers / suggestions to overcome this > issue. > > > > Thanks, > > B > > -- > > View this message in context: > http://n3.nabble.com/How-to-add-a-new-field-to-existing-document-append-a-new-field-to-already-existing-document-tp596093p596093.html > > Sent from the Solr - User mailing list archive at Nabble.com. > > > > > > -- > Lance Norskog > goks...@gmail.com >
