Re: duplicate deleting

2006-11-27 Thread Zaheed Haque
Chris: Thanks for the reply. On 11/27/06, Chris Hostetter <[EMAIL PROTECTED]> wrote: : I have a field called last modified and that field will determine : which record will get to be the one in Solr index. : : These files are huge and I need an automatic way of cleanup on a : weekly basis. Yes

Re: duplicate deleting

2006-11-27 Thread Chris Hostetter
: I have a field called last modified and that field will determine : which record will get to be the one in Solr index. : : These files are huge and I need an automatic way of cleanup on a : weekly basis. Yes, I can cleanup the files before handing over to Solr : but I thought there must be some

duplicate deleting

2006-11-24 Thread Zaheed Haque
Hi: I have a following use case. I have 5 sets of large different XML dump from 5 database. All the XML file has the same structure. However there are duplicate entries which are in different files with different ID's. (i.e. solr doc, 1 db entry = 1 solr doc). How can I remove duplicate where 3 o