Re: Composite Key

2009-07-24 Thread Mark Miller
But, if you just want to use it for updating, you could use the deduplication updateprocessor - it lets you change what fields control uniqueness for updating - you could add multiple fields as the signature, and if those fields are the same in another doc, they will replace previous occurrences in

Re: Composite Key

2009-07-24 Thread Erik Hatcher
On Jul 24, 2009, at 8:33 AM, Nishant Chandra wrote: Can I use composite key for uniqueKeyId? If yes, how? No - you get one field to use for uniqueKey in Solr. It is your indexer's responsibility for aggregating values from your data sources into a single uniqueKey value. For example, in

Re: Composite key for uniqueKeyId

2008-03-10 Thread Norberto Meijome
On Fri, 7 Mar 2008 17:59:48 -0800 (PST) Chris Hostetter <[EMAIL PROTECTED]> wrote: > I believe Norberto ment he was handling it in his update client code -- > before sending the docs to Solr. Indeed, this what we do. We have a process that parses certain files, generates documents following the

Re: Composite key for uniqueKeyId

2008-03-08 Thread Vijay Rao
I used it to index my DB and I found no bugs .Ours is a very simple usecase. There were rough edges though. The error logging and messages were not up to the mark. It aborted the entire indexing when there was a missing 'required' field. It must just skip that document. Or give me an opotion to c

Re: Composite key for uniqueKeyId

2008-03-08 Thread Noble Paul നോബിള്‍ नोब्ळ्
hi , The tool is undergoing substantial testing in our QA department . Because it is an official internal project also, the bugs are filed in our bug tool. We are fixing them as and when they are reported. It has gone through some good iterations and it is going to power the backend for a 2 of our

Re: Composite key for uniqueKeyId

2008-03-08 Thread Erik Hatcher
The best thing folks can do to help with getting patches like this important DataImporterHandler committed to trunk is to try it out, report back experiences, and offer suggestions for improvement. Solr 1.3 will come in _good_ time, but not before its time. There are many substantial chang

Re: Composite key for uniqueKeyId

2008-03-07 Thread Vijay Rao
I am also looking forward to get this checked into the trunk. Will there be a patch with Solr1.2 support? Cheers Vijay On Sat, Mar 8, 2008 at 10:11 AM, Jon Baer <[EMAIL PROTECTED]> wrote: > That definitely sounds like the proper way to go + will try. Im not > too concerned w/ my keys coming bac

Re: Composite key for uniqueKeyId

2008-03-07 Thread Noble Paul നോബിള്‍ नोब्ळ्
Good to hear that people are using DatImportHandler In a couple of days, we are giving another patch which is cleared by our QA with better error handling, messaging and a lot of new features. A committer will have to decide on when it is good enough to be committed --Noble On Sat, Mar 8, 2008 a

Re: Composite key for uniqueKeyId

2008-03-07 Thread Jon Baer
That definitely sounds like the proper way to go + will try. Im not too concerned w/ my keys coming back just that I can't seem to run the DataImportHandler w/o one. I was able to temporarily get around it by returning it in the entity query. Ie: BTW, the DataImportHandler seems t

Re: Composite key for uniqueKeyId

2008-03-07 Thread Chris Hostetter
I believe Norberto ment he was handling it in his update client code -- before sending the docs to Solr. Something that *seems* possible but I've never actaully tried is writting a "ConcatTokenFilterFactory" that queues up all the tokens and joins them together (using some confiured string, de

Re: Composite key for uniqueKeyId

2008-03-07 Thread Jon Baer
Hi Norberto, This sounds exactly what Im looking to do, do you have an example? (Keep in mind Im using data-config.xml - DataImporter) Im interested in merging different types of content in, ie: NEWS12345 VIDEO12345 So Id like to end up w/ different keys per type if possible. Thanks. - Jon

Re: Composite key for uniqueKeyId

2008-03-06 Thread Norberto Meijome
On Thu, 6 Mar 2008 11:33:38 -0500 Jon Baer <[EMAIL PROTECTED]> wrote: > Im interested to know if composite keys are now possible or if there > is anything to copyField I can use to get composite keys working for > my doc ids? FWIW, we just do this @ doc generation time - grab several fields,