Changing my field type to string for my uniquekey field solved the problem. Thanks to Jack and Erik for the fix!
On May 18, 2012, at 5:33 PM, Jack Krupansky wrote: > Typically the uniqueKey field is a "string" field type (your schema uses > "text_general"), although I don't think it is supposed to be a requirement. > Still, it is one thing that stands out. > > Actually, you may be running into some variation of SOLR-1401: > > https://issues.apache.org/jira/browse/SOLR-1401 > > In other words, stick with "string" and stay away from a tokenized (text) > key. > > You could also get duplicates by merging cores or if your "add" has > allowDups = "true" or overwrite="false". > > -- Jack Krupansky > > -----Original Message----- > From: Parmeley, Michael > Sent: Friday, May 18, 2012 5:50 PM > To: solr-user@lucene.apache.org > Subject: Duplicate documents being added even with unique key > > I have a uniquekey set in my schema; however, I am still getting duplicated > documents added. Can anyone provide any insight into why this may be > happening? > > This is in my schema.xml: > > <!-- Field to use to determine and enforce document uniqueness. > Unless this field is marked with required="false", it will be a > required field > --> > <uniqueKey>uniquekey</uniqueKey> > > <field name="uniquekey" type="text_general" indexed="true" stored="true" > required="true" /> > > On startup I get this message in catalina.out: > > INFO: unique key field: uniquekey > > However, you can see I get multiple documents: > > <result name="response" numFound="7" start="0"> > <doc> > <str name="abbreviation">PSR3</str> > <int name="clientid">1</int> > <str name="entitytype">Skill</str> > <int name="id">510</int> > <str name="name">Body and Soul</str> > <int name="projectid">1</int> > <int name="skillnumber">281</int> > <str name="uniquekey">Skill510</str> > </doc> > <doc> > <str name="abbreviation">PSR3</str> > <int name="clientid">1</int> > <str name="entitytype">Skill</str> > <int name="id">510</int> > <str name="name">Body and Soul</str> > <int name="projectid">1</int> > <int name="skillnumber">281</int> > <str name="uniquekey">Skill510</str> > </doc> > <doc> > <str name="abbreviation">PSR3</str> > <int name="clientid">1</int> > <str name="entitytype">Skill</str> > <int name="id">510</int> > <str name="name">Body and Soul</str> > <int name="projectid">1</int> > <int name="skillnumber">281</int> > <str name="uniquekey">Skill510</str> > </doc> > <doc> > <str name="abbreviation">PSR3</str> > <int name="clientid">1</int> > <str name="entitytype">Skill</str> > <int name="id">510</int> > <str name="name">Body and Soul</str> > <int name="projectid">1</int> > <int name="skillnumber">281</int> > <str name="uniquekey">Skill510</str> > </doc> > <doc> > <str name="abbreviation">PSR3</str> > <int name="clientid">1</int> > <str name="entitytype">Skill</str> > <int name="id">510</int> > <str name="name">Body and Soul</str> > <int name="projectid">1</int> > <int name="skillnumber">281</int> > <str name="uniquekey">Skill510</str> > </doc> > <doc> > <str name="abbreviation">PSR3</str> > <int name="clientid">1</int> > <str name="entitytype">Skill</str> > <int name="id">510</int> > <str name="name">Body and Soul</str> > <int name="projectid">1</int> > <int name="skillnumber">281</int> > <str name="uniquekey">Skill510</str> > </doc> > <doc> > <str name="abbreviation">PSR3</str> > <int name="clientid">1</int> > <str name="entitytype">Skill</str> > <int name="id">510</int> > <str name="name">Body and Soul</str> > <int name="projectid">1</int> > <int name="skillnumber">281</int> > <str name="uniquekey">Skill510</str> > </doc> > </result> >
