indexing one documents with different populated fields causes a deletion of documents in with other populated fileds

2007-10-25 Thread Anton Valdstein
Hi,
I have 2 fields defined in the schema.xml. One is named ItalianTitle and the
other is named ItalianOrEnglishTitle_t.
I want to index first all the Italian titles into documents having the
Italian texts stored and indexed in the ItalianTitle field while these
documents should have the field ItalianOrEnglishTitle_t
empty. I succeeded doing so, but than I tried to index the Italian texts
into the documents having the ItalianTitle field empty and stored in the
ItalianOrEnglishTitle_t.
this resulted in my index only having documents with ItalianOrEnglishTitle_t
populated and the previous indexed documents having the ItalianTitle field
populated where deleted from the index.
I looked at the statistics and found that, though no delete request was
issued the
updated handler did delete the number of documents i had added with the
field ItalianTitle


Does solr check automatically for duplicate texts in  other fields and
delete documents  that have the same text stored  in  other fields?


Re: indexing one documents with different populated fields causes a deletion of documents in with other populated fileds

2007-10-25 Thread Anton Valdstein
thanks, that explains a lot (:,
I have another question: about how the idf is calculated:
is the document frequency the sum of all documents containing the term in
one of their fields or just in the field the query contained?


On 10/25/07, Yonik Seeley <[EMAIL PROTECTED]> wrote:
>
> On 10/25/07, Anton Valdstein <[EMAIL PROTECTED]> wrote:
> > Does solr check automatically for duplicate texts in  other fields and
> > delete documents  that have the same text stored  in  other fields?
>
> Solr automatically overwrites (deletes old versions of) documents with
> the same uniqueKey field (normally called "id").
>
> Both Lucene and Solr lack the ability to change (or add fields to)
> existing documents.
>
> -Yonik
>