On Mon, Apr 5, 2010 at 9:10 PM, Chris Hostetter
wrote:
>
>
> : > ... the reusing the FieldCache seems like hte only thing that would be
> : > advantageous in that case
> :
> : And FieldCache entries are currently reused when there have only been
> : deletions on a segment (since Solr 1.4).
>
> But
: > ... the reusing the FieldCache seems like hte only thing that would be
: > advantageous in that case
:
: And FieldCache entries are currently reused when there have only been
: deletions on a segment (since Solr 1.4).
But that's kind of orthoginal to (what i think) Lance's point was: that
On Mon, Apr 5, 2010 at 9:04 PM, Chris Hostetter
wrote:
> ... the reusing the FieldCache seems like hte only thing that would be
> advantageous in that case
And FieldCache entries are currently reused when there have only been
deletions on a segment (since Solr 1.4).
-Yonik
http://www.lucidimagin
: We had exactly this problem in a consumer app; we had a small but
: continuously growing list of obscene documents in the index, and did
: not want to display these. So, we had a filter query with all of the
: obscene words, and used this with every query.
that doesn't seem like it would really
: times. Is there any way to have the index keep its caches when the only thing
: that happens is deletions, then invalidate them when it's time to actually add
: data? It would have to be something I can dynamically change when switching
: between deletions and the daily import.
The problem is
In a word: "no".
What you can do instead of deleting them is to add them to a growing
list of "don't search for these documents". This could be listed in a
filter query.
We had exactly this problem in a consumer app; we had a small but
continuously growing list of obscene documents in the index,
My index has a number of shards that are nearly static, each with about
7 million documents. By nearly static, I mean that the only changes
that normally happen to them are document deletions, done with the xml
update handler. The process that does these deletions runs once every
two minutes,
