Re: Filtering results based on a set of values for a field

2011-08-19 Thread Erick Erickson
Good luck, and let us know what the results are. About dropping the cache.. That shouldn't be a problem, it should just be computed when your component is called the first time, so starting the server (or opening a new searcher) should re-compute it. Your filters shouldn't be very big, just maxDoc

Re: Filtering results based on a set of values for a field

2011-08-18 Thread Tomas Zerolo
On Thu, Aug 18, 2011 at 02:32:48PM -0400, Erick Erickson wrote: > Hmmm, I'm still not getting it... > > You have one or more lists. These lists change once a month or so. Are > you trying > to include or exclude the documents in these lists? In our specific case to include *only* the documents ha

Re: Filtering results based on a set of values for a field

2011-08-18 Thread Erick Erickson
Hmmm, I'm still not getting it... You have one or more lists. These lists change once a month or so. Are you trying to include or exclude the documents in these lists? And do the authors you want to include or exclude change on a per-query basis or would you be all set if you just had a filter tha

Re: Filtering results based on a set of values for a field

2011-08-18 Thread Tomas Zerolo
On Thu, Aug 18, 2011 at 08:36:08AM -0400, Erick Erickson wrote: > How does this list of authors get selected? The reason I'm asking is > I'm wondering > if you can "define the problem away". In other words, I'm wondering if this > is an XY problem (http://people.apache.org/~hossman/#xyproblem). :-

Re: Filtering results based on a set of values for a field

2011-08-18 Thread Erick Erickson
How does this list of authors get selected? The reason I'm asking is I'm wondering if you can "define the problem away". In other words, I'm wondering if this is an XY problem (http://people.apache.org/~hossman/#xyproblem). I can't imagine you expect a user to specify up to 2k authors, so there mu

Re: Filtering results based on a set of values for a field

2011-08-17 Thread Tomas Zerolo
On Tue, Aug 16, 2011 at 07:56:51AM +, tomas.zer...@axelspringer.de wrote: > Hello, Solrs > > we are trying to filter out documents written by (one or more of) the authors > from > a mediumish list (~2K). The document set itself is in the millions. [...] Sorry. Forgot to say that we are usin

Filtering results based on a set of values for a field

2011-08-16 Thread tomas.zerolo
Hello, Solrs we are trying to filter out documents written by (one or more of) the authors from a mediumish list (~2K). The document set itself is in the millions. Apart from the obvious approach of building a huge OR-list and appending it to the query, it seems that writing a Lucene[1] filter (