On 2/12/07, Erik Hatcher <[EMAIL PROTECTED]> wrote:
On Feb 12, 2007, at 9:10 PM, Gmail Account wrote:
> This would be great! I can't help with the solution but I am very
> interested in using it if one of you guys can figure it out.
>
> I can't wait to see if this works out.
And just for the record, Solr drives Collex @ NINES: <http://
www.nines.org/collex> which implements tagging along with faceted and
full-text search. I've recently hacked our system such that the bulk
of our custom caches are only refreshed when a new batch of data is
loaded, and only the "collectable cache" is updated on a <commit/>.
This reduced our new index searcher visibility time from 45 seconds
down to only a few seconds or less.
Wow!
This (the warming time) is a major benefit to having separate
documents that reference "main" documents that are updated less
frequently.
The hard part would be to generalize something like that.
A separate index for each document type sounds like it would help.
As part of Flare, I will experiment with the tagging design Yonik has
posted to the wiki but for now our "legacy" application is running
fine with my early hacks.
My design so far was to show how we could get very far with what we
have now (or almost have now, with updateable documents). However, it
doesn't take into account things like warming time.
It might be a while before we could come up with any kind of generic
mechanism that could perform as well as your "hacks" w.r.t warming
speed :-)
-Yonik
