On 4-Dec-07, at 8:43 AM, Evgeniy Strokin wrote:
Hello,...
we have 110M records index under Solr. Some queries takes a while,
but we need sub-second results. I guess the only solution is cache
(something else?)...
We use standard LRUCache. In docs it says (as far as I understood)
that it loads view of index in to memory and next time works with
memory instead of hard drive.
So, my question: hypothetically, we can have all index in memory if
we'd have enough memory size, right? In this case the result should
come up very fast. We have very rear updates. So I think this could
be a solution.
How big is the index on disk (the most important files are .frq,
and .prx if you do phrase queries? How big and what exactly is a
record in your system? Do you do faceting/sorting? How much memory
do you have? What does a typical query look like?
Performance is a tricky subject. It is hard to give any kind of
useful answer that applies in general. The one thing I can say is
that 110M is a _lot_ of docs for one system, especially if these are
normal-sized documents
regards,
-Mike
