Hi everybody,
I have a relatively large index (it will eventually contain ~4M
documents and be about 3G in size, I think) that indexes user data,
settings, and the like. The documents represent a community of users
whereupon a subset of them may be "online" at any time. Also, we want to
score our search results across searches that span the whole index by the
online (i.e. presence) status.
Right now the list of online members is kept in a database table,
however we very often need to search on these users. The problem is, we're
using Solr for our searches and we don't know how to approach setting up a
search system for a large amount of highly volatile data.
How do people typically go about this? Do they do one of the
following:
1) Set up a second core and keep only index the "online"
members in there? (Then we could not score normal search results by online
status.)
2) Index the online status in our regular solr index and not
worry about it? (If it's fast to update docs in a large index, then why not
maintain real-time data in the main index?)
3) Just use a database for the presence data and forget about
using Solr for the presence-related searches?
Is there anything in Solr that I should be looking into to help with
this problem? I'd appreciate any help.
Sincerely,
Daryl.
