Re: NRT facet search options comparison

[Nagendra Nagarajayya]

Andy:

I did not actually measure and benchmark facet search performance with 
and without NRT. The screenshots though show the performance impact if 
you look at the  QTime parameter in Fig 1 and Fig 2. I did not notice 
any appreciable difference in performance when I tested faceting with 
NRT. The current implementation just recreates the UnInvertedField cache 
as this was easier to implement. This needs be dynamic and not recreated.

Regards,
- NN

On 6/1/2011 8:53 PM, Andy wrote:
Nagendra,

Thanks. Can you comment on the performance impact of NRT on facet search? The 
pages you linked to don't really touch on that.

My concern is that with NRT, the facet cache will be constantly invalidated. 
How will that impact the performance of faceting?

Do you have any benchmark comparing the performance of facet search with and 
without NRT?

Thanks

Andy


--- On Wed, 6/1/11, Nagendra Nagarajayya<nnagaraja...@transaxtions.com>  wrote:

From: Nagendra Nagarajayya<nnagaraja...@transaxtions.com>
Subject: Re: NRT facet search options comparison
To: solr-user@lucene.apache.org
Date: Wednesday, June 1, 2011, 11:29 PM
Hi Andy:

Here is a white paper that shows screenshots of faceting
working with
Solr and RankingAlgorithm under NRT:
http://solr-ra.tgels.com/wiki/en/Near_Real_Time_Search

The implementation (src) is also available with the
download and is
described in the below document:
http://solr-ra.tgels.com/papers/NRT_Solr_RankingAlgorithm.pdf

The faceting test was done with the mbartists demo from the
book,
Solr-14-Enterprise-Search-Server and is approx around 390k
docs.

Regards,

- Nagendra Nagarajayya
http://solr-ra.tgels.com
http://rankingalgorithm.tgels.com

On 6/1/2011 12:52 PM, Andy wrote:
Hi,

I need to provide NRT search with faceting. Been
looking at the options out there. Wondered if anyone could
clarify some questions I have and perhaps share your NRT
experiences.
The various NRT options:

1) Solr
-Solr doesn't have NRT, yet. What is the expected time
frame for NRT? Is it a few months or more like a year?
-How would Solr faceting work with NRT? My
understanding is that faceting in Solr relies on caching,
which doesn't go well with NRT updates. When NRT arrives,
would facet performance take a huge drop when using with NRT
because of this caching issue?
2) ElasticSearch
-ES supports NRT so that's great. Does anyone have
experiences with ES that they could share? Does faceting
work with NRT in ES? Any Solr features that are missing in
ES?
3) Solr-RA
-Read in this list about Solr-RA, which has NRT
support. Has anyone used it? Can you share your
experiences?
-Again not sure if facet would work with Solr-RA NRT.
Solr-RA is based on Solr, so faceting in Solr-RA relies on
caching I suppose. Does NRT affect facet performance?
4) Zoie plugin for Solr
-Zoie is a NRT search library. I tried but couldn't
get the Zoie plugin to work with Solr. Always got the error
message of opening too many Searchers. Has anyone got this
to work?
Any other options?

Thanks
Andy