Re: Solr cloud: Faceting issue on text field

2014-02-28 Thread David Miller
Hi Chris, The enum option is working for us, with suitable minDf settings. We are able to do faceting with decent speed using this. Thanks a lot, Dave On Fri, Feb 28, 2014 at 9:09 AM, David Miller wrote: > Hi Chris, > > Thanks for the info. I have looked into the "docValues&q

Re: Solr cloud: Faceting issue on text field

2014-02-28 Thread David Miller
Hi Chris, Thanks for the info. I have looked into the "docValues" option earlier. But docValues doesn't support textField and we require textField to enable various tokenizer and analyzers (like shingle, pattern filter etc.) We require the faceting to be on terms with in the text field, not as a w

Re: Solr cloud: Faceting issue on text field

2014-02-27 Thread David Miller
Hi, The target here is to use the facets to generate tag clouds, whose set can have go upto trigrams. This works fine in dev, but our production is having issues with faceting.. Regards, On Wed, Feb 26, 2014 at 10:00 PM, David Miller wrote: > Hi Jack, > > Ya, the requirement is lik

Re: Solr cloud: Faceting issue on text field

2014-02-26 Thread David Miller
g? > > How many unique terms occur in the facet field? > > -- Jack Krupansky > > -Original Message- From: David Miller > Sent: Wednesday, February 26, 2014 2:06 PM > To: solr-user@lucene.apache.org > Subject: Solr cloud: Faceting issue on text field > > >

Re: Solr cloud: Faceting issue on text field

2014-02-26 Thread David Miller
pe up to address your questions there. > In the mean time have you read > http://sbdevel.wordpress.com/2013/04/16/you-are-faceting-itwrong/? > > > On Feb 26, 2014, at 3:26 PM, David Miller wrote: > > > Hi Greg, > > > > Yes, the memory and cpu spiked for th

Re: Solr cloud: Faceting issue on text field

2014-02-26 Thread David Miller
es copious amounts of memory; have you checked for GC > activity while the query is running? > > Thanks, > Greg > > On Feb 26, 2014, at 1:06 PM, David Miller wrote: > > > Hi, > > > > I am encountering an issue where Solr nodes goes down when trying to >

Solr cloud: Faceting issue on text field

2014-02-26 Thread David Miller
Hi, I am encountering an issue where Solr nodes goes down when trying to obtain facets on a text field. The cluster consists of a few servers and have around 200 million documents (small to medium). I am trying the faceting first time on this field and it gives a 502 Bad Gateway error along with s

Re: Tf-Idf for a specific query

2014-02-11 Thread David Miller
Erick Erickson wrote: > David: > > If you're, say, faceting on fields with lots of unique values, this > will be quite expensive. > No idea whether you can tolerate slower queries or not, just sayin' > > Erick > > On Fri, Feb 7, 2014 at 5:35 PM, David Mill

Re: Tf-Idf for a specific query

2014-02-07 Thread David Miller
gt; > I can imagine that "DF for resultset" is facets! > > > On Fri, Feb 7, 2014 at 11:26 PM, David Miller >wrote: > > > Hi Mikhail, > > > > The DF seems to be based on the entire document set. What I require is > > based on a the results of a s

Re: Tf-Idf for a specific query

2014-02-07 Thread David Miller
ponent (invert it > yourself) > then, for certain term you can get number of occurrences per document by > http://wiki.apache.org/solr/FunctionQuery#tf > > > > On Fri, Feb 7, 2014 at 3:58 AM, David Miller > wrote: > > > Hi Guys.. > > > > I require to

Tf-Idf for a specific query

2014-02-06 Thread David Miller
Hi Guys.. I require to obtain Tf-idf score from Solr for a certain set of documents. But the catch is that, I needs the IDF (or DF) to be calculated on the documents returned by the specific query and not the entire corpus. Please provide me some hint on whether Solr has this feature or if I can