Re: Weird Facet and KeywordTokenizerFactory Issue

2009-10-29 Thread Ravi Kiran
Thank you very much...I shall try out the tokenizerFactory attribute on SynonymFilterFactory On Tue, Oct 13, 2009 at 12:27 AM, Chris Hostetter wrote: > > : I had to be brief as my facets are in the order of 100K over 800K > documents > : and also if I give the complete schema.xml I was afraid nob

Re: Weird Facet and KeywordTokenizerFactory Issue

2009-10-12 Thread Chris Hostetter
: I had to be brief as my facets are in the order of 100K over 800K documents : and also if I give the complete schema.xml I was afraid nobody would read my : long message :-) ..Hence I showed only relevant pieces of the result showing : different fields having same problem relevant is good, but

Re: Weird Facet and KeywordTokenizerFactory Issue

2009-10-06 Thread Ravi Kiran
Hello Mr.Hostetter, Thank you for patiently reading through my post, I apologize for being cryptic in my previous messages.. >>when you cut/pasted the facet output, you excluded the field names. based >>on the schema & solrconfig.xml snippets you posted later, i'm assuming >>they are usstate, and

Re: Weird Facet and KeywordTokenizerFactory Issue

2009-10-06 Thread Chris Hostetter
A few comments about the info you've provided... when you cut/pasted the facet output, you excluded the field names. based on the schema & solrconfig.xml snippets you posted later, i'm assuming they are usstate, and keyword, but you have to be explicit so that people can help correlate the r

Re: Weird Facet and KeywordTokenizerFactory Issue

2009-10-06 Thread Christian Zambrano
Got it. Sorry for not having an answer for your problem. On 10/06/2009 04:58 PM, Ravi Kiran wrote: You dont see any facet fields in my query because I have configured them in the solrconfig.xml to give specific fields as facets by default in the dismax and standard handlers so that I dont have t

Re: Weird Facet and KeywordTokenizerFactory Issue

2009-10-06 Thread Ravi Kiran
You dont see any facet fields in my query because I have configured them in the solrconfig.xml to give specific fields as facets by default in the dismax and standard handlers so that I dont have to specify all those fields individually everytime I query, all I need to do is just set facet=true tha

Re: Weird Facet and KeywordTokenizerFactory Issue

2009-10-06 Thread Christian Zambrano
I am stumped then. I had a similar issue when I was using a field that was being heavily tokenized, but I corrected the issue by using a field(generated using copyField) that doesn't get analyzed at all. On the query you provided before I didn't see the parameters to tell solr for which field

Re: Weird Facet and KeywordTokenizerFactory Issue

2009-10-06 Thread Ravi Kiran
Yes Exactly the same On Tue, Oct 6, 2009 at 4:52 PM, Christian Zambrano wrote: > And you had the analyzer for that field set-up the same way as shown on > your previous e-mail when you indexed the data? > > > > > On 10/06/2009 03:46 PM, Ravi Kiran wrote: > >> I did infact check it out any there i

Re: Weird Facet and KeywordTokenizerFactory Issue

2009-10-06 Thread Christian Zambrano
And you had the analyzer for that field set-up the same way as shown on your previous e-mail when you indexed the data? On 10/06/2009 03:46 PM, Ravi Kiran wrote: I did infact check it out any there is no weirdness in analysis page...see result below Index Analyzer org.apache.solr.analysis.Ke

Re: Weird Facet and KeywordTokenizerFactory Issue

2009-10-06 Thread Ravi Kiran
I did infact check it out any there is no weirdness in analysis page...see result below Index Analyzer org.apache.solr.analysis.KeywordTokenizerFactory {} term position 1 term text New York term type word source start,end 0,8 payload org.apache.solr.analysis.TrimFilterFactory {} term position 1

Re: Weird Facet and KeywordTokenizerFactory Issue

2009-10-06 Thread Christian Zambrano
Have you tried using the Analysis page to see what tokens are generated for the string "New York"? It could be one of the token filter is adding the token 'new' for all strings that start with 'new' On 10/06/2009 02:54 PM, Ravi Kiran wrote: Hello All, Iam getting some ghost face

Weird Facet and KeywordTokenizerFactory Issue

2009-10-06 Thread Ravi Kiran
Hello All, Iam getting some ghost facets in solr 1.4. Can anybody kindly help me understand why I get them and how to eliminate them. My schema.xml snippet is given at the end. Iam indexing Named Entities extracted via OpenNLP into solr. My understanding regarding KeywordTokenizerFact