Re: Custom analyzer & frequency

2017-11-21 Thread Erick Erickson
One thing you might do is use the termfreq function to see that it looks like in the index. Also the schema/analysis page will put terms in "buckets" by power-of-2 so that might help too. Best, Erick On Tue, Nov 21, 2017 at 7:55 AM, Barbet Alain wrote: > You rock, thank you so much for this clea

Re: Custom analyzer & frequency

2017-11-21 Thread Barbet Alain
You rock, thank you so much for this clear answer, I loose 2 days for nothing as I've already the term freq but now I've an answer :-) (And yes I check it's the doc freq, not the term freq). Thank you again ! 2017-11-21 16:34 GMT+01:00 Emir Arnautović : > Hi Alain, > As explained in prev mail tha

Re: Custom analyzer & frequency

2017-11-21 Thread Emir Arnautović
Hi Alain, As explained in prev mail that is doc frequency and each doc is counted once. I am not sure if Luke can provide you information about overall term frequency - sum of term frequency of all docs. Regards, Emir -- Monitoring - Log Management - Alerting - Anomaly Detection Solr & Elasticse

Re: Custom analyzer & frequency

2017-11-21 Thread Emir Arnautović
Hi Alain, I haven’t been using Luke UI in a while, but if you are talking about top terms for some field, that might be doc freq, not term freq and every doc is counted once - that is equivalent to “Load Term Info” in “Schema” in Solr Admin console. HTH, Emir -- Monitoring - Log Management - Ale

Re: Custom analyzer & frequency

2017-11-21 Thread Barbet Alain
$ cat add_test.sh DATA=' 666 toto titi tata toto tutu titi ' $ sh add_test.sh 0484 $ curl 'http://localhost:8983/solr/alian_test/terms?terms.fl=titi_txt_fr&terms.sort=index' 00 So it's not only on Luke Side, it's come from Solr. Does it sound normal ? 2017-11-21 11:4

Re: Custom analyzer & frequency

2017-11-21 Thread Barbet Alain
Thank you very much for your answer. It was an error on copy / paste on my mail sorry about that ! So it was already a text field, so omitTermFrequenciesAndPosition was already on “false” So I forget my custom analyzer and try to test with an already defined field_type (text_fr) and see same beha

Re: Custom analyzer & frequency

2017-11-21 Thread Emir Arnautović
Hi Alain, You did not provided definition of used field type - you use “nametext” type and pasted “text_ami” field type. It is possible that you have omitTermFrequenciesAndPosition=“true” on nametext field type. The default value for text fields should be false. HTH, Emir -- Monitoring - Log Ma