Re: Indexing fieldvalues with dashes and spaces

2010-08-19 Thread PeterKerk
Sorry for late reply, just back from holiday :) I did what you mentioned: and then in url facet.field=services_raw It works...awesome, thanks! -- View this message in context: http://lucene.472066.n3.nabble.com/Indexing-fieldvalues-with-dashes-and-spaces-tp1023699p1222961.html Sent from th

Re: Indexing fieldvalues with dashes and spaces

2010-08-10 Thread Jan Høydahl / Cominvent
Hi, Try solr.KeywordTokenizerFactory. However, in your case it looks as if you have certain requirements for searching that requires tokenization. So you should leave the WhitespaceTokenizer as is and create a separate field specially for the faceting, with indexed=true, stored=false and type=

Re: Indexing fieldvalues with dashes and spaces

2010-08-09 Thread PeterKerk
Hi Erick, Ok. its more clear now. I indeed have the whitespace tokenizer: What happens is that I have a field called 'Beach & Sea", which is a theme for a location. What happens because of the whitespace tokenizer, i

Re: Indexing fieldvalues with dashes and spaces

2010-08-06 Thread Erick Erickson
See below: On Fri, Aug 6, 2010 at 9:00 AM, PeterKerk wrote: > > Ah, I'm glad it does, makes me feel a bit less stupid ;) > > So to summarize and see if I understand it now: > - the analyzers allow for many different ways to index a field, these > analyzers are placed in a chain > Minor terminol

Re: Indexing fieldvalues with dashes and spaces

2010-08-06 Thread PeterKerk
Ah, I'm glad it does, makes me feel a bit less stupid ;) So to summarize and see if I understand it now: - the analyzers allow for many different ways to index a field, these analyzers are placed in a chain - when a field is indexed it can be searched - a field could also be stored as-is, but I w

Re: Indexing fieldvalues with dashes and spaces

2010-08-05 Thread Erick Erickson
This confuses lots of people. When you index a field, it's Analyzed 10 ways from Sunday. Consider "The World is an unknown Entity". When you INDEX it, many thing happen, depending upon the analyser. Stopwords may be removed. each token may be lower cased. Each token may be stemmed. It all depends o

RE: Indexing fieldvalues with dashes and spaces

2010-08-05 Thread PeterKerk
@Michael, @Erick, You both mention interesting things that triggered me. @Erick: Your referenced page is very useful. It seems the whitespace tokenizer under the text_ws is causing issues. You do mention another interesting thing: "And do be aware that fields you get back from a request (i.e. a

Re: Indexing fieldvalues with dashes and spaces

2010-08-04 Thread Erick Erickson
I suspect you're running afoul of tokenizers and filters. The parts of your schema that you published aren't the ones that really count. What you probably need to look at is the FieldType definitions, i.e. what analysis is done for, say, text_ws (see http://wiki.apache.org/solr/AnalyzersTokenizers

RE: Indexing fieldvalues with dashes and spaces

2010-08-04 Thread PeterKerk
Well the example you provided is 100% relevant to me :) I've read the wiki now (SchemaXml,SolrFacetingOverview,Query Syntax, SimpleFacetParameters), but still do not have an exact idea of what you mean. My situation: a city field is something that I want users to search on via text input, so let

RE: Indexing fieldvalues with dashes and spaces

2010-08-04 Thread Markus Jelsma
d for displaying the navigation.   But, check the wiki on this subject.   -Original message- From: PeterKerk Sent: Wed 04-08-2010 22:23 To: solr-user@lucene.apache.org; Subject: RE: Indexing fieldvalues with dashes and spaces Sorry, but Im a newbie to Solr...how would I change my schem

RE: Indexing fieldvalues with dashes and spaces

2010-08-04 Thread Michael Griffiths
4:18 PM To: solr-user@lucene.apache.org Subject: RE: Indexing fieldvalues with dashes and spaces You shouldn't fetch faceting results from analyzed fields, it will mess with your results. Search on analyzed fields but don't retrieve values from them.   -Original message- From: Pet

RE: Indexing fieldvalues with dashes and spaces

2010-08-04 Thread PeterKerk
Sorry, but Im a newbie to Solr...how would I change my schema.xml to match your requirements? And what do you mean by "it will mess with your results"? What will happen then? -- View this message in context: http://lucene.472066.n3.nabble.com/Indexing-fieldvalues-with-dashes-and-spaces-tp102369

RE: Indexing fieldvalues with dashes and spaces

2010-08-04 Thread Markus Jelsma
ieldvalues with dashes and spaces I changed  values to text_ws Now I only seem to have problems with fieldvalues that hold spacessee below:           It has now become: "facet_counts":{  "facet_queries":{},  "facet_fields":{ "theme":[ "Ge

RE: Indexing fieldvalues with dashes and spaces

2010-08-04 Thread PeterKerk
I changed values to text_ws Now I only seem to have problems with fieldvalues that hold spacessee below: It has now become: "facet_counts":{ "facet_queries":{}, "facet_fields":{ "theme":[ "Gemeentehuis",2, "&",1, < still & is c

RE: Indexing fieldvalues with dashes and spaces

2010-08-04 Thread Michael Griffiths
Your schema.xml setting for the field is probably tokenizing the punctuation. Change the field type to one that doesn't tokenize on punctuation; e.g. use "text_ws" and not "text" -Original Message- From: PeterKerk [mailto:vettepa...@hotmail.com] Sent: Wednesday, August 04, 2010 3:36 PM