: Special characters in the text used for boost queries are not removed. For : example, bq=field1:(what is xyz?)^10 gets parsed into query field1:xyz?10 : (what and is are stop words). Question mark didn't get removed -- field1 : uses standard tokenizer and standard filter, so I expect it to get removed. : When I test it using the analysis page agains field1, question mark did get : removed.
unless you are using some special QParser that you haven't mentioned, i supsect that what you are seeing is that since "?" is a special character for wildcard searchers, you are still seeing it appear in the debugQuery output showing hte toString of your query. in general, if your analyzer removes punctuation, then the punctuation will be removed -- but the exception is when thta punctuation is a "special character" for your quer parser -- then it has special meaning. -Hoss
