Re: solr.StandardTokenizerFactory: more info needed

2011-07-06 Thread Dmitry Kan
> >> Steve > >> > >> -----Original Message- > >> From: Dmitry Kan [mailto:dmitry@gmail.com] > >> Sent: Wednesday, July 06, 2011 9:21 AM > >> To: solr-user@lucene.apache.org > >> Subject: Re: solr.StandardTokenizerFactory: more

Re: solr.StandardTokenizerFactory: more info needed

2011-07-06 Thread Erick Erickson
; >> Before you recompile, you have to run 'ant jflex' to  generate the java >> source. >> >> Steve >> >> -Original Message- >> From: Dmitry Kan [mailto:dmitry@gmail.com] >> Sent: Wednesday, July 06, 2011 9:21 AM >>

Re: solr.StandardTokenizerFactory: more info needed

2011-07-06 Thread Dmitry Kan
> source. > > Steve > > -Original Message- > From: Dmitry Kan [mailto:dmitry@gmail.com] > Sent: Wednesday, July 06, 2011 9:21 AM > To: solr-user@lucene.apache.org > Subject: Re: solr.StandardTokenizerFactory: more info needed > > Hi Steven, > > This looks ve

RE: solr.StandardTokenizerFactory: more info needed

2011-07-06 Thread Steven A Rowe
ubject: Re: solr.StandardTokenizerFactory: more info needed Hi Steven, This looks very good. Thanks. Do I understand correctly, that I were to change the tokenizer rules, I could go and change e.g. the token class definitions (like ) in this file and recompile the code? On Wed, Jul 6, 2011 at 3:45 PM

Re: solr.StandardTokenizerFactory: more info needed

2011-07-06 Thread Dmitry Kan
Hi Steven, This looks very good. Thanks. Do I understand correctly, that I were to change the tokenizer rules, I could go and change e.g. the token class definitions (like ) in this file and recompile the code? On Wed, Jul 6, 2011 at 3:45 PM, Steven A Rowe wrote: > Hi Dmitry, > > The underlying

RE: solr.StandardTokenizerFactory: more info needed

2011-07-06 Thread Steven A Rowe
Hi Dmitry, The underlying Lucene implementation is here: http://svn.apache.org/repos/asf/lucene/java/tags/lucene_2_9_1/src/java/org/apache/lucene/analysis/standard/ StandardTokenizerImpl.jflex is probably where you should start. Steve -Original Message- From: Dmitry Kan [mailto:dmitry.