Re: WhitespaceTokenizerFactory and PathHierarchyTokenizerFactory

2016-02-25 Thread Anil
HI, search can be any free text or ip address or path and Special characters should not be treated as text delimiters. 10.20 must return 10.20.30.112 /var/log must return /var/log/bigdata Please let me know if you need any additional details. Thanks. Regards, Anil On 25 February 2016 at 18:20

Re: WhitespaceTokenizerFactory and PathHierarchyTokenizerFactory

2016-02-25 Thread Jack Krupansky
You still haven't stated exactly what your query requirements are. In Solr you should always start with an analysis of how people will expect to query the data and then work backwards to how to store and index the data to achieve the desired queries. Note that the standard tokenizer will tokenize

Re: WhitespaceTokenizerFactory and PathHierarchyTokenizerFactory

2016-02-24 Thread Anil
Sorry Jack for confusion. I have field which holds free text. text can contain path , ip or any free text. I would like to tokenize the text of the field using white space. if the text token is of path or ip pattern , it has be tockenized like path hierarchy way. Regards, Anil On 24 February 2

Re: WhitespaceTokenizerFactory and PathHierarchyTokenizerFactory

2016-02-24 Thread Jack Krupansky
Your statement makes no sense. Please clarify. Express your requirement(s) in plain English first before dragging in possible solutions. Technically, path elements can have embedded spaces. -- Jack Krupansky On Wed, Feb 24, 2016 at 6:53 AM, Anil wrote: > HI, > > i need to use both WhitespaceTok