lukas-vlcek opened a new pull request, #12750: URL: https://github.com/apache/lucene/pull/12750
… PathHierarchy tokenizer ### Description This PR is expected to fail. It demonstrates issue with `BaseTokenStreamTestCase.assertAnalyzesTo()` method in connection to `PathHierarchyTokenizer`. Is there any reason why `PathHierarchyTokenizer` shall not be used in the test like this? There are definitely other tokenizers that are being tested like this, ie. they are wrapped in Analyzer and then `assertAnalyzesTo()` method is called to check the tokens. What is special about PathHierarchy tokenizer that it does not work? I think the problem might not be in the tokenizer but in the test method itself or in the way I call it (maybe I need to pass in more parameters/flags to get rid of the issue?). The testing method is complex, especially when it gets to `checkAnalysisConsistency()` part. I am looking for any useful tips. Thank you! -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. To unsubscribe, e-mail: issues-unsubscr...@lucene.apache.org For queries about this service, please contact Infrastructure at: us...@infra.apache.org --------------------------------------------------------------------- To unsubscribe, e-mail: issues-unsubscr...@lucene.apache.org For additional commands, e-mail: issues-h...@lucene.apache.org
