[ 
https://issues.apache.org/jira/browse/LUCENE-9130?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17016766#comment-17016766
 ] 

Chen Zhixiang commented on LUCENE-9130:
---------------------------------------

Try to dump terms' positing info:

 private void debugOutputTermsInfo2(IndexReader indexReader, int doc, String 
fieldName) throws IOException {
 Terms terms = MultiTerms.getTerms(indexReader, fieldName);
 TermsEnum termIter = terms.iterator();
 while (termIter.next() != null) {
 PostingsEnum postingsEnum = termIter.postings(null, PostingsEnum.ALL);
 while (postingsEnum.nextDoc() != DocIdSetIterator.NO_MORE_DOCS) {
 int freq = postingsEnum.freq();
 System.out.printf("term: %s, freq: %d,", termIter.term().utf8ToString(), freq);
 while (freq > 0) {
 System.out.printf(" nextPosition: %d,", postingsEnum.nextPosition());
 System.out.printf(" startOffset: %d, endOffset: %d",
 postingsEnum.startOffset(), postingsEnum.endOffset());
 freq--;
 }
 System.out.println();
 }
 }
 }

Output:

term: 1, freq: 1, nextPosition: 7, startOffset: -1, endOffset: -1
term: 2179, freq: 1, nextPosition: 0, startOffset: -1, endOffset: -1
term: 2184, freq: 1, nextPosition: 2, startOffset: -1, endOffset: -1
term: lg, freq: 1, nextPosition: 6, startOffset: -1, endOffset: -1
term: 入, freq: 1, nextPosition: 4, startOffset: -1, endOffset: -1

terms' position info is right(filtered terms take a position number), but no 
offset(invalid -1), is offset info needed in PhraseQuery?

> Failed to match when create PhraseQuery with terms analyzed from long query 
> text
> --------------------------------------------------------------------------------
>
>                 Key: LUCENE-9130
>                 URL: https://issues.apache.org/jira/browse/LUCENE-9130
>             Project: Lucene - Core
>          Issue Type: Bug
>          Components: core/search
>    Affects Versions: 8.4
>            Reporter: Chen Zhixiang
>            Priority: Major
>         Attachments: LongTextFieldSearchTest.java
>
>
> When i use a long text (which is euqual to doc's StringField at indexing 
> time) to build a PhraseQuery, i cannot match the document. But BooleanQuery 
> with MUST/AND mode successes.
>  
> long query text is a address string: 
> "申长路988弄虹桥万科中心地下停车场LG2层2179-2184车位(锡虹路入,LG1层开到底下LG2)"
> test case is attached.
> logs:
>  
> 15:46:11.940 [main] INFO test.LongTextFieldSearchTest - indexed terms: 开, 层, 
> 心, 弄, 万, 停车场, 地下, 科, 虹桥, 底下, 锡, 入, 2184, 中, 路, 到, 1, 2, 申, 2179, 车位, 988, 虹, 
> lg, 长
> 15:46:11.956 [main] INFO test.LongTextFieldSearchTest - terms: 申, 长, 路, 988, 
> 弄, 虹桥, 万, 科, 中, 心, 地下, 停车场, lg, 2, 层, 2179, 2184, 车位, 锡, 虹, 路, 入, lg, 1, 层, 
> 开, 到, 底下, lg, 2
> 15:46:11.962 [main] INFO test.LongTextFieldSearchTest - query: +(+address:申 
> +address:长 +address:路 +address:988 +address:弄 +address:虹桥 +address:万 
> +address:科 +address:中 +address:心 +address:地下 +address:停车场 +address:lg 
> +address:2 +address:层 +address:2179 +address:2184 +address:车位 +address:锡 
> +address:虹 +address:路 +address:入 +address:lg +address:1 +address:层 +address:开 
> +address:到 +address:底下 +address:lg +address:2)
> 15:46:11.988 [main] INFO test.LongTextFieldSearchTest - 
> results.totalHits.value=1
> 15:46:12.181 [main] INFO test.LongTextFieldSearchTest - indexed terms: 开, 层, 
> 心, 弄, 万, 停车场, 地下, 科, 虹桥, 底下, 锡, 入, 2184, 中, 路, 到, 1, 2, 申, 2179, 车位, 988, 虹, 
> lg, 长
> 15:46:12.185 [main] INFO test.LongTextFieldSearchTest - terms: 申, 长, 路, 988, 
> 弄, 虹桥, 万, 科, 中, 心, 地下, 停车场, lg, 2, 层, 2179, 2184, 车位, 锡, 虹, 路, 入, lg, 1, 层, 
> 开, 到, 底下, lg, 2
> 15:46:12.188 [main] INFO test.LongTextFieldSearchTest - query: +address:"申 长 
> 路 988 弄 虹桥 万 科 中 心 地下 停车场 lg 2 层 2179 2184 车位 锡 虹 路 入 lg 1 层 开 到 底下 lg 2"~2
> 15:46:12.210 [main] INFO test.LongTextFieldSearchTest - 
> results.totalHits.value=0
> 15:46:12.214 [main] INFO test.LongTextFieldSearchTest - no matching phrase



--
This message was sent by Atlassian Jira
(v8.3.4#803005)

---------------------------------------------------------------------
To unsubscribe, e-mail: issues-unsubscr...@lucene.apache.org
For additional commands, e-mail: issues-h...@lucene.apache.org

Reply via email to