vismaytiwari commented on issue #14137: URL: https://github.com/apache/lucene/issues/14137#issuecomment-4951951701
Opened #16384 for this. The flattened graph feeding `FixedShingleFilter` for `555,0` is `5550`(posInc 1), `555`(posInc 0), `0`(posInc 1). `5550` can't form a bigram so it emits nothing, and the first shingle `555 0` ends up based at `555` (posInc 0) — which becomes the stream's first token with a 0 increment, tripping the indexer's "first position increment must be > 0". The fix accumulates the increments of base positions that emit nothing and applies the total to the next emitted shingle (0 for further graph routes stacked at the same base), so `555 0` keeps the full increment (1 here). Added a test building the reported chain. -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. To unsubscribe, e-mail: [email protected] For queries about this service, please contact Infrastructure at: [email protected] --------------------------------------------------------------------- To unsubscribe, e-mail: [email protected] For additional commands, e-mail: [email protected]
