jpountz commented on code in PR #13636:
URL: https://github.com/apache/lucene/pull/13636#discussion_r1709336210
##########
lucene/core/src/java21/org/apache/lucene/internal/vectorization/PanamaVectorizationProvider.java:
##########
@@ -79,4 +113,15 @@ public VectorUtilSupport getVectorUtilSupport() {
public FlatVectorsScorer getLucene99FlatVectorsScorer() {
return Lucene99MemorySegmentFlatVectorsScorer.INSTANCE;
}
+
+ @Override
+ public PostingDecodingUtil newPostingDecodingUtil(IndexInput input) throws
IOException {
+ if (HAS_FAST_INTEGER_VECTORS && input instanceof MemorySegmentAccessInput
msai) {
+ MemorySegment ms = msai.segmentSliceOrNull(0, input.length());
Review Comment:
Right. I leaned this way to avoid paying the overhead per decoded block. If
segments > 16GB are not compound segments, then they would also need the doc
(or pos, or pay) file to exceed 16GB on its own, which is a pretty big segment.
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: issues-unsubscr...@lucene.apache.org
For queries about this service, please contact Infrastructure at:
us...@infra.apache.org
---------------------------------------------------------------------
To unsubscribe, e-mail: issues-unsubscr...@lucene.apache.org
For additional commands, e-mail: issues-h...@lucene.apache.org
