Re: [PR] Only consider clauses whose cost is less than the lead cost to compute block boundaries in WANDScorer. [lucene]

2024-11-19 Thread via GitHub
jpountz merged PR #14000: URL: https://github.com/apache/lucene/pull/14000 -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. To unsubscribe, e-mail: issues-unsubscr...@lucene.apa

Re: [PR] Add IndexInput isLoaded [lucene]

2024-11-19 Thread via GitHub
ChrisHegarty commented on PR #13998: URL: https://github.com/apache/lucene/pull/13998#issuecomment-2485150279 > yes, agreed about `mincore` as a followup. Let's use existing JDK plumbing as a start as done here. ++ > i'm very much against using `mlock`, there are so many prob

[I] [Discuss] Reducing allocations in HnswUtil::markRooted [lucene]

2024-11-19 Thread via GitHub
viswanathk opened a new issue, #14002: URL: https://github.com/apache/lucene/issues/14002 ### Description I was going through the nightly benchmark runs and came across this https://blunders.io/jfr-demo/indexing-1kb-vectors-2024.11.17.18.04.47/allocations-drill-down Almost 7% o

Re: [PR] Introduces IndexInput#updateReadAdvice to change the ReadAdvice while merging vectors [lucene]

2024-11-19 Thread via GitHub
shatejas commented on PR #13985: URL: https://github.com/apache/lucene/pull/13985#issuecomment-2486363537 Thanks @ChrisHegarty! I do need help with merging this. I have updated `CHANGES.txt`. Do let me know the process of backporting it - if it needs cherry-picking and raising a new

Re: [PR] Optimize slice calculation in IndexSearcher a little [lucene]

2024-11-19 Thread via GitHub
github-actions[bot] commented on PR #13860: URL: https://github.com/apache/lucene/pull/13860#issuecomment-2487035986 This PR has not had activity in the past 2 weeks, labeling it as stale. If the PR is waiting for review, notify the d...@lucene.apache.org list. Thank you for your contributi

Re: [I] Add refinement of quantized vector scores with fp distance calculations [lucene]

2024-11-19 Thread via GitHub
dungba88 commented on issue #13564: URL: https://github.com/apache/lucene/issues/13564#issuecomment-2487581544 Relatedly, I got to [this paper](https://arxiv.org/abs/2411.12229) today. It mainly talks about integrating RaBitQ with graph search, but the part about reducing random access intr

Re: [PR] [WIP] Multi-Vector support for HNSW search [lucene]

2024-11-19 Thread via GitHub
vigyasharma commented on PR #13525: URL: https://github.com/apache/lucene/pull/13525#issuecomment-2487589088 > My concern is that this proposal doesn’t truly add support for independent multi-vectors. That's a valid concern. I've been thinking about a more comprehensive multi-vector