mikemccand opened a new pull request, #13767: URL: https://github.com/apache/lucene/pull/13767
It is buggy today (see #13519). 4 and 7 bit quantization still work. It's a bit tricky because 9.11 indices may have 8 bit compressed vectors which are buggy at search time (and users may not realize it, or may not be using them at search time). But the index is still intact since we keep the original full float precision vectors. Merges will write new segments (at 4 or 8 bit quantization, or no quantization) and be correct. So, users can force rewrite all their 9.11 written segments (or reindex those docs), and can change to 4 or 7 bit quantization for newly indexed documents. The 9.11 index is still usable. (I added a couple test cases confirming that one can indeed change their mind, indexing a given vector field first with 4 bit quantization, then later (new IndexWriter / Codec) with 7 bit or with no quantization.) I added MIGRATE.md explanation. Separately, I also tightned up the `compress` boolean to throw an exception unless bits=4. Previously (for 7 bit compression) it silently ignored `compress=true` for 7, 8 bit quantization. And tried to improve its javadocs a bit. -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. To unsubscribe, e-mail: issues-unsubscr...@lucene.apache.org For queries about this service, please contact Infrastructure at: us...@infra.apache.org --------------------------------------------------------------------- To unsubscribe, e-mail: issues-unsubscr...@lucene.apache.org For additional commands, e-mail: issues-h...@lucene.apache.org
