Pulkitg64 opened a new issue, #16725: URL: https://github.com/apache/lucene/issues/16725
### Description We have been adding FP16 support at various places in Lucene. Listing them below: * Add fp16 (float16) vector encoding support, no quantization support: #16383 * Add scalar quantization support for Fp16 vector encoding: #16473 * Fp16 re ranking and prefetch support: #16628 (Still not reviewed and merged) I think there are few more places where the Fp16 support is still missing from the main branch. This is an overview issue which tracks all the task where we need to add the support. Listing few tasks below which I am able to identify but there might be more: - [ ] `DiversifyingChildrenFloat16KnnVectorQuery` (lucene/join). Parent-block-join diversifying KNN. `Float` and `Byte` siblings exist; no fp16 variant. - [ ] `Float16VectorSimilarityQuery` (lucene/core). Threshold based vector search. `FloatVectorSimilarityQuery` and `ByteVectorSimilarityQuery` exist over `AbstractVectorSimilarityQuery` but no fp16 subclass. - [ ] `PanamaVectorUtilSupport`. `short[]` dotProduct/cosine/squareDistance currently delegate to the scalar implementation (`FLOAT16_DELEGATE`). SIMD vectorization is not possible today; it depends on a future JDK release adding `Float16Vector` support. - [ ] In Faiss codec. -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. To unsubscribe, e-mail: [email protected] For queries about this service, please contact Infrastructure at: [email protected] --------------------------------------------------------------------- To unsubscribe, e-mail: [email protected] For additional commands, e-mail: [email protected]
