[
https://issues.apache.org/jira/browse/LUCENE-10471?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17579875#comment-17579875
]
Robert Muir commented on LUCENE-10471:
--------------------------------------
It is also terrible that this issue says 2048 but somehow that already blew up
to 16k here.
-1 to 16K. Its unnecessarily large and puts the project at risk in the future.
We can debate 2048.
> Increase the number of dims for KNN vectors to 2048
> ---------------------------------------------------
>
> Key: LUCENE-10471
> URL: https://issues.apache.org/jira/browse/LUCENE-10471
> Project: Lucene - Core
> Issue Type: Wish
> Reporter: Mayya Sharipova
> Priority: Trivial
> Time Spent: 40m
> Remaining Estimate: 0h
>
> The current maximum allowed number of dimensions is equal to 1024. But we see
> in practice a couple well-known models that produce vectors with > 1024
> dimensions (e.g
> [mobilenet_v2|https://tfhub.dev/google/imagenet/mobilenet_v2_035_224/feature_vector/1]
> uses 1280d vectors, OpenAI / GPT-3 Babbage uses 2048d vectors). Increasing
> max dims to `2048` will satisfy these use cases.
> I am wondering if anybody has strong objections against this.
--
This message was sent by Atlassian Jira
(v8.20.10#820010)
---------------------------------------------------------------------
To unsubscribe, e-mail: [email protected]
For additional commands, e-mail: [email protected]