[ https://issues.apache.org/jira/browse/SOLR-14454?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17108603#comment-17108603 ]
David Smiley commented on SOLR-14454: ------------------------------------- Also, if you write a leading vInt into the bytes to store the length of the value, then you could add more values and thus support multiValued. Even if you don't have time to support multiValued support today, I think it's important for back-compatibility when it's eventually supported to do it this way from the beginning. > support for UTF-8 (string) types with DocValuesType.BINARY > ---------------------------------------------------------- > > Key: SOLR-14454 > URL: https://issues.apache.org/jira/browse/SOLR-14454 > Project: Solr > Issue Type: New Feature > Security Level: Public(Default Security Level. Issues are Public) > Components: Schema and Analysis > Affects Versions: master (9.0) > Reporter: Michael Gibney > Priority: Minor > Time Spent: 10m > Remaining Estimate: 0h > > The goal is to add support for string fields with arbitrarily large values in > the {{/export}} handler and streaming expressions. > {{StrField}} values are currently limited to 32766 bytes for the case where > {{indexed=true}} or {{docValues=true}}. Exceeding this value triggers an > "immense field" warning, and causes indexing to fail for the associated input > doc. > Configuring a {{StrField}} field as "{{indexed=false docValues=false}}" > removes this size limitation, so it is already possible to have large > _stored_ {{StrField}} values. But the "{{docValues=true}}" prerequisite for > the {{/export}} handler (and consequently for streaming expressions) limits > the size of field that can be used in conjunction with these features. > Adding support for UTF-8/string field types with {{DocValuesType.BINARY}} > would address this limitation and allow considerable flexibility in the > implementation of custom field types. N.b.: this would address field value > retrieval use cases only (e.g., {{/export}} and {{useDocValuesAsStored}}); > neither sorting nor faceting would be supported. -- This message was sent by Atlassian Jira (v8.3.4#803005) --------------------------------------------------------------------- To unsubscribe, e-mail: issues-unsubscr...@lucene.apache.org For additional commands, e-mail: issues-h...@lucene.apache.org