itschrispeck commented on PR #13948: URL: https://github.com/apache/pinot/pull/13948#issuecomment-2362696585
> I have a question that might be unrelated, but I’d appreciate your expertise. is it possible to rebuild the segment1 indexes into Analyzer2 and QueryParserForAnalyzer2 format? if possible, how expensive is it? This diff would be a pre-req to do so, but that functionality would still have to be added in `TextIndexHandler` as mentioned. Essentially we'd read the Lucene index metadata added by this diff and decide if we should overwrite the existing index. Expense is mostly determined by Analyzer choice, but in general Lucene index build is expensive relative to Pinot's other indexes. I have not added the functionality in this PR since internally we take advantage of the fact that it is _not_ currently possible. When that functionality is added, we'll add some config to enable/disable it as well. -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. To unsubscribe, e-mail: commits-unsubscr...@pinot.apache.org For queries about this service, please contact Infrastructure at: us...@infra.apache.org --------------------------------------------------------------------- To unsubscribe, e-mail: commits-unsubscr...@pinot.apache.org For additional commands, e-mail: commits-h...@pinot.apache.org
