somandal opened a new pull request, #9810: URL: https://github.com/apache/pinot/pull/9810
Related OSS Issue: https://github.com/apache/pinot/issues/6473 Related OSS PRs: https://github.com/apache/pinot/pull/9333 https://github.com/apache/pinot/pull/9740 Document outlining the breakup of PRs and the approach to solve various sub-problems of this issue: https://docs.google.com/document/d/1MNLLhYCg5e-UFBQ6wTBODd41sDsbjevwRfwoGuNowWw/edit?usp=sharing This PR adds support for the following operations related to forward index disabled columns: - Adds default column handling for MV forward index disabled columns. Creates an inverted index for default MV columns with forward index disabled instead of a forward index. - Adds a utility class to generate the forward index from the inverted index and dictionary. - Adds support to enable the forward index on existing columns with the forward index disabled. - Adds support to create a temporary forward index if other indexes are added for columns where the forward index is disabled. This PR does not add support for the following (and there will be follow up PRs to handle these): - Dealing with duplicated entries within a multi-value row. - Derived column handling. Tests includes: - Segment reload path for default columns and existing columns - Query path to ensure queries work when the forward index is re-enabled cc @siddharthteotia @Jackie-Jiang @vvivekiyer -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. To unsubscribe, e-mail: commits-unsubscr...@pinot.apache.org For queries about this service, please contact Infrastructure at: us...@infra.apache.org --------------------------------------------------------------------- To unsubscribe, e-mail: commits-unsubscr...@pinot.apache.org For additional commands, e-mail: commits-h...@pinot.apache.org
