xiangfu0 opened a new pull request, #17998: URL: https://github.com/apache/pinot/pull/17998
## Summary - remove the native text index reader, creator, mutable index, benchmark, and native-only tests - make Pinot text indexing Lucene-only and reject `fstType=native` text index configurations - clean up legacy `.nativetext.idx` files during reload and rebuild Lucene text indexes when text indexing is still configured - remove `TEXT_CONTAINS` support because it depended on the native text index implementation ## Why Pinot is removing native text indices, but the codebase still carried native-specific implementations, query handling, tests, and benchmarks. This change removes those paths and leaves only the compatibility hooks needed to reject old configs and clean up old on-disk native files. ## User Impact - TEXT indexes now use Lucene only. - Existing native text index files are removed on reload instead of being treated as live text indexes. - `TEXT_CONTAINS` is no longer supported. - Table configs that still specify native text indexing are rejected instead of silently using the removed implementation. ## How To Reproduce 1. Configure a TEXT index with `fstType=native`, or load a segment that still contains a `.nativetext.idx` file. 2. Observe that Pinot previously still carried native text index code paths, native-only query behavior, and comparison coverage. 3. Apply this change and reload the segment or validate the table config again. ## Validation - `./mvnw -pl pinot-core,pinot-segment-local,pinot-segment-spi,pinot-query-runtime,pinot-integration-tests,pinot-perf spotless:apply -DskipTests` - `./mvnw -pl pinot-core,pinot-segment-local,pinot-segment-spi,pinot-query-runtime,pinot-integration-tests,pinot-perf checkstyle:check license:format license:check -DskipTests` - `./mvnw -pl pinot-core,pinot-query-runtime -am -Dtest=TextMatchTransformFunctionTest,TableIndexingTest,QueryRunnerTest -Dsurefire.failIfNoSpecifiedTests=false test -rf :pinot-core` - `./mvnw -pl pinot-segment-local,pinot-integration-tests,pinot-perf -am -DskipTests test-compile` -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. To unsubscribe, e-mail: [email protected] For queries about this service, please contact Infrastructure at: [email protected] --------------------------------------------------------------------- To unsubscribe, e-mail: [email protected] For additional commands, e-mail: [email protected]
