Jackie-Jiang opened a new pull request, #14547: URL: https://github.com/apache/pinot/pull/14547
The concept is similar to #13572, which added a config to differentiate empty array and `null`. This PR makes this the default behavior (reverted the added config), and extend the behavior to all record extractors and preserve more values. `RecordExtractor` should preserve the values as much as possible because the extracted values are fed into ingestion transforms. This PR changes `RecordExtractor` to preserve the following values: - Empty array - Empty map - Map entries with null value `DataTypeTransformer` is able to handle these values properly. -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. To unsubscribe, e-mail: commits-unsubscr...@pinot.apache.org For queries about this service, please contact Infrastructure at: us...@infra.apache.org --------------------------------------------------------------------- To unsubscribe, e-mail: commits-unsubscr...@pinot.apache.org For additional commands, e-mail: commits-h...@pinot.apache.org
