Jackie-Jiang opened a new issue #6902: URL: https://github.com/apache/incubator-pinot/issues/6902
1. Null value vector cannot be created on the output segments 2. New added columns can cause NPE The root cause of the issue is that we skip the record transformer within the `SegmentProcessorFramework`. For existing null values, `_nullValueFields` are not preserved within the `GenericRow`; For new added columns, the field will be `null` without the `NullValueTransformer`. Besides these issues, the new added derived column won't be generated as well. The solution is: 1. Backfill null values to the `GenericRow` in the `PinotSegmentRecordReader` 2. Use the default record transformer -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. For queries about this service, please contact Infrastructure at: us...@infra.apache.org --------------------------------------------------------------------- To unsubscribe, e-mail: commits-unsubscr...@pinot.apache.org For additional commands, e-mail: commits-h...@pinot.apache.org