npawar opened a new issue #5507: URL: https://github.com/apache/incubator-pinot/issues/5507
Refer to description in PR https://github.com/apache/incubator-pinot/pull/5492. This PR added deep extraction for JSON and AVRO. We want to do the same for all remaining extractors. End state: Every extractor should convert - nested structures to Map - Collection to Object[] - Number/String/bytebuffer to single value As a side effect, it would be great if we can clean up AvroUtils/JsonRecordExtractorUtils/RecordReaderUtils. All 3 of them are doing similar things, but there's some repetition across the 3. - JsonRecordExtractorUtils - handles instanceof Map, Collection, single-values, recursively - AvroUtils - handles instanceof Map, Collection, GenericData.Record, single-values, recursively - RecordReaderUtils - handles Collection, single-value, but only upto 1st depth. ---------------------------------------------------------------- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. For queries about this service, please contact Infrastructure at: us...@infra.apache.org --------------------------------------------------------------------- To unsubscribe, e-mail: commits-unsubscr...@pinot.apache.org For additional commands, e-mail: commits-h...@pinot.apache.org
