saumya2700 commented on issue #8604: URL: https://github.com/apache/pinot/issues/8604#issuecomment-1125633524
> @saumya2700 You don't need to add the transform configs for every field. As i've pasted in my message above, all you need to do is remove the non-array fields from the fieldsToUnnest. Regarding the transform functions you're trying out, it will not work for the existing rows, because those rows don't have any way of knowing what "header" is. That information was only in the source data. To make it work in a backward compatible manner, you'll have to provide a "defaultValue" to the JSONPATHSTRING function as, JSONPATHSTRING(header, '$.trId', ''). It would be best to 1) try with the complex config or 2) reingest the data YEs it will not work for existing rows , but it is not working for new rows even. I dont want backward compatible just wanted to get data for new records in this new column. -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. To unsubscribe, e-mail: commits-unsubscr...@pinot.apache.org For queries about this service, please contact Infrastructure at: us...@infra.apache.org --------------------------------------------------------------------- To unsubscribe, e-mail: commits-unsubscr...@pinot.apache.org For additional commands, e-mail: commits-h...@pinot.apache.org
