rsrkpatwari1234 opened a new pull request, #16113:
URL: https://github.com/apache/pinot/pull/16113
This PR introduces a new field within Complex Type configuration to decide
whether to retain the original fields of array object after applying unnest
transformation. We observed high GC time due to #13490 for pinot server nodes
in the past for tables using complext type transformation. This change allows
us to utilise this feature for specific tables without impacting other tables.
### Key Features:
- Introduced boolean field `retainOriginalFieldInUnnest` in
`ComplexTypeConfig`
```
"ingestionConfig": {
"streamIngestionConfig": {
.............................
},
"complexTypeConfig": {
"fieldsToUnnest": [
.......
],
"retainOriginalFieldInUnnest": true # Default : false
}
},
```
### Testing:
-
`feature` `bugfix`
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: commits-unsubscr...@pinot.apache.org
For queries about this service, please contact Infrastructure at:
us...@infra.apache.org
---------------------------------------------------------------------
To unsubscribe, e-mail: commits-unsubscr...@pinot.apache.org
For additional commands, e-mail: commits-h...@pinot.apache.org
