KKcorps opened a new pull request, #9511: URL: https://github.com/apache/pinot/pull/9511
This PR continues the effort from #9163 We already added `continueOnError` flag in previous PRs to handle errors gracefully. This PR extends the same configs to handle decoder exceptions as well. A new config flag has also been added called `skipPartialRecords` through which user can decided whether to consume these partial records or not after `continueOnError`. The PR also adds `$INCOMPETE_RECORDS_KEY$` as a schema column so that users can query which records need to be fixed in the table. The current implmentation is not ideal and should ideally be through VirtualColumnProvider. However, it would need some interface changes in virtual column classes. -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. To unsubscribe, e-mail: commits-unsubscr...@pinot.apache.org For queries about this service, please contact Infrastructure at: us...@infra.apache.org --------------------------------------------------------------------- To unsubscribe, e-mail: commits-unsubscr...@pinot.apache.org For additional commands, e-mail: commits-h...@pinot.apache.org
