Jackie-Jiang opened a new pull request, #14396: URL: https://github.com/apache/pinot/pull/14396
- Removed `skipUnParseableLines` flag and always skip un-parseable lines - Add `stopOnError` flag to stop reading records on error The new record reader is able to handle multi-line values as well as un-parseable lines. When a line cannot be parsed, it resumes from the next line. More importantly, it doesn't throw exception in `hasNext()`, and the exception is cached and thrown when calling `next()`. This aligns with the high level abstraction of ingestion flow. -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. To unsubscribe, e-mail: commits-unsubscr...@pinot.apache.org For queries about this service, please contact Infrastructure at: us...@infra.apache.org --------------------------------------------------------------------- To unsubscribe, e-mail: commits-unsubscr...@pinot.apache.org For additional commands, e-mail: commits-h...@pinot.apache.org
