johighley commented on issue #6524: URL: https://github.com/apache/incubator-pinot/issues/6524#issuecomment-797682547
I was told to add this use case to this issue: We're ingesting millions of records via Kafka to a realtime table as fast as Pinot can consume them. It's 1 record per message. We need some way to monitor the message ingestion for failures, especially due to data issues (ex: alpha chars in numeric field, missing data, or json format issue). Looking through server logs isn't practical. Ideally, Pinot would provide the raw message and the error it encountered. ---------------------------------------------------------------- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. For queries about this service, please contact Infrastructure at: us...@infra.apache.org --------------------------------------------------------------------- To unsubscribe, e-mail: commits-unsubscr...@pinot.apache.org For additional commands, e-mail: commits-h...@pinot.apache.org
