Jackie-Jiang commented on issue #15036: URL: https://github.com/apache/pinot/issues/15036#issuecomment-2657539572
I'm not sure if I completely get the question, but I can answer from the perspective of how Pinot handles streaming data. Unlike a lot of other databases that ingest streaming data as mini batches (where the delay happens), Pinot directly writes the data into index row-by-row and the data immediately becomes queryable. The delay of streaming data arriving Pinot to it becoming queryable is usually below millisecond (Pinot can easily ingest thousands of messages per second). If you count end-to-end time from data produced to streaming system (e.g. Kafka) to becoming queryable in Pinot, the delay is usually a few seconds, and majority of the delay is from streaming system processing then delivering the messages to Pinot. -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. To unsubscribe, e-mail: commits-unsubscr...@pinot.apache.org For queries about this service, please contact Infrastructure at: us...@infra.apache.org --------------------------------------------------------------------- To unsubscribe, e-mail: commits-unsubscr...@pinot.apache.org For additional commands, e-mail: commits-h...@pinot.apache.org
