mcvsubbu commented on issue #7004: URL: https://github.com/apache/incubator-pinot/issues/7004#issuecomment-884345130
> Then perhaps we can make these columns opt-in based on configurations? Based on my observations at Uber, a `_key` column would be useful, and for some topics the key is computed on the fly by deriving from multiple fields in the topic. I can also see the value of offset, especially for CDC use cases where events are sorted in the topic partition. Like I mentioned before, making these configurable goes without saying. We have production use cases that ingest at extremely high rate while still serving queries (also at a very high QPS). We cannot afford to configure this in. -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. To unsubscribe, e-mail: commits-unsubscr...@pinot.apache.org For queries about this service, please contact Infrastructure at: us...@infra.apache.org --------------------------------------------------------------------- To unsubscribe, e-mail: commits-unsubscr...@pinot.apache.org For additional commands, e-mail: commits-h...@pinot.apache.org