npawar commented on issue #7004: URL: https://github.com/apache/incubator-pinot/issues/7004#issuecomment-854909817
i like the idea of making it a virtual column, and having it be always present, “$offset” since we wont know the datatype of the offset (kafka is long, kinesis sequence numbers exceed long range, hence are string) we could keep the offset datatype as string? this would have serialized value of whatever the stream’s implementation of StreamPartitionMsgOffset is a segment can have only 1 sorted index. So it wont be a good idea to make it have sorted index. Do we need index by default? -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. For queries about this service, please contact Infrastructure at: us...@infra.apache.org --------------------------------------------------------------------- To unsubscribe, e-mail: commits-unsubscr...@pinot.apache.org For additional commands, e-mail: commits-h...@pinot.apache.org
