egalpin commented on issue #10712: URL: https://github.com/apache/pinot/issues/10712#issuecomment-1734134107
@mcvsubbu I think the idea is that if multiple physical OFFLINE tables and multiple physical REALTIME tables could be composed into a single logical table, including maintaining the notion of a timeBoundary, then the segment count limitation could be mitigated by adding additional physical OFFLINE or REALTIME tables and including them in the "logical hybrid" table. I think it would be a great idea to eventually have hybrid tables represented using the same concept of physical/logical table so that hybrid tables would be less of a special case. That said, I think it might be worth separating that work into a distinct follow-up outside the scope of initially introducing physical/logical table feature. I'll try to capture the conversation so far here into a design doc to better allow organization of requirements, intentional punts/anti-features/follow-up features, as well as a place to share design ideas once we settle requirements. -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. To unsubscribe, e-mail: commits-unsubscr...@pinot.apache.org For queries about this service, please contact Infrastructure at: us...@infra.apache.org --------------------------------------------------------------------- To unsubscribe, e-mail: commits-unsubscr...@pinot.apache.org For additional commands, e-mail: commits-h...@pinot.apache.org
