mcvsubbu commented on issue #10712: URL: https://github.com/apache/pinot/issues/10712#issuecomment-1693683622
> > Are you suggesting that we somehow map one logical table to multiple physical tables at the same time (perhaps the phys table name somehow chosen during query time). Or, are we saying that there can be several physical tables underneath, we just nail one of them at any given time? > > For me, the former of being able to hit multiple/all tables with the same logical name would be an awesome feature. Is initial design discussion ok here? I have a few questions that would help inform design considerations: > > 1. Where would the mapping between physical/logical table names exist? Zookeeper? I would advocate strongly for a singleton record containing all of the mappings; this way, bulk changes can be applied atomically (ex. remove alias from one table, add to a different table happening atomically is great to have) > > 2. Presumably this mapping would be cached/stored locally within Brokers for performance reasons? Thoughts on managing that aspect? > > > There are quite a few cases I can imagine making use of this so I'd like to get started in the near term once we reach an agreeable design 😊 Thanks in advance! We are discussing requirements here, not design. What is the use case that drives mapping mulitple physical tables to the same logical table? Can you elaborate a bit? Do the physical tables have the same schema? How does a given query (that may only have the logical tablename) choose between the physical tables to run the query in? -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. To unsubscribe, e-mail: commits-unsubscr...@pinot.apache.org For queries about this service, please contact Infrastructure at: us...@infra.apache.org --------------------------------------------------------------------- To unsubscribe, e-mail: commits-unsubscr...@pinot.apache.org For additional commands, e-mail: commits-h...@pinot.apache.org
