egalpin commented on issue #10712: URL: https://github.com/apache/pinot/issues/10712#issuecomment-1692546878
>Are you suggesting that we somehow map one logical table to multiple physical tables at the same time (perhaps the phys table name somehow chosen during query time). Or, are we saying that there can be several physical tables underneath, we just nail one of them at any given time? For me, the former of being able to hit multiple/all tables with the same logical name would be an awesome feature. Is initial design discussion ok here? I have a few questions that would help inform design considerations: 1. Where would the mapping between physical/logical table names exist? Zookeeper? I would advocate strongly for a singleton record containing all of the mappings; this way, bulk changes can be applied atomically (ex. remove alias from one table, add to a different table happening atomically is great to have) 3. Presumably this mapping would be cached/stored locally within Brokers for performance reasons? Thoughts on managing that aspect? There are quite a few cases I can imagine making use of this so I'd like to get started in the near term once we reach an agreeable design 😊 Thanks in advance! -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. To unsubscribe, e-mail: commits-unsubscr...@pinot.apache.org For queries about this service, please contact Infrastructure at: us...@infra.apache.org --------------------------------------------------------------------- To unsubscribe, e-mail: commits-unsubscr...@pinot.apache.org For additional commands, e-mail: commits-h...@pinot.apache.org
