adasari opened a new issue, #11436: URL: https://github.com/apache/iceberg/issues/11436
### Feature Request / Improvement We're currently using FlinkCDC to create an Iceberg database from a source PostgreSQL database, which necessitates a one-to-one mapping between source tables and Iceberg tables. Currently, the FlinkSink writes the entire data stream to a single Iceberg table, as the table name is provided as an input configuration. While CDC is effective for creating replicated databases and synchronizing data between source and destination, it poses a challenge to split the incoming stream into multiple streams—one for each table—especially when the tables are not predefined. This limitation complicates the use of the existing FlinkSink. Could you please consider adding support for routing the incoming data stream into multiple tables by implementing a custom table name extractor method that operates on the incoming RowData/Row? This would allow for single table usage when the extractor consistently returns a single table for all incoming rows. I’d appreciate your thoughts on this. Thank you! ### Query engine Flink ### Willingness to contribute - [ ] I can contribute this improvement/feature independently - [ ] I would be willing to contribute this improvement/feature with guidance from the Iceberg community - [X] I cannot contribute this improvement/feature at this time -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. To unsubscribe, e-mail: issues-unsubscr...@iceberg.apache.org.apache.org For queries about this service, please contact Infrastructure at: us...@infra.apache.org --------------------------------------------------------------------- To unsubscribe, e-mail: issues-unsubscr...@iceberg.apache.org For additional commands, e-mail: issues-h...@iceberg.apache.org
