Re: [I] Support Hudi `DeltaStreamer` compatible feature [iceberg]

2024-09-21 Thread via GitHub
github-actions[bot] commented on issue #8724: URL: https://github.com/apache/iceberg/issues/8724#issuecomment-2365374235 This issue has been automatically marked as stale because it has been open for 180 days with no activity. It will be closed in next 14 days if no further activity occurs.

Re: [I] Support Hudi `DeltaStreamer` compatible feature [iceberg]

2023-10-09 Thread via GitHub
pvary commented on issue #8724: URL: https://github.com/apache/iceberg/issues/8724#issuecomment-1752813481 > Yes, Flink is great but still we need to write some code for ingestion, right..? Yes, you need to write Flink the job's code. If your goal is just a simple dump, then it could

Re: [I] Support Hudi `DeltaStreamer` compatible feature [iceberg]

2023-10-07 Thread via GitHub
LittleWat commented on issue #8724: URL: https://github.com/apache/iceberg/issues/8724#issuecomment-1751663468 Yes, Flink is great but still we need to write some code for ingestion, right..? [Hudi Deltastreamer](https://hudi.apache.org/docs/0.13.1/hoodie_deltastreamer/#deltastreamer) is a

Re: [I] Support Hudi `DeltaStreamer` compatible feature [iceberg]

2023-10-06 Thread via GitHub
pvary commented on issue #8724: URL: https://github.com/apache/iceberg/issues/8724#issuecomment-1751614785 We use Flink for the ingestion. Flink supports wide range of sources, and the Iceberg FlinkSink enables you to write them to Iceberg tables. -- This is an automated message from t

Re: [I] Support Hudi `DeltaStreamer` compatible feature [iceberg]

2023-10-06 Thread via GitHub
LittleWat commented on issue #8724: URL: https://github.com/apache/iceberg/issues/8724#issuecomment-1751560189 KafkaConnect is cool! Deltastreamer also supports [the distributed-file-system ingestion](https://hudi.apache.org/docs/0.13.1/hoodie_deltastreamer/#distributed-file-system-dfs). U

Re: [I] Support Hudi `DeltaStreamer` compatible feature [iceberg]

2023-10-05 Thread via GitHub
amogh-jahagirdar commented on issue #8724: URL: https://github.com/apache/iceberg/issues/8724#issuecomment-1750065550 I'm not very familiar with Hudi Deltastreamer but for Kafka ingest into Iceberg tables, @bryanck is working on contributing a Kafka sink connector into the project https://g