Re: [PR] Flink: put everything together for range distribution in Flink sink [iceberg]

2024-08-19 Thread via GitHub
stevenzwu merged PR #10859: URL: https://github.com/apache/iceberg/pull/10859 -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. To unsubscribe, e-mail: issues-unsubscr...@iceberg

Re: [PR] Flink: put everything together for range distribution in Flink sink [iceberg]

2024-08-16 Thread via GitHub
stevenzwu commented on code in PR #10859: URL: https://github.com/apache/iceberg/pull/10859#discussion_r1720073124 ## docs/docs/flink-configuration.md: ## @@ -146,14 +146,54 @@ INSERT INTO tableName /*+ OPTIONS('upsert-enabled'='true') */ ... ``` -| Flink option |

Re: [PR] Flink: put everything together for range distribution in Flink sink [iceberg]

2024-08-16 Thread via GitHub
stevenzwu commented on code in PR #10859: URL: https://github.com/apache/iceberg/pull/10859#discussion_r1720070350 ## docs/docs/flink-writes.md: ## @@ -262,6 +262,107 @@ INSERT INTO tableName /*+ OPTIONS('upsert-enabled'='true') */ Check out all the options here: [write-opt

Re: [PR] Flink: put everything together for range distribution in Flink sink [iceberg]

2024-08-15 Thread via GitHub
pvary commented on code in PR #10859: URL: https://github.com/apache/iceberg/pull/10859#discussion_r1719365548 ## flink/v1.19/flink/src/main/java/org/apache/iceberg/flink/sink/FlinkSink.java: ## @@ -548,21 +609,52 @@ private DataStream distributeDataStream( }

Re: [PR] Flink: put everything together for range distribution in Flink sink [iceberg]

2024-08-15 Thread via GitHub
pvary commented on code in PR #10859: URL: https://github.com/apache/iceberg/pull/10859#discussion_r1719362536 ## flink/v1.19/flink/src/main/java/org/apache/iceberg/flink/sink/FlinkSink.java: ## @@ -233,15 +239,66 @@ public Builder flinkConf(ReadableConfig config) { * @ret

Re: [PR] Flink: put everything together for range distribution in Flink sink [iceberg]

2024-08-15 Thread via GitHub
pvary commented on code in PR #10859: URL: https://github.com/apache/iceberg/pull/10859#discussion_r1719357623 ## docs/docs/flink-writes.md: ## @@ -262,6 +262,107 @@ INSERT INTO tableName /*+ OPTIONS('upsert-enabled'='true') */ Check out all the options here: [write-options

Re: [PR] Flink: put everything together for range distribution in Flink sink [iceberg]

2024-08-15 Thread via GitHub
pvary commented on code in PR #10859: URL: https://github.com/apache/iceberg/pull/10859#discussion_r1719348803 ## docs/docs/flink-configuration.md: ## @@ -146,14 +146,54 @@ INSERT INTO tableName /*+ OPTIONS('upsert-enabled'='true') */ ... ``` -| Flink option | Def

Re: [PR] Flink: put everything together for range distribution in Flink sink [iceberg]

2024-08-15 Thread via GitHub
stevenzwu commented on code in PR #10859: URL: https://github.com/apache/iceberg/pull/10859#discussion_r1719333729 ## flink/v1.19/flink/src/main/java/org/apache/iceberg/flink/FlinkWriteOptions.java: ## @@ -60,6 +61,14 @@ private FlinkWriteOptions() {} public static final Conf

Re: [PR] Flink: put everything together for range distribution in Flink sink [iceberg]

2024-08-15 Thread via GitHub
stevenzwu commented on code in PR #10859: URL: https://github.com/apache/iceberg/pull/10859#discussion_r1719333729 ## flink/v1.19/flink/src/main/java/org/apache/iceberg/flink/FlinkWriteOptions.java: ## @@ -60,6 +61,14 @@ private FlinkWriteOptions() {} public static final Conf

Re: [PR] Flink: put everything together for range distribution in Flink sink [iceberg]

2024-08-15 Thread via GitHub
stevenzwu commented on code in PR #10859: URL: https://github.com/apache/iceberg/pull/10859#discussion_r1719331652 ## flink/v1.19/flink/src/test/java/org/apache/iceberg/flink/sink/TestFlinkIcebergSinkDistributionMode.java: ## @@ -177,4 +185,288 @@ public void testOverrideWriteC

Re: [PR] Flink: put everything together for range distribution in Flink sink [iceberg]

2024-08-12 Thread via GitHub
pvary commented on code in PR #10859: URL: https://github.com/apache/iceberg/pull/10859#discussion_r1713628882 ## flink/v1.19/flink/src/test/java/org/apache/iceberg/flink/sink/TestFlinkIcebergSinkDistributionMode.java: ## @@ -177,4 +185,288 @@ public void testOverrideWriteConfi

Re: [PR] Flink: put everything together for range distribution in Flink sink [iceberg]

2024-08-12 Thread via GitHub
pvary commented on code in PR #10859: URL: https://github.com/apache/iceberg/pull/10859#discussion_r1713616551 ## docs/docs/flink-writes.md: ## @@ -262,6 +262,106 @@ INSERT INTO tableName /*+ OPTIONS('upsert-enabled'='true') */ Check out all the options here: [write-options

Re: [PR] Flink: put everything together for range distribution in Flink sink [iceberg]

2024-08-06 Thread via GitHub
stevenzwu commented on code in PR #10859: URL: https://github.com/apache/iceberg/pull/10859#discussion_r1706431358 ## flink/v1.19/flink/src/test/java/org/apache/iceberg/flink/sink/TestFlinkIcebergSinkDistributionMode.java: ## @@ -177,4 +185,288 @@ public void testOverrideWriteC

Re: [PR] Flink: put everything together for range distribution in Flink sink [iceberg]

2024-08-06 Thread via GitHub
stevenzwu commented on code in PR #10859: URL: https://github.com/apache/iceberg/pull/10859#discussion_r1706418907 ## flink/v1.19/flink/src/main/java/org/apache/iceberg/flink/sink/FlinkSink.java: ## @@ -548,21 +599,46 @@ private DataStream distributeDataStream( }

Re: [PR] Flink: put everything together for range distribution in Flink sink [iceberg]

2024-08-06 Thread via GitHub
stevenzwu commented on code in PR #10859: URL: https://github.com/apache/iceberg/pull/10859#discussion_r1706409470 ## flink/v1.19/flink/src/main/java/org/apache/iceberg/flink/sink/FlinkSink.java: ## @@ -233,15 +239,56 @@ public Builder flinkConf(ReadableConfig config) { *

Re: [PR] Flink: put everything together for range distribution in Flink sink [iceberg]

2024-08-06 Thread via GitHub
stevenzwu commented on code in PR #10859: URL: https://github.com/apache/iceberg/pull/10859#discussion_r1706409470 ## flink/v1.19/flink/src/main/java/org/apache/iceberg/flink/sink/FlinkSink.java: ## @@ -233,15 +239,56 @@ public Builder flinkConf(ReadableConfig config) { *

Re: [PR] Flink: put everything together for range distribution in Flink sink [iceberg]

2024-08-06 Thread via GitHub
stevenzwu commented on code in PR #10859: URL: https://github.com/apache/iceberg/pull/10859#discussion_r1706398874 ## docs/docs/flink-writes.md: ## @@ -262,6 +262,91 @@ INSERT INTO tableName /*+ OPTIONS('upsert-enabled'='true') */ Check out all the options here: [write-opti

Re: [PR] Flink: put everything together for range distribution in Flink sink [iceberg]

2024-08-06 Thread via GitHub
stevenzwu commented on code in PR #10859: URL: https://github.com/apache/iceberg/pull/10859#discussion_r1706398874 ## docs/docs/flink-writes.md: ## @@ -262,6 +262,91 @@ INSERT INTO tableName /*+ OPTIONS('upsert-enabled'='true') */ Check out all the options here: [write-opti

Re: [PR] Flink: put everything together for range distribution in Flink sink [iceberg]

2024-08-06 Thread via GitHub
stevenzwu commented on code in PR #10859: URL: https://github.com/apache/iceberg/pull/10859#discussion_r1706396475 ## docs/docs/flink-writes.md: ## @@ -262,6 +262,91 @@ INSERT INTO tableName /*+ OPTIONS('upsert-enabled'='true') */ Check out all the options here: [write-opti

Re: [PR] Flink: put everything together for range distribution in Flink sink [iceberg]

2024-08-06 Thread via GitHub
stevenzwu commented on code in PR #10859: URL: https://github.com/apache/iceberg/pull/10859#discussion_r1706343923 ## flink/v1.19/flink/src/main/java/org/apache/iceberg/flink/FlinkWriteOptions.java: ## @@ -60,6 +61,14 @@ private FlinkWriteOptions() {} public static final Conf

Re: [PR] Flink: put everything together for range distribution in Flink sink [iceberg]

2024-08-06 Thread via GitHub
stevenzwu commented on PR #10859: URL: https://github.com/apache/iceberg/pull/10859#issuecomment-2271588597 > @rodmeneses: This will effect your PR as well. Please sync with @stevenzwu about the order of the commits I don't think we should worry about the order. we can integrate the r

Re: [PR] Flink: put everything together for range distribution in Flink sink [iceberg]

2024-08-06 Thread via GitHub
pvary commented on PR #10859: URL: https://github.com/apache/iceberg/pull/10859#issuecomment-2270944191 @rodmeneses: This will effect your PR as well. Please sync with @stevenzwu about the order of the commits -- This is an automated message from the Apache Git Service. To respond to the

Re: [PR] Flink: put everything together for range distribution in Flink sink [iceberg]

2024-08-06 Thread via GitHub
pvary commented on code in PR #10859: URL: https://github.com/apache/iceberg/pull/10859#discussion_r1705298661 ## flink/v1.19/flink/src/test/java/org/apache/iceberg/flink/sink/TestFlinkIcebergSinkDistributionMode.java: ## @@ -177,4 +185,288 @@ public void testOverrideWriteConfi

Re: [PR] Flink: put everything together for range distribution in Flink sink [iceberg]

2024-08-06 Thread via GitHub
pvary commented on code in PR #10859: URL: https://github.com/apache/iceberg/pull/10859#discussion_r1705286597 ## flink/v1.19/flink/src/main/java/org/apache/iceberg/flink/sink/FlinkSink.java: ## @@ -548,21 +599,46 @@ private DataStream distributeDataStream( }

Re: [PR] Flink: put everything together for range distribution in Flink sink [iceberg]

2024-08-06 Thread via GitHub
pvary commented on code in PR #10859: URL: https://github.com/apache/iceberg/pull/10859#discussion_r1705281270 ## flink/v1.19/flink/src/main/java/org/apache/iceberg/flink/sink/FlinkSink.java: ## @@ -233,15 +239,56 @@ public Builder flinkConf(ReadableConfig config) { * @ret

Re: [PR] Flink: put everything together for range distribution in Flink sink [iceberg]

2024-08-06 Thread via GitHub
pvary commented on code in PR #10859: URL: https://github.com/apache/iceberg/pull/10859#discussion_r1705279951 ## docs/docs/flink-writes.md: ## @@ -262,6 +262,91 @@ INSERT INTO tableName /*+ OPTIONS('upsert-enabled'='true') */ Check out all the options here: [write-options]

Re: [PR] Flink: put everything together for range distribution in Flink sink [iceberg]

2024-08-06 Thread via GitHub
pvary commented on code in PR #10859: URL: https://github.com/apache/iceberg/pull/10859#discussion_r1705275468 ## docs/docs/flink-writes.md: ## @@ -262,6 +262,91 @@ INSERT INTO tableName /*+ OPTIONS('upsert-enabled'='true') */ Check out all the options here: [write-options]

Re: [PR] Flink: put everything together for range distribution in Flink sink [iceberg]

2024-08-06 Thread via GitHub
pvary commented on code in PR #10859: URL: https://github.com/apache/iceberg/pull/10859#discussion_r1705247759 ## docs/docs/flink-writes.md: ## @@ -262,6 +262,91 @@ INSERT INTO tableName /*+ OPTIONS('upsert-enabled'='true') */ Check out all the options here: [write-options]

Re: [PR] Flink: put everything together for range distribution in Flink sink [iceberg]

2024-08-06 Thread via GitHub
pvary commented on code in PR #10859: URL: https://github.com/apache/iceberg/pull/10859#discussion_r1705245993 ## docs/docs/flink-writes.md: ## @@ -262,6 +262,91 @@ INSERT INTO tableName /*+ OPTIONS('upsert-enabled'='true') */ Check out all the options here: [write-options]

Re: [PR] Flink: put everything together for range distribution in Flink sink [iceberg]

2024-08-06 Thread via GitHub
pvary commented on code in PR #10859: URL: https://github.com/apache/iceberg/pull/10859#discussion_r1705245091 ## flink/v1.19/flink/src/main/java/org/apache/iceberg/flink/FlinkWriteOptions.java: ## @@ -60,6 +61,14 @@ private FlinkWriteOptions() {} public static final ConfigOp

Re: [PR] Flink: put everything together for range distribution in Flink sink [iceberg]

2024-08-02 Thread via GitHub
stevenzwu commented on code in PR #10859: URL: https://github.com/apache/iceberg/pull/10859#discussion_r1702143575 ## flink/v1.19/flink/src/main/java/org/apache/iceberg/flink/sink/FlinkSink.java: ## @@ -349,18 +396,20 @@ private DataStreamSink chainIcebergOperators() { /