Re: [PR] AWS: Set better defaults for S3 retry behaviour [iceberg]

2024-09-27 Thread via GitHub
danielcweeks commented on PR #11052: URL: https://github.com/apache/iceberg/pull/11052#issuecomment-2379484397 @ookumuso After thinking about this a little more, I'm increasingly concerned about the high value for defaults. If we look at this in isolation, it seems like the right thing to

Re: [PR] AWS: Set better defaults for S3 retry behaviour [iceberg]

2024-09-26 Thread via GitHub
amogh-jahagirdar commented on code in PR #11052: URL: https://github.com/apache/iceberg/pull/11052#discussion_r1777830154 ## aws/src/main/java/org/apache/iceberg/aws/s3/S3FileIOProperties.java: ## @@ -824,6 +889,65 @@ public void applyEndpointConfigurations(T builder) { }

Re: [PR] AWS: Set better defaults for S3 retry behaviour [iceberg]

2024-09-26 Thread via GitHub
danielcweeks commented on code in PR #11052: URL: https://github.com/apache/iceberg/pull/11052#discussion_r153530 ## aws/src/main/java/org/apache/iceberg/aws/s3/S3FileIOProperties.java: ## @@ -824,6 +889,65 @@ public void applyEndpointConfigurations(T builder) { }

Re: [PR] AWS: Set better defaults for S3 retry behaviour [iceberg]

2024-09-26 Thread via GitHub
danielcweeks commented on code in PR #11052: URL: https://github.com/apache/iceberg/pull/11052#discussion_r1777363011 ## aws/src/main/java/org/apache/iceberg/aws/s3/S3FileIOProperties.java: ## @@ -393,6 +403,21 @@ public class S3FileIOProperties implements Serializable { */

Re: [PR] AWS: Set better defaults for S3 retry behaviour [iceberg]

2024-09-26 Thread via GitHub
ookumuso commented on code in PR #11052: URL: https://github.com/apache/iceberg/pull/11052#discussion_r1777652003 ## aws/src/main/java/org/apache/iceberg/aws/s3/S3FileIOProperties.java: ## @@ -393,6 +403,21 @@ public class S3FileIOProperties implements Serializable { */ p

Re: [PR] AWS: Set better defaults for S3 retry behaviour [iceberg]

2024-09-26 Thread via GitHub
drewschleit commented on code in PR #11052: URL: https://github.com/apache/iceberg/pull/11052#discussion_r1777470471 ## aws/src/main/java/org/apache/iceberg/aws/s3/S3FileIOProperties.java: ## @@ -824,6 +889,65 @@ public void applyEndpointConfigurations(T builder) { } }

Re: [PR] AWS: Set better defaults for S3 retry behaviour [iceberg]

2024-09-26 Thread via GitHub
drewschleit commented on code in PR #11052: URL: https://github.com/apache/iceberg/pull/11052#discussion_r1777451480 ## aws/src/main/java/org/apache/iceberg/aws/s3/S3FileIOProperties.java: ## @@ -824,6 +889,65 @@ public void applyEndpointConfigurations(T builder) { } }

Re: [PR] AWS: Set better defaults for S3 retry behaviour [iceberg]

2024-09-26 Thread via GitHub
drewschleit commented on code in PR #11052: URL: https://github.com/apache/iceberg/pull/11052#discussion_r1777451480 ## aws/src/main/java/org/apache/iceberg/aws/s3/S3FileIOProperties.java: ## @@ -824,6 +889,65 @@ public void applyEndpointConfigurations(T builder) { } }

Re: [PR] AWS: Set better defaults for S3 retry behaviour [iceberg]

2024-09-26 Thread via GitHub
danielcweeks commented on code in PR #11052: URL: https://github.com/apache/iceberg/pull/11052#discussion_r1777369877 ## aws/src/main/java/org/apache/iceberg/aws/s3/S3FileIOProperties.java: ## @@ -824,6 +889,65 @@ public void applyEndpointConfigurations(T builder) { }

Re: [PR] AWS: Set better defaults for S3 retry behaviour [iceberg]

2024-09-26 Thread via GitHub
danielcweeks commented on code in PR #11052: URL: https://github.com/apache/iceberg/pull/11052#discussion_r1777369877 ## aws/src/main/java/org/apache/iceberg/aws/s3/S3FileIOProperties.java: ## @@ -824,6 +889,65 @@ public void applyEndpointConfigurations(T builder) { }

Re: [PR] AWS: Set better defaults for S3 retry behaviour [iceberg]

2024-09-26 Thread via GitHub
amogh-jahagirdar commented on code in PR #11052: URL: https://github.com/apache/iceberg/pull/11052#discussion_r1777340404 ## aws/src/main/java/org/apache/iceberg/aws/s3/S3FileIOProperties.java: ## @@ -393,6 +403,21 @@ public class S3FileIOProperties implements Serializable {

Re: [PR] AWS: Set better defaults for S3 retry behaviour [iceberg]

2024-09-26 Thread via GitHub
amogh-jahagirdar commented on code in PR #11052: URL: https://github.com/apache/iceberg/pull/11052#discussion_r1777340404 ## aws/src/main/java/org/apache/iceberg/aws/s3/S3FileIOProperties.java: ## @@ -393,6 +403,21 @@ public class S3FileIOProperties implements Serializable {

Re: [PR] AWS: Set better defaults for S3 retry behaviour [iceberg]

2024-09-25 Thread via GitHub
jackye1995 commented on PR #11052: URL: https://github.com/apache/iceberg/pull/11052#issuecomment-2374896767 @ookumuso looks like CI failed for some unrelated reason, can you rebase the PR to retrigger the CI? -- This is an automated message from the Apache Git Service. To respond to the

Re: [PR] AWS: Set better defaults for S3 retry behaviour [iceberg]

2024-09-25 Thread via GitHub
jackye1995 commented on PR #11052: URL: https://github.com/apache/iceberg/pull/11052#issuecomment-2374873258 @amogh-jahagirdar @nastra for the concerns regarding the new config values, to give some additional data points here, we have similar configs internally for quite some time now in Ic

Re: [PR] AWS: Set better defaults for S3 retry behaviour [iceberg]

2024-09-24 Thread via GitHub
ookumuso commented on code in PR #11052: URL: https://github.com/apache/iceberg/pull/11052#discussion_r1773679309 ## aws/src/main/java/org/apache/iceberg/aws/s3/S3FileIOProperties.java: ## @@ -393,6 +403,21 @@ public class S3FileIOProperties implements Serializable { */ p

Re: [PR] AWS: Set better defaults for S3 retry behaviour [iceberg]

2024-09-17 Thread via GitHub
ookumuso commented on code in PR #11052: URL: https://github.com/apache/iceberg/pull/11052#discussion_r1764233622 ## aws/src/main/java/org/apache/iceberg/aws/s3/S3FileIOProperties.java: ## @@ -393,6 +403,21 @@ public class S3FileIOProperties implements Serializable { */ p

Re: [PR] AWS: Set better defaults for S3 retry behaviour [iceberg]

2024-09-17 Thread via GitHub
ookumuso commented on code in PR #11052: URL: https://github.com/apache/iceberg/pull/11052#discussion_r1764233622 ## aws/src/main/java/org/apache/iceberg/aws/s3/S3FileIOProperties.java: ## @@ -393,6 +403,21 @@ public class S3FileIOProperties implements Serializable { */ p

Re: [PR] AWS: Set better defaults for S3 retry behaviour [iceberg]

2024-09-17 Thread via GitHub
amogh-jahagirdar commented on code in PR #11052: URL: https://github.com/apache/iceberg/pull/11052#discussion_r1764104918 ## aws/src/main/java/org/apache/iceberg/aws/s3/S3FileIOProperties.java: ## @@ -393,6 +403,21 @@ public class S3FileIOProperties implements Serializable {

Re: [PR] AWS: Set better defaults for S3 retry behaviour [iceberg]

2024-09-17 Thread via GitHub
ookumuso commented on code in PR #11052: URL: https://github.com/apache/iceberg/pull/11052#discussion_r1763561503 ## aws/src/main/java/org/apache/iceberg/aws/s3/S3FileIOProperties.java: ## @@ -393,6 +403,21 @@ public class S3FileIOProperties implements Serializable { */ p

Re: [PR] AWS: Set better defaults for S3 retry behaviour [iceberg]

2024-09-16 Thread via GitHub
nastra commented on code in PR #11052: URL: https://github.com/apache/iceberg/pull/11052#discussion_r1762443878 ## aws/src/main/java/org/apache/iceberg/aws/s3/S3FileIOProperties.java: ## @@ -393,6 +403,21 @@ public class S3FileIOProperties implements Serializable { */ pri

Re: [PR] AWS: Set better defaults for S3 retry behaviour [iceberg]

2024-09-16 Thread via GitHub
ookumuso commented on code in PR #11052: URL: https://github.com/apache/iceberg/pull/11052#discussion_r1761455914 ## docs/docs/aws.md: ## @@ -378,6 +378,19 @@ However, for the older versions up to 0.12.0, the logic is as follows: For more details, please refer to the [Locati

Re: [PR] AWS: Set better defaults for S3 retry behaviour [iceberg]

2024-09-16 Thread via GitHub
nastra commented on code in PR #11052: URL: https://github.com/apache/iceberg/pull/11052#discussion_r1760984150 ## docs/docs/aws.md: ## @@ -378,6 +378,19 @@ However, for the older versions up to 0.12.0, the logic is as follows: For more details, please refer to the [Location