Re: [PR] Spark 3.4: Support Spark Column Stats [iceberg]

2024-11-14 Thread via GitHub
nastra merged PR #11532: URL: https://github.com/apache/iceberg/pull/11532 -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. To unsubscribe, e-mail: issues-unsubscr...@iceberg.ap

Re: [PR] Spark 3.4: Support Spark Column Stats [iceberg]

2024-11-13 Thread via GitHub
huaxingao commented on PR #11532: URL: https://github.com/apache/iceberg/pull/11532#issuecomment-2474477341 @saitharun15 https://github.com/apache/iceberg/pull/11035 fixed SparkScan to only read Apache DataSketches. Could you please back-port these changes too? -- This is an automated mes

Re: [PR] Spark 3.4: Support Spark Column Stats [iceberg]

2024-11-13 Thread via GitHub
saitharun15 commented on code in PR #11532: URL: https://github.com/apache/iceberg/pull/11532#discussion_r1839833713 ## spark/v3.4/spark/src/test/java/org/apache/iceberg/spark/source/TestSparkScan.java: ## @@ -716,6 +879,26 @@ private Expression[] expressions(Expression... expr

Re: [PR] Spark 3.4: Support Spark Column Stats [iceberg]

2024-11-13 Thread via GitHub
nastra commented on code in PR #11532: URL: https://github.com/apache/iceberg/pull/11532#discussion_r1839975364 ## spark/v3.4/spark/src/test/java/org/apache/iceberg/spark/source/TestSparkScan.java: ## @@ -716,6 +879,26 @@ private Expression[] expressions(Expression... expressio

Re: [PR] Spark 3.4: Support Spark Column Stats [iceberg]

2024-11-13 Thread via GitHub
nastra commented on code in PR #11532: URL: https://github.com/apache/iceberg/pull/11532#discussion_r1839820652 ## spark/v3.4/spark/src/test/java/org/apache/iceberg/spark/source/TestSparkScan.java: ## @@ -716,6 +879,26 @@ private Expression[] expressions(Expression... expressio

Re: [PR] Spark 3.4: Support Spark Column Stats [iceberg]

2024-11-13 Thread via GitHub
nastra commented on code in PR #11532: URL: https://github.com/apache/iceberg/pull/11532#discussion_r1839823976 ## spark/v3.4/spark/src/test/java/org/apache/iceberg/spark/source/TestSparkScan.java: ## @@ -716,6 +879,26 @@ private Expression[] expressions(Expression... expressio

[PR] Spark 3.4: Support Spark Column Stats [iceberg]

2024-11-13 Thread via GitHub
saitharun15 opened a new pull request, #11532: URL: https://github.com/apache/iceberg/pull/11532 Backport of #10659 Currently only Spark Action to Analyze table(#11106) is backported to 3.4, this PR backports changes related to reporting back Column Stats to Spark 3.4 @huaxin