Re: [PR] Update CachingCatalog to use expireAfterWrite instead of expireAfterAccess [iceberg]

zhangminglei commented on PR #8844: URL: https://github.com/apache/iceberg/pull/8844#issuecomment-1774520236 From spark doc https://spark.apache.org/docs/3.0.0-preview/sql-ref-syntax-aux-refresh-table.html#description **REFRESH TABLE statement invalidates the cached entries, which inc

Re: [PR] Docs: Fix some typos in docs [iceberg]

ajantha-bhat commented on code in PR #8892: URL: https://github.com/apache/iceberg/pull/8892#discussion_r1368130579 ## docs/spark-procedures.md: ## @@ -127,11 +127,11 @@ This procedure invalidates all cached Spark plans that reference the affected ta Usage -| Argument

Re: [I] Apache hive 3 with Tez engine select table no empty [iceberg]

anvanna commented on issue #8891: URL: https://github.com/apache/iceberg/issues/8891#issuecomment-1774420926 @BsoBird no, just tested query after insert some rows to iceberg table, but no result return -- This is an automated message from the Apache Git Service. To respond to the message,

Re: [PR] fix(avro-schema): fix avro map schema generation [iceberg-rust]

liurenjie1024 commented on PR #83: URL: https://github.com/apache/iceberg-rust/pull/83#issuecomment-1774393140 Thanks, it will be resolved in #82 -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to

Re: [PR] Update CachingCatalog to use expireAfterWrite instead of expireAfterAccess [iceberg]

lirui-apache commented on PR #8844: URL: https://github.com/apache/iceberg/pull/8844#issuecomment-1774392135 Thanks @RussellSpitzer , I think "REFRESH TABLE" can solve our issue. Is it correct to assume that the best practice is to always refresh before running any DDLs on a table? -- Th

Re: [PR] fix: Add catalog pages to docs. [iceberg-docs]

liurenjie1024 commented on PR #284: URL: https://github.com/apache/iceberg-docs/pull/284#issuecomment-1774361996 > Hi, @nastra I followed you instruction to add it, it goes well mostly but with one thing: https://user-images.githubusercontent.com/2771941/277220251-d83a7fe6-3e49-4837-86ad-df7

Re: [PR] fix: Add catalog pages to docs. [iceberg-docs]

liurenjie1024 commented on PR #284: URL: https://github.com/apache/iceberg-docs/pull/284#issuecomment-1774360342 Hi, @nastra I followed you instruction to add it, it goes well mostly but with one thing: https://github.com/apache/iceberg-docs/assets/2771941/d83a7fe6-3e49-4837-86ad-df76f47

Re: [PR] Phase 1 - New Docs Deployment [iceberg]

manuzhang commented on PR #8659: URL: https://github.com/apache/iceberg/pull/8659#issuecomment-1774333581 @bitsondatadev have you created a project to track progress and to-do list? Maybe others can help and pick up some tasks as well. -- This is an automated message from the Apache Git S

Re: [PR] Build: Bump griffe from 0.36.5 to 0.36.7 [iceberg-python]

Fokko merged PR #97: URL: https://github.com/apache/iceberg-python/pull/97 -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. To unsubscribe, e-mail: issues-unsubscr...@iceberg.ap

Re: [I] Add support for selected vector based processing on ORC Files [iceberg]

github-actions[bot] commented on issue #7191: URL: https://github.com/apache/iceberg/issues/7191#issuecomment-1774241749 This issue has been closed because it has not received any activity in the last 14 days since being marked as 'stale' -- This is an automated message from the Apache Gi

Re: [I] Add support for selected vector based processing on ORC Files [iceberg]

github-actions[bot] closed issue #7191: Add support for selected vector based processing on ORC Files URL: https://github.com/apache/iceberg/issues/7191 -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go

Re: [I] How to synchronize data through flink cdc after the table structure is updated? [iceberg]

github-actions[bot] commented on issue #7357: URL: https://github.com/apache/iceberg/issues/7357#issuecomment-1774241730 This issue has been automatically marked as stale because it has been open for 180 days with no activity. It will be closed in next 14 days if no further activity occurs.

Re: [PR] Build: Bump griffe from 0.36.5 to 0.36.7 [iceberg-python]

Fokko commented on PR #97: URL: https://github.com/apache/iceberg-python/pull/97#issuecomment-1774237507 @dependabot rebase -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment.

Re: [PR] Build: Bump sqlalchemy from 2.0.21 to 2.0.22 [iceberg-python]

Fokko merged PR #98: URL: https://github.com/apache/iceberg-python/pull/98 -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. To unsubscribe, e-mail: issues-unsubscr...@iceberg.ap

Re: [PR] Build: Bump pytest-mock from 3.11.1 to 3.12.0 [iceberg-python]

Fokko merged PR #99: URL: https://github.com/apache/iceberg-python/pull/99 -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. To unsubscribe, e-mail: issues-unsubscr...@iceberg.ap

Re: [PR] Build: Bump mkdocs-material from 9.4.2 to 9.4.6 [iceberg-python]

Fokko merged PR #100: URL: https://github.com/apache/iceberg-python/pull/100 -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. To unsubscribe, e-mail: issues-unsubscr...@iceberg.

Re: [PR] Fix equality of bound expressions [iceberg-python]

Fokko merged PR #95: URL: https://github.com/apache/iceberg-python/pull/95 -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. To unsubscribe, e-mail: issues-unsubscr...@iceberg.ap

[PR] Build: Bump mkdocs-material from 9.4.2 to 9.4.6 [iceberg-python]

dependabot[bot] opened a new pull request, #100: URL: https://github.com/apache/iceberg-python/pull/100 Bumps [mkdocs-material](https://github.com/squidfunk/mkdocs-material) from 9.4.2 to 9.4.6. Release notes Sourced from https://github.com/squidfunk/mkdocs-material/releases";>mkdo

[PR] Build: Bump pytest-mock from 3.11.1 to 3.12.0 [iceberg-python]

dependabot[bot] opened a new pull request, #99: URL: https://github.com/apache/iceberg-python/pull/99 Bumps [pytest-mock](https://github.com/pytest-dev/pytest-mock) from 3.11.1 to 3.12.0. Release notes Sourced from https://github.com/pytest-dev/pytest-mock/releases";>pytest-mock's

[PR] Build: Bump sqlalchemy from 2.0.21 to 2.0.22 [iceberg-python]

dependabot[bot] opened a new pull request, #98: URL: https://github.com/apache/iceberg-python/pull/98 Bumps [sqlalchemy](https://github.com/sqlalchemy/sqlalchemy) from 2.0.21 to 2.0.22. Release notes Sourced from https://github.com/sqlalchemy/sqlalchemy/releases";>sqlalchemy's rel

[PR] Build: Bump griffe from 0.36.5 to 0.36.7 [iceberg-python]

dependabot[bot] opened a new pull request, #97: URL: https://github.com/apache/iceberg-python/pull/97 Bumps [griffe](https://github.com/mkdocstrings/griffe) from 0.36.5 to 0.36.7. Release notes Sourced from https://github.com/mkdocstrings/griffe/releases";>griffe's releases.

[PR] Build: Bump adlfs from 2023.9.0 to 2023.10.0 [iceberg-python]

dependabot[bot] opened a new pull request, #96: URL: https://github.com/apache/iceberg-python/pull/96 Bumps [adlfs](https://github.com/dask/adlfs) from 2023.9.0 to 2023.10.0. Release notes Sourced from https://github.com/dask/adlfs/releases";>adlfs's releases. 2023.10.0 W

[I] Iceberg streaming streaming-skip-overwrite-snapshots SparkMicroBatchStream only skips over one file per trigger [iceberg]

cccs-jc opened a new issue, #8902: URL: https://github.com/apache/iceberg/issues/8902 ### Apache Iceberg version 1.3.1 ### Query engine Spark ### Please describe the bug 🐞 @singhpk234 I think you might know how to fix this. The implementation of `str

Re: [PR] Phase 1 - New Docs Deployment [iceberg]

rdblue merged PR #8659: URL: https://github.com/apache/iceberg/pull/8659 -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. To unsubscribe, e-mail: issues-unsubscr...@iceberg.apac

Re: [PR] Phase 1 - New Docs Deployment [iceberg]

rdblue commented on PR #8659: URL: https://github.com/apache/iceberg/pull/8659#issuecomment-1774192281 I'm going to merge this to unblock the next phase of work. Building the site works and I think once this is in we can move on to: 1. Update the style to match the current site 2. Add

Re: [PR] JDBC catalog fix namespaceExists check [iceberg]

rdblue commented on code in PR #8340: URL: https://github.com/apache/iceberg/pull/8340#discussion_r1367964162 ## core/src/test/java/org/apache/iceberg/jdbc/TestJdbcCatalog.java: ## @@ -604,6 +604,27 @@ public void testCreateNamespace() { // Test with no metadata catalo

Re: [PR] Core: Enable column statistics filtering after planning [iceberg]

stevenzwu commented on code in PR #8803: URL: https://github.com/apache/iceberg/pull/8803#discussion_r1367174997 ## flink/v1.17/flink/src/main/java/org/apache/iceberg/flink/source/ScanContext.java: ## @@ -464,6 +476,11 @@ public Builder includeColumnStats(boolean newIncludeColu

Re: [PR] Core: Enable column statistics filtering after planning [iceberg]

stevenzwu commented on code in PR #8803: URL: https://github.com/apache/iceberg/pull/8803#discussion_r1367939105 ## flink/v1.17/flink/src/main/java/org/apache/iceberg/flink/FlinkReadConf.java: ## @@ -152,6 +155,16 @@ public boolean includeColumnStats() { .parse(); }

Re: [PR] Core: Enable column statistics filtering after planning [iceberg]

stevenzwu commented on code in PR #8803: URL: https://github.com/apache/iceberg/pull/8803#discussion_r1367939105 ## flink/v1.17/flink/src/main/java/org/apache/iceberg/flink/FlinkReadConf.java: ## @@ -152,6 +155,16 @@ public boolean includeColumnStats() { .parse(); }

Re: [I] Docs: PostgreSql integration [iceberg-python]

Fokko commented on issue #78: URL: https://github.com/apache/iceberg-python/issues/78#issuecomment-1774101844 This should be a location to a bucket where the metadata and the data itself will be stored. I think this finds its origin in Hive: https://docs.cloudera.com/cdp-private-clou

Re: [PR] chore(deps): Update opendal requirement from 0.40 to 0.41 [iceberg-rust]

Fokko merged PR #84: URL: https://github.com/apache/iceberg-rust/pull/84 -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. To unsubscribe, e-mail: issues-unsubscr...@iceberg.apac

[I] Hive's performance for querying the Iceberg table is very poor. [iceberg]

BsoBird opened a new issue, #8901: URL: https://github.com/apache/iceberg/issues/8901 ### Query engine HIVE 3.1.3 ICEBERTG 1.3.1 SPARK 3.3.2 ### Question Hi Team. I recently was testing Hive query Iceberg table , I found that Hive query Iceberg table perfo

[PR] chore(deps): Update opendal requirement from 0.40 to 0.41 [iceberg-rust]

dependabot[bot] opened a new pull request, #84: URL: https://github.com/apache/iceberg-rust/pull/84 Updates the requirements on [opendal](https://github.com/apache/incubator-opendal) to permit the latest version. Release notes Sourced from https://github.com/apache/incubator-opend

Re: [I] Apache hive 3 with Tez engine select table no empty [iceberg]

BsoBird commented on issue #8891: URL: https://github.com/apache/iceberg/issues/8891#issuecomment-1774052144 @anvanna hi. When you test HIVE to read ICEBERG, do you encounter the problem that the performance is too poor and the JOIN condition cannot be pushed down to the partition of

Re: [PR] Fix literal predicate equality check [iceberg-python]

Fokko commented on code in PR #94: URL: https://github.com/apache/iceberg-python/pull/94#discussion_r1367862862 ## pyiceberg/expressions/__init__.py: ## @@ -701,7 +701,7 @@ def bind(self, schema: Schema, case_sensitive: bool = True) -> BoundLiteralPredi def __eq__(self,

[PR] Fix equality of bound expressions [iceberg-python]

Fokko opened a new pull request, #95: URL: https://github.com/apache/iceberg-python/pull/95 (no comment) -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. To unsubscribe, e-m

Re: [PR] build(deps): bump github.com/aws/aws-sdk-go-v2/config from 1.18.44 to 1.18.45 [iceberg-go]

dependabot[bot] closed pull request #19: build(deps): bump github.com/aws/aws-sdk-go-v2/config from 1.18.44 to 1.18.45 URL: https://github.com/apache/iceberg-go/pull/19 -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the

[PR] build(deps): bump github.com/aws/aws-sdk-go-v2/config from 1.18.44 to 1.19.0 [iceberg-go]

dependabot[bot] opened a new pull request, #25: URL: https://github.com/apache/iceberg-go/pull/25 Bumps [github.com/aws/aws-sdk-go-v2/config](https://github.com/aws/aws-sdk-go-v2) from 1.18.44 to 1.19.0. Changelog Sourced from https://github.com/aws/aws-sdk-go-v2/blob/v1.19.0/CHAN

Re: [PR] build(deps): bump github.com/aws/aws-sdk-go-v2/config from 1.18.44 to 1.18.45 [iceberg-go]

dependabot[bot] commented on PR #19: URL: https://github.com/apache/iceberg-go/pull/19#issuecomment-1774031462 Superseded by #25. -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comm