Re: [PR] Update how to release [iceberg-python]

2023-10-02 Thread via GitHub
Fokko merged PR #34: URL: https://github.com/apache/iceberg-python/pull/34 -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. To unsubscribe, e-mail: issues-unsubscr...@iceberg.ap

Re: [PR] Update how to release [iceberg-python]

2023-10-02 Thread via GitHub
Fokko commented on PR #34: URL: https://github.com/apache/iceberg-python/pull/34#issuecomment-1744317925 Thanks @rdblue 🙌 -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. T

Re: [PR] Build: Bump urllib3 from 1.26.16 to 1.26.17 [iceberg-python]

2023-10-02 Thread via GitHub
Fokko merged PR #36: URL: https://github.com/apache/iceberg-python/pull/36 -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. To unsubscribe, e-mail: issues-unsubscr...@iceberg.ap

Re: [PR] Build: Bump griffe from 0.36.2 to 0.36.4 [iceberg-python]

2023-10-02 Thread via GitHub
Fokko merged PR #13: URL: https://github.com/apache/iceberg-python/pull/13 -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. To unsubscribe, e-mail: issues-unsubscr...@iceberg.ap

Re: [PR] Build: Bump urllib3 from 1.26.16 to 1.26.17 in /python [iceberg]

2023-10-02 Thread via GitHub
dependabot[bot] commented on PR #8703: URL: https://github.com/apache/iceberg/pull/8703#issuecomment-1744222661 OK, I won't notify you again about this release, but will get in touch when a new version is available. If you'd rather skip all updates until the next major or minor version, let

Re: [PR] Build: Bump urllib3 from 1.26.16 to 1.26.17 in /python [iceberg]

2023-10-02 Thread via GitHub
ajantha-bhat closed pull request #8703: Build: Bump urllib3 from 1.26.16 to 1.26.17 in /python URL: https://github.com/apache/iceberg/pull/8703 -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the sp

Re: [PR] Build: Bump urllib3 from 1.26.16 to 1.26.17 in /python [iceberg]

2023-10-02 Thread via GitHub
ajantha-bhat commented on PR #8703: URL: https://github.com/apache/iceberg/pull/8703#issuecomment-1744222631 Closing since we are deleting the python folder in https://github.com/apache/iceberg/pull/8695 -- This is an automated message from the Apache Git Service. To respond to the messag

[PR] Build: Bump urllib3 from 1.26.16 to 1.26.17 [iceberg-python]

2023-10-02 Thread via GitHub
dependabot[bot] opened a new pull request, #36: URL: https://github.com/apache/iceberg-python/pull/36 Bumps [urllib3](https://github.com/urllib3/urllib3) from 1.26.16 to 1.26.17. Release notes Sourced from https://github.com/urllib3/urllib3/releases";>urllib3's releases. 1.2

[PR] Build: Bump urllib3 from 1.26.16 to 1.26.17 in /python [iceberg]

2023-10-02 Thread via GitHub
dependabot[bot] opened a new pull request, #8703: URL: https://github.com/apache/iceberg/pull/8703 Bumps [urllib3](https://github.com/urllib3/urllib3) from 1.26.16 to 1.26.17. Release notes Sourced from https://github.com/urllib3/urllib3/releases";>urllib3's releases. 1.26.1

Re: [PR] Phase 1 - New Docs Deployment [iceberg]

2023-10-02 Thread via GitHub
bitsondatadev commented on code in PR #8659: URL: https://github.com/apache/iceberg/pull/8659#discussion_r1343407301 ## docs-new/README.md: ## @@ -0,0 +1,123 @@ + + +# making-iceberg-docs + +Testbed for the Iceberg docs. + +## Requirements + +* Python >=3.9 +* pip + + +## Build

Re: [PR] build(deps): bump github.com/aws/aws-sdk-go-v2/service/s3 from 1.38.4 to 1.40.0 [iceberg-go]

2023-10-02 Thread via GitHub
danielcweeks merged PR #12: URL: https://github.com/apache/iceberg-go/pull/12 -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. To unsubscribe, e-mail: issues-unsubscr...@iceberg

Re: [PR] build(deps): bump github.com/wolfeidau/s3iofs from 1.2.0 to 1.3.0 [iceberg-go]

2023-10-02 Thread via GitHub
danielcweeks merged PR #10: URL: https://github.com/apache/iceberg-go/pull/10 -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. To unsubscribe, e-mail: issues-unsubscr...@iceberg

Re: [PR] build(deps): bump github.com/aws/aws-sdk-go-v2/config from 1.18.35 to 1.18.42 [iceberg-go]

2023-10-02 Thread via GitHub
danielcweeks merged PR #9: URL: https://github.com/apache/iceberg-go/pull/9 -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. To unsubscribe, e-mail: issues-unsubscr...@iceberg.a

Re: [I] DeleteOrphanFilesSparkAction doesn't use the Catalog's FileIO [iceberg]

2023-10-02 Thread via GitHub
github-actions[bot] commented on issue #7280: URL: https://github.com/apache/iceberg/issues/7280#issuecomment-1743950845 This issue has been automatically marked as stale because it has been open for 180 days with no activity. It will be closed in next 14 days if no further activity occurs.

[I] De-Duping Rows While Compacting [iceberg]

2023-10-02 Thread via GitHub
W-I-D-EE opened a new issue, #8702: URL: https://github.com/apache/iceberg/issues/8702 ### Query engine Spark 3.2.3 ### Question Looks like i can remove duplicate rows using MERGE INTO. Is there any way to do this during a compaction? Ideally i could remove deduplicate d

Re: [PR] API, Core: Allow setting a View's location [iceberg]

2023-10-02 Thread via GitHub
rdblue commented on code in PR #8648: URL: https://github.com/apache/iceberg/pull/8648#discussion_r1343186994 ## api/src/main/java/org/apache/iceberg/view/View.java: ## @@ -77,6 +77,15 @@ public interface View { */ Map properties(); + /** + * Return the view's base l

Re: [PR] Labeler: Add Specification label [iceberg]

2023-10-02 Thread via GitHub
rdblue merged PR #8700: URL: https://github.com/apache/iceberg/pull/8700 -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. To unsubscribe, e-mail: issues-unsubscr...@iceberg.apac

Re: [PR] Labeler: Add Specification label [iceberg]

2023-10-02 Thread via GitHub
rdblue commented on PR #8700: URL: https://github.com/apache/iceberg/pull/8700#issuecomment-1743753967 Thanks, @Fokko! -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. To un

Re: [PR] API, Core: Allow setting a View's location [iceberg]

2023-10-02 Thread via GitHub
rdblue commented on code in PR #8648: URL: https://github.com/apache/iceberg/pull/8648#discussion_r1343154772 ## core/src/main/java/org/apache/iceberg/view/SetViewLocation.java: ## @@ -0,0 +1,80 @@ +/* + * Licensed to the Apache Software Foundation (ASF) under one + * or more co

Re: [PR] API, Core: Allow setting a View's location [iceberg]

2023-10-02 Thread via GitHub
rdblue commented on code in PR #8648: URL: https://github.com/apache/iceberg/pull/8648#discussion_r1343154283 ## api/src/main/java/org/apache/iceberg/view/UpdateViewLocation.java: ## @@ -0,0 +1,32 @@ +/* + * Licensed to the Apache Software Foundation (ASF) under one + * or more

Re: [PR] Core: Support view metadata compression [iceberg]

2023-10-02 Thread via GitHub
rdblue commented on code in PR #8552: URL: https://github.com/apache/iceberg/pull/8552#discussion_r1343150026 ## core/src/test/java/org/apache/iceberg/view/TestViewMetadataParser.java: ## @@ -308,4 +322,57 @@ public void replaceViewMetadataWithMultipleSQLsForDialect() throws Ex

Re: [PR] Core: Support view metadata compression [iceberg]

2023-10-02 Thread via GitHub
rdblue commented on code in PR #8552: URL: https://github.com/apache/iceberg/pull/8552#discussion_r1343147048 ## core/src/test/java/org/apache/iceberg/view/TestViewMetadataParser.java: ## @@ -18,18 +18,30 @@ */ package org.apache.iceberg.view; +import static org.apache.iceb

Re: [PR] API: add type Timestampns [iceberg]

2023-10-02 Thread via GitHub
jacobmarble commented on code in PR #8658: URL: https://github.com/apache/iceberg/pull/8658#discussion_r1343083398 ## api/src/main/java/org/apache/iceberg/types/Types.java: ## @@ -48,6 +48,8 @@ private Types() {} .put(TimeType.get().toString(), TimeType.get())

Re: [PR] API: add type Timestampns [iceberg]

2023-10-02 Thread via GitHub
jacobmarble commented on code in PR #8658: URL: https://github.com/apache/iceberg/pull/8658#discussion_r1343083398 ## api/src/main/java/org/apache/iceberg/types/Types.java: ## @@ -48,6 +48,8 @@ private Types() {} .put(TimeType.get().toString(), TimeType.get())

Re: [PR] API: add type Timestampns [iceberg]

2023-10-02 Thread via GitHub
jacobmarble commented on code in PR #8658: URL: https://github.com/apache/iceberg/pull/8658#discussion_r1343083398 ## api/src/main/java/org/apache/iceberg/types/Types.java: ## @@ -48,6 +48,8 @@ private Types() {} .put(TimeType.get().toString(), TimeType.get())

Re: [PR] API: add type Timestampns [iceberg]

2023-10-02 Thread via GitHub
jacobmarble commented on code in PR #8658: URL: https://github.com/apache/iceberg/pull/8658#discussion_r1343083398 ## api/src/main/java/org/apache/iceberg/types/Types.java: ## @@ -48,6 +48,8 @@ private Types() {} .put(TimeType.get().toString(), TimeType.get())

Re: [PR] API: add type Timestampns [iceberg]

2023-10-02 Thread via GitHub
jacobmarble commented on code in PR #8658: URL: https://github.com/apache/iceberg/pull/8658#discussion_r1343083398 ## api/src/main/java/org/apache/iceberg/types/Types.java: ## @@ -48,6 +48,8 @@ private Types() {} .put(TimeType.get().toString(), TimeType.get())

Re: [PR] open-api: Add namespaceExist API [iceberg]

2023-10-02 Thread via GitHub
dramaticlly commented on PR #8569: URL: https://github.com/apache/iceberg/pull/8569#issuecomment-1743610048 thank you @Fokko, @amogh-jahagirdar and @nastra for the review! -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and us

Re: [PR] open-api: Add namespaceExist API [iceberg]

2023-10-02 Thread via GitHub
Fokko commented on PR #8569: URL: https://github.com/apache/iceberg/pull/8569#issuecomment-1743609595 Fair point, let's add this. Thanks @nastra and @amogh-jahagirdar for the reviews, and @dramaticlly for raising this PR! -- This is an automated message from the Apache Git Service. To res

Re: [PR] open-api: Add namespaceExist API [iceberg]

2023-10-02 Thread via GitHub
Fokko merged PR #8569: URL: https://github.com/apache/iceberg/pull/8569 -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. To unsubscribe, e-mail: issues-unsubscr...@iceberg.apach

Re: [PR] open-api: Add namespaceExist API [iceberg]

2023-10-02 Thread via GitHub
dramaticlly commented on PR #8569: URL: https://github.com/apache/iceberg/pull/8569#issuecomment-1743604553 > Sorry for being so late to the party. I don't have a strong objection against this, but I'm curious about what the use case is. If you want to create a namespace then it is best to

Re: [PR] Build: Bump typing-extensions from 4.7.1 to 4.8.0 [iceberg-python]

2023-10-02 Thread via GitHub
Fokko merged PR #12: URL: https://github.com/apache/iceberg-python/pull/12 -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. To unsubscribe, e-mail: issues-unsubscr...@iceberg.ap

Re: [PR] open-api: Add namespaceExist API [iceberg]

2023-10-02 Thread via GitHub
Fokko commented on PR #8569: URL: https://github.com/apache/iceberg/pull/8569#issuecomment-1743585167 Sorry for being so late to the party. I don't have a strong objection against this, but I'm curious about what the use case is. If you want to create a namespace then it is best to just try

Re: [I] Support get partition table with filter [iceberg-python]

2023-10-02 Thread via GitHub
puchengy commented on issue #24: URL: https://github.com/apache/iceberg-python/issues/24#issuecomment-1743486785 > What do you think of passing in a predicate, and letting the Airflow sensor pass if there are rows? @Fokko That works. This is actually what we are doing (but for legacy

Re: [I] Support get partition table with filter [iceberg-python]

2023-10-02 Thread via GitHub
Fokko commented on issue #24: URL: https://github.com/apache/iceberg-python/issues/24#issuecomment-1743474860 @puchengy The problem with Iceberg is that the partition is more of a logical concept, rather than a physical path like in a Hive table. What do you think of passing in a predicate,

Re: [PR] Build: Bump rich from 13.5.3 to 13.6.0 [iceberg-python]

2023-10-02 Thread via GitHub
Fokko merged PR #11: URL: https://github.com/apache/iceberg-python/pull/11 -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. To unsubscribe, e-mail: issues-unsubscr...@iceberg.ap

Re: [PR] Python: Add support for Python 3.12 [iceberg-python]

2023-10-02 Thread via GitHub
Fokko commented on PR #35: URL: https://github.com/apache/iceberg-python/pull/35#issuecomment-1743459670 Thanks for opening this PR. 3.12 has been released today: https://www.python.org/downloads/release/python-3120/ -- This is an automated message from the Apache Git Service. To respond

Re: [PR] Python: Add support for Python 3.12 [iceberg]

2023-10-02 Thread via GitHub
Fokko commented on PR #8531: URL: https://github.com/apache/iceberg/pull/8531#issuecomment-1743459315 That's awesome. 3.12 has been released today: https://www.python.org/downloads/release/python-3120/ -- This is an automated message from the Apache Git Service. To respond to the message,

Re: [PR] Kafka Connect: Initial project setup and event data structures [iceberg]

2023-10-02 Thread via GitHub
ajantha-bhat commented on PR #8701: URL: https://github.com/apache/iceberg/pull/8701#issuecomment-1743437849 Very happy to see this contribution 👍 I have recently tested this project with Nessie catalog and liked it. I just skimmed the files. Will definitely go through design docs

Re: [PR] Kafka Connect: Initial project setup and event data structures [iceberg]

2023-10-02 Thread via GitHub
ajantha-bhat commented on code in PR #8701: URL: https://github.com/apache/iceberg/pull/8701#discussion_r1342953382 ## kafka-connect/kafka-connect-events/src/test/java/org/apache/iceberg/connect/events/EventTestUtil.java: ## @@ -1,22 +1,24 @@ /* - * Licensed to the Apache Softw

Re: [PR] Kafka Connect: Initial project setup and event data structures [iceberg]

2023-10-02 Thread via GitHub
bryanck commented on code in PR #8701: URL: https://github.com/apache/iceberg/pull/8701#discussion_r1342952373 ## kafka-connect/kafka-connect-events/src/main/java/io/tabular/iceberg/connect/events/CommitCompletePayload.java: ## @@ -0,0 +1,97 @@ +/* + * Licensed to the Apache Sof

Re: [PR] Kafka Connect: Initial project setup and event data structures [iceberg]

2023-10-02 Thread via GitHub
ajantha-bhat commented on code in PR #8701: URL: https://github.com/apache/iceberg/pull/8701#discussion_r1342950793 ## kafka-connect/kafka-connect-events/src/main/java/io/tabular/iceberg/connect/events/CommitCompletePayload.java: ## @@ -0,0 +1,97 @@ +/* + * Licensed to the Apach

[PR] Kafka Connect: Initial project setup and event data structures [iceberg]

2023-10-02 Thread via GitHub
bryanck opened a new pull request, #8701: URL: https://github.com/apache/iceberg/pull/8701 We (Tabular) would like to submit our Iceberg Kafka Connect sink connector to the Iceberg project. Kafka Connect is a popular, efficient, and easy to use framework for reading from and writing to Kafk

Re: [I] Support get partition table with filter [iceberg-python]

2023-10-02 Thread via GitHub
puchengy commented on issue #24: URL: https://github.com/apache/iceberg-python/issues/24#issuecomment-1743397194 Hello @Fokko, here is my use case: 1. Given a table, find out all the partitions it has. 2. Given a partition filter, check if such partition exist in the table. Thank you

Re: [PR] Python: Add support for Python 3.12 [iceberg]

2023-10-02 Thread via GitHub
steinsgateted commented on PR #8531: URL: https://github.com/apache/iceberg/pull/8531#issuecomment-1743371640 @Fokko Thank you, reopen the PR: [Python: Add support for Python 3.12](https://github.com/apache/iceberg-python/pull/35) -- This is an automated message from the Apache Git Servic

[PR] Python: Add support for Python 3.12 [iceberg-python]

2023-10-02 Thread via GitHub
steinsgateted opened a new pull request, #35: URL: https://github.com/apache/iceberg-python/pull/35 reopen the PR: [Python: Add support for Python 3.12](https://github.com/apache/iceberg/pull/8531) -- This is an automated message from the Apache Git Service. To respond to the message, ple

Re: [PR] Deliver key metadata to parquet encryption [iceberg]

2023-10-02 Thread via GitHub
ggershinsky commented on code in PR #6762: URL: https://github.com/apache/iceberg/pull/6762#discussion_r1342920622 ## api/src/main/java/org/apache/iceberg/encryption/EncryptionKeyMetadata.java: ## @@ -49,4 +54,12 @@ static EncryptionKeyMetadata empty() { ByteBuffer buffer();

Re: [PR] feat: support read Manifest List [iceberg-rust]

2023-10-02 Thread via GitHub
Fokko merged PR #56: URL: https://github.com/apache/iceberg-rust/pull/56 -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. To unsubscribe, e-mail: issues-unsubscr...@iceberg.apac

Re: [PR] feat: support read Manifest List [iceberg-rust]

2023-10-02 Thread via GitHub
Fokko commented on PR #56: URL: https://github.com/apache/iceberg-rust/pull/56#issuecomment-1743312941 Thanks @ZENOTME for working on this! And @liurenjie102, @Xuanwo and @JanKaul for the review 🙌 -- This is an automated message from the Apache Git Service. To respond to the message, ple

Re: [PR] Build: Bump mkdocs-material from 9.4.1 to 9.4.2 [iceberg-python]

2023-10-02 Thread via GitHub
Fokko merged PR #10: URL: https://github.com/apache/iceberg-python/pull/10 -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. To unsubscribe, e-mail: issues-unsubscr...@iceberg.ap

[PR] Labeler: Add Specification label [iceberg]

2023-10-02 Thread via GitHub
Fokko opened a new pull request, #8700: URL: https://github.com/apache/iceberg/pull/8700 I noticed that this was missing -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. To

Re: [PR] Core: Add View support for REST catalog [iceberg]

2023-10-02 Thread via GitHub
nastra commented on code in PR #7913: URL: https://github.com/apache/iceberg/pull/7913#discussion_r1342796092 ## core/src/main/java/org/apache/iceberg/rest/CatalogHandlers.java: ## @@ -374,4 +385,107 @@ static TableMetadata commit(TableOperations ops, UpdateTableRequest request

Re: [PR] Core: Add View support for REST catalog [iceberg]

2023-10-02 Thread via GitHub
nastra commented on code in PR #7913: URL: https://github.com/apache/iceberg/pull/7913#discussion_r1342796092 ## core/src/main/java/org/apache/iceberg/rest/CatalogHandlers.java: ## @@ -374,4 +385,107 @@ static TableMetadata commit(TableOperations ops, UpdateTableRequest request

Re: [PR] Python: Wire up the writing [iceberg]

2023-10-02 Thread via GitHub
Fokko closed pull request #8650: Python: Wire up the writing URL: https://github.com/apache/iceberg/pull/8650 -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. To unsubscribe, e-

Re: [PR] Python: Add support for Python 3.12 [iceberg]

2023-10-02 Thread via GitHub
Fokko closed pull request #8531: Python: Add support for Python 3.12 URL: https://github.com/apache/iceberg/pull/8531 -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. To unsubsc

Re: [PR] Python: Add support for Python 3.12 [iceberg]

2023-10-02 Thread via GitHub
Fokko commented on PR #8531: URL: https://github.com/apache/iceberg/pull/8531#issuecomment-1743082546 @jayceslesar I prefer to have official actions, but we can test with the deadsnakes one. I'm closing this PR, @steinsgateted if you're interested in working on this, please reopen th

[PR] Update how to release [iceberg-python]

2023-10-02 Thread via GitHub
Fokko opened a new pull request, #34: URL: https://github.com/apache/iceberg-python/pull/34 (no comment) -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. To unsubscribe, e-m

Re: [PR] Build: Bump moto from 4.2.4 to 4.2.5 [iceberg-python]

2023-10-02 Thread via GitHub
Fokko merged PR #9: URL: https://github.com/apache/iceberg-python/pull/9 -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. To unsubscribe, e-mail: issues-unsubscr...@iceberg.apac

[PR] Catch warning in PyLint tests [iceberg-python]

2023-10-02 Thread via GitHub
Fokko opened a new pull request, #33: URL: https://github.com/apache/iceberg-python/pull/33 Migrated https://github.com/apache/iceberg/pull/6703/ to the new repository. -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use t

Re: [PR] Python: Configurable Authentication URL for Rest Catalog [iceberg]

2023-10-02 Thread via GitHub
Fokko closed pull request #8400: Python: Configurable Authentication URL for Rest Catalog URL: https://github.com/apache/iceberg/pull/8400 -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specifi

Re: [PR] Python: add pydantic plugin for mypy [iceberg]

2023-10-02 Thread via GitHub
Fokko commented on PR #8493: URL: https://github.com/apache/iceberg/pull/8493#issuecomment-1743043145 @rustyconover If you're interested in getting this in, could you address the comments and recreate a PR against https://github.com/apache/iceberg-python? -- This is an automated message

Re: [PR] Python: add pydantic plugin for mypy [iceberg]

2023-10-02 Thread via GitHub
Fokko closed pull request #8493: Python: add pydantic plugin for mypy URL: https://github.com/apache/iceberg/pull/8493 -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. To unsubs

Re: [PR] Python: Configurable Authentication URL for Rest Catalog [iceberg]

2023-10-02 Thread via GitHub
Fokko commented on PR #8400: URL: https://github.com/apache/iceberg/pull/8400#issuecomment-1743042784 @syun64 @danielcweeks I have to close this PR since we're migrating to the iceberg-python repository. Maybe you could re-create an issue on this repository to address this, so we can both i

Re: [PR] Python: fix mypy type errors [iceberg]

2023-10-02 Thread via GitHub
Fokko commented on PR #8305: URL: https://github.com/apache/iceberg/pull/8305#issuecomment-1743039993 @rustyconover If you're interested in getting this in, could you address the comments and recreate a PR against https://github.com/apache/iceberg-python? I think it would be great to get th

Re: [PR] Python: fix mypy type errors [iceberg]

2023-10-02 Thread via GitHub
Fokko closed pull request #8305: Python: fix mypy type errors URL: https://github.com/apache/iceberg/pull/8305 -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. To unsubscribe, e

Re: [PR] Python: allow projection of Iceberg fields to pyarrow table schema with names [iceberg]

2023-10-02 Thread via GitHub
Fokko closed pull request #8144: Python: allow projection of Iceberg fields to pyarrow table schema with names URL: https://github.com/apache/iceberg/pull/8144 -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above

Re: [PR] Python: allow projection of Iceberg fields to pyarrow table schema with names [iceberg]

2023-10-02 Thread via GitHub
Fokko commented on PR #8144: URL: https://github.com/apache/iceberg/pull/8144#issuecomment-1743038552 Hey @moriyoshi Thanks for creating this PR, could you re-create it against the https://github.com/apache/iceberg-python repository? We're migrating the Python to its own repo, and I overloo

Re: [PR] Python: Give the Dataset protocol a try [iceberg]

2023-10-02 Thread via GitHub
Fokko closed pull request #7846: Python: Give the Dataset protocol a try URL: https://github.com/apache/iceberg/pull/7846 -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. To uns

Re: [PR] Python: Add support for ORC [iceberg]

2023-10-02 Thread via GitHub
Fokko closed pull request #7033: Python: Add support for ORC URL: https://github.com/apache/iceberg/pull/7033 -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. To unsubscribe, e-

Re: [PR] Python: Add SnapshotUtils [iceberg]

2023-10-02 Thread via GitHub
Fokko closed pull request #6933: Python: Add SnapshotUtils URL: https://github.com/apache/iceberg/pull/6933 -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. To unsubscribe, e-ma

Re: [PR] Spec: Add string ↔ binary promotion [iceberg]

2023-10-02 Thread via GitHub
Fokko closed pull request #5151: Spec: Add string ↔ binary promotion URL: https://github.com/apache/iceberg/pull/5151 -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. To unsubsc

Re: [PR] Add links to Go, Python and Rust [iceberg]

2023-10-02 Thread via GitHub
Fokko commented on PR #8681: URL: https://github.com/apache/iceberg/pull/8681#issuecomment-1743034646 Thanks for the review @nastra, @ajantha-bhat and @hussein-awala 🙌 -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use t

Re: [PR] Add links to Go, Python and Rust [iceberg]

2023-10-02 Thread via GitHub
Fokko merged PR #8681: URL: https://github.com/apache/iceberg/pull/8681 -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. To unsubscribe, e-mail: issues-unsubscr...@iceberg.apach

Re: [PR] Add links to Go, Python and Rust [iceberg]

2023-10-02 Thread via GitHub
Fokko commented on code in PR #8681: URL: https://github.com/apache/iceberg/pull/8681#discussion_r1342704543 ## README.md: ## @@ -82,3 +82,11 @@ Iceberg also has modules for adding Iceberg support to processing engines: See the [Multi-Engine Support](https://iceberg.apache.

Re: [PR] Build: Upgrade to gradle 8.3 [iceberg]

2023-10-02 Thread via GitHub
jbonofre commented on PR #8486: URL: https://github.com/apache/iceberg/pull/8486#issuecomment-1742977842 I'm testing if gradle 8.3 correctly detects change on the API (via `revapi`). -- This is an automated message from the Apache Git Service. To respond to the message, please log on to Gi

Re: [I] Python: Add before- and after operations to `PreOrderSchemaVisitor` [iceberg-python]

2023-10-02 Thread via GitHub
MehulBatra commented on issue #32: URL: https://github.com/apache/iceberg-python/issues/32#issuecomment-1742859798 Looking into it. -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific c

Re: [PR] Core: Add View support for REST catalog [iceberg]

2023-10-02 Thread via GitHub
nastra commented on code in PR #7913: URL: https://github.com/apache/iceberg/pull/7913#discussion_r1342408996 ## core/src/main/java/org/apache/iceberg/rest/CatalogHandlers.java: ## @@ -374,4 +385,107 @@ static TableMetadata commit(TableOperations ops, UpdateTableRequest request

Re: [PR] Core: Add View support for REST catalog [iceberg]

2023-10-02 Thread via GitHub
nastra commented on code in PR #7913: URL: https://github.com/apache/iceberg/pull/7913#discussion_r1342576396 ## open-api/rest-catalog-open-api.yaml: ## @@ -1630,6 +1990,102 @@ components: metadata-log: $ref: '#/components/schemas/MetadataLog' +SQLViewR

Re: [PR] Python: Fix warnings from pytest [iceberg]

2023-10-02 Thread via GitHub
Fokko closed pull request #6703: Python: Fix warnings from pytest URL: https://github.com/apache/iceberg/pull/6703 -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. To unsubscrib

Re: [I] Python: Add before- and after operations to `PreOrderSchemaVisitor` [iceberg]

2023-10-02 Thread via GitHub
Fokko closed issue #8273: Python: Add before- and after operations to `PreOrderSchemaVisitor` URL: https://github.com/apache/iceberg/issues/8273 -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the s

Re: [I] Python: Add before- and after operations to `PreOrderSchemaVisitor` [iceberg]

2023-10-02 Thread via GitHub
Fokko commented on issue #8273: URL: https://github.com/apache/iceberg/issues/8273#issuecomment-1742841514 Migrated to new repository in https://github.com/apache/iceberg-python/issues/32 (also updated the links with permalinks) -- This is an automated message from the Apache Git Service

[I] Python: Add before- and after operations to `PreOrderSchemaVisitor` [iceberg-python]

2023-10-02 Thread via GitHub
Fokko opened a new issue, #32: URL: https://github.com/apache/iceberg-python/issues/32 ### Feature Request / Improvement In the `SchemaVisitor`: https://github.com/apache/iceberg/blob/c68abfc9fd3956077b43aba20441f089bb8b93d6/python/pyiceberg/schema.py#L345-L374 Those are missin

[I] Various fields in Manifest & ManifestList not written in accordance to the Spec [iceberg]

2023-10-02 Thread via GitHub
JFinis opened a new issue, #8699: URL: https://github.com/apache/iceberg/issues/8699 ### Apache Iceberg version 1.3.1 (latest release) ### Query engine Spark ### Please describe the bug 🐞 I created some Icebergs with the latest Iceberg/Spark and checked whet

Re: [PR] Build: Bump pypa/cibuildwheel from 2.16.0 to 2.16.1 [iceberg]

2023-10-02 Thread via GitHub
nastra closed pull request #8693: Build: Bump pypa/cibuildwheel from 2.16.0 to 2.16.1 URL: https://github.com/apache/iceberg/pull/8693 -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific co

Re: [PR] Build: Bump mkdocs-section-index from 0.3.7 to 0.3.8 in /python [iceberg]

2023-10-02 Thread via GitHub
dependabot[bot] commented on PR #8692: URL: https://github.com/apache/iceberg/pull/8692#issuecomment-1742823812 OK, I won't notify you again about this release, but will get in touch when a new version is available. If you'd rather skip all updates until the next major or minor version, let

Re: [PR] Build: Bump moto from 4.2.4 to 4.2.5 in /python [iceberg]

2023-10-02 Thread via GitHub
dependabot[bot] commented on PR #8690: URL: https://github.com/apache/iceberg/pull/8690#issuecomment-1742823790 OK, I won't notify you again about this release, but will get in touch when a new version is available. If you'd rather skip all updates until the next major or minor version, let

Re: [PR] Build: Bump duckdb from 0.8.1 to 0.9.0 in /python [iceberg]

2023-10-02 Thread via GitHub
dependabot[bot] commented on PR #8691: URL: https://github.com/apache/iceberg/pull/8691#issuecomment-1742823799 OK, I won't notify you again about this release, but will get in touch when a new version is available. If you'd rather skip all updates until the next major or minor version, let

Re: [PR] Build: Bump mkdocstrings-python from 1.7.0 to 1.7.1 in /python [iceberg]

2023-10-02 Thread via GitHub
dependabot[bot] commented on PR #8689: URL: https://github.com/apache/iceberg/pull/8689#issuecomment-1742823772 OK, I won't notify you again about this release, but will get in touch when a new version is available. If you'd rather skip all updates until the next major or minor version, let

Re: [PR] Build: Bump com.diffplug.spotless:spotless-plugin-gradle from 6.13.0 to 6.22.0 [iceberg]

2023-10-02 Thread via GitHub
nastra closed pull request #8694: Build: Bump com.diffplug.spotless:spotless-plugin-gradle from 6.13.0 to 6.22.0 URL: https://github.com/apache/iceberg/pull/8694 -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL abo

Re: [PR] Build: Bump rich from 13.5.3 to 13.6.0 in /python [iceberg]

2023-10-02 Thread via GitHub
dependabot[bot] commented on PR #8688: URL: https://github.com/apache/iceberg/pull/8688#issuecomment-1742823763 OK, I won't notify you again about this release, but will get in touch when a new version is available. If you'd rather skip all updates until the next major or minor version, let

Re: [PR] Build: Bump griffe from 0.36.2 to 0.36.4 in /python [iceberg]

2023-10-02 Thread via GitHub
dependabot[bot] commented on PR #8687: URL: https://github.com/apache/iceberg/pull/8687#issuecomment-1742823746 OK, I won't notify you again about this release, but will get in touch when a new version is available. If you'd rather skip all updates until the next major or minor version, let

Re: [PR] Build: Bump moto from 4.2.4 to 4.2.5 in /python [iceberg]

2023-10-02 Thread via GitHub
nastra closed pull request #8690: Build: Bump moto from 4.2.4 to 4.2.5 in /python URL: https://github.com/apache/iceberg/pull/8690 -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific commen

Re: [PR] Build: Bump mkdocstrings-python from 1.7.0 to 1.7.1 in /python [iceberg]

2023-10-02 Thread via GitHub
nastra closed pull request #8689: Build: Bump mkdocstrings-python from 1.7.0 to 1.7.1 in /python URL: https://github.com/apache/iceberg/pull/8689 -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the

Re: [PR] Build: Bump rich from 13.5.3 to 13.6.0 in /python [iceberg]

2023-10-02 Thread via GitHub
nastra closed pull request #8688: Build: Bump rich from 13.5.3 to 13.6.0 in /python URL: https://github.com/apache/iceberg/pull/8688 -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comm

Re: [PR] Build: Bump griffe from 0.36.2 to 0.36.4 in /python [iceberg]

2023-10-02 Thread via GitHub
nastra closed pull request #8687: Build: Bump griffe from 0.36.2 to 0.36.4 in /python URL: https://github.com/apache/iceberg/pull/8687 -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific co

Re: [PR] Build: Bump pypa/cibuildwheel from 2.16.0 to 2.16.1 [iceberg]

2023-10-02 Thread via GitHub
dependabot[bot] commented on PR #8693: URL: https://github.com/apache/iceberg/pull/8693#issuecomment-1742824237 OK, I won't notify you again about this release, but will get in touch when a new version is available. If you'd rather skip all updates until the next major or minor version, let

Re: [PR] Build: Bump com.diffplug.spotless:spotless-plugin-gradle from 6.13.0 to 6.22.0 [iceberg]

2023-10-02 Thread via GitHub
dependabot[bot] commented on PR #8694: URL: https://github.com/apache/iceberg/pull/8694#issuecomment-1742823828 OK, I won't notify you again about this release, but will get in touch when a new version is available. If you'd rather skip all updates until the next major or minor version, let

Re: [PR] Build: Bump mkdocs-section-index from 0.3.7 to 0.3.8 in /python [iceberg]

2023-10-02 Thread via GitHub
nastra closed pull request #8692: Build: Bump mkdocs-section-index from 0.3.7 to 0.3.8 in /python URL: https://github.com/apache/iceberg/pull/8692 -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the

Re: [PR] Build: Bump duckdb from 0.8.1 to 0.9.0 in /python [iceberg]

2023-10-02 Thread via GitHub
nastra closed pull request #8691: Build: Bump duckdb from 0.8.1 to 0.9.0 in /python URL: https://github.com/apache/iceberg/pull/8691 -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comm

Re: [I] Python: add support to optimize, analyze tables and expire snapshots, remove orphan files [iceberg]

2023-10-02 Thread via GitHub
Fokko closed issue #8183: Python: add support to optimize, analyze tables and expire snapshots, remove orphan files URL: https://github.com/apache/iceberg/issues/8183 -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the UR

  1   2   3   >