Re: [I] Support get partition table with filter [iceberg-python]

2024-06-15 Thread via GitHub
syun64 closed issue #24: Support get partition table with filter URL: https://github.com/apache/iceberg-python/issues/24 -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. To unsu

Re: [I] Support get partition table with filter [iceberg-python]

2024-06-15 Thread via GitHub
syun64 commented on issue #24: URL: https://github.com/apache/iceberg-python/issues/24#issuecomment-2170955372 Partitions table was added in: https://github.com/apache/iceberg-python/pull/603 -- This is an automated message from the Apache Git Service. To respond to the message, please l

Re: [I] Support get partition table with filter [iceberg-python]

2024-02-29 Thread via GitHub
pp-akursar commented on issue #24: URL: https://github.com/apache/iceberg-python/issues/24#issuecomment-1972048447 I was looking for something comparable to spark's [partitions](https://iceberg.apache.org/docs/latest/spark-queries/#partitions) metadata table, which lets me do something like

Re: [I] Support get partition table with filter [iceberg-python]

2023-10-05 Thread via GitHub
puchengy commented on issue #24: URL: https://github.com/apache/iceberg-python/issues/24#issuecomment-1749897984 @Fokko Yes, I can help. Thanks. -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to th

Re: [I] Support get partition table with filter [iceberg-python]

2023-10-05 Thread via GitHub
Fokko commented on issue #24: URL: https://github.com/apache/iceberg-python/issues/24#issuecomment-1749431518 @puchengy Yes, certainly. Would this be something that you're interested in working on? From the snapshot, we can load the manifest list, and from there the manifests themselves, wh

Re: [I] Support get partition table with filter [iceberg-python]

2023-10-05 Thread via GitHub
puchengy commented on issue #24: URL: https://github.com/apache/iceberg-python/issues/24#issuecomment-1749412122 @Fokko gentle ping, thanks ^ -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the s

Re: [I] Support get partition table with filter [iceberg-python]

2023-10-02 Thread via GitHub
puchengy commented on issue #24: URL: https://github.com/apache/iceberg-python/issues/24#issuecomment-1743486785 > What do you think of passing in a predicate, and letting the Airflow sensor pass if there are rows? @Fokko That works. This is actually what we are doing (but for legacy

Re: [I] Support get partition table with filter [iceberg-python]

2023-10-02 Thread via GitHub
Fokko commented on issue #24: URL: https://github.com/apache/iceberg-python/issues/24#issuecomment-1743474860 @puchengy The problem with Iceberg is that the partition is more of a logical concept, rather than a physical path like in a Hive table. What do you think of passing in a predicate,

Re: [I] Support get partition table with filter [iceberg-python]

2023-10-02 Thread via GitHub
puchengy commented on issue #24: URL: https://github.com/apache/iceberg-python/issues/24#issuecomment-1743397194 Hello @Fokko, here is my use case: 1. Given a table, find out all the partitions it has. 2. Given a partition filter, check if such partition exist in the table. Thank you

[I] Support get partition table with filter [iceberg-python]

2023-10-02 Thread via GitHub
Fokko opened a new issue, #24: URL: https://github.com/apache/iceberg-python/issues/24 ### Feature Request / Improvement Migration of issue https://github.com/apache/iceberg/issues/8619 -- This is an automated message from the Apache Git Service. To respond to the message, please lo