jrouly commented on code in PR #490:
URL: https://github.com/apache/iceberg-python/pull/490#discussion_r1509830589
##
pyiceberg/catalog/glue.py:
##
@@ -93,6 +93,13 @@
if TYPE_CHECKING:
import pyarrow as pa
+
+# There is a unique Glue metastore in each AWS account and eac
jrouly commented on code in PR #490:
URL: https://github.com/apache/iceberg-python/pull/490#discussion_r1509829128
##
pyiceberg/catalog/glue.py:
##
@@ -252,6 +259,22 @@ def _construct_database_input(database_name: str,
properties: Properties) -> Dat
return database_input
jrouly commented on code in PR #490:
URL: https://github.com/apache/iceberg-python/pull/490#discussion_r1509828986
##
pyiceberg/catalog/glue.py:
##
@@ -252,6 +259,22 @@ def _construct_database_input(database_name: str,
properties: Properties) -> Dat
return database_input
jaychia commented on code in PR #9836:
URL: https://github.com/apache/iceberg/pull/9836#discussion_r1509756358
##
docs/docs/daft.md:
##
@@ -0,0 +1,148 @@
+---
+title: "Daft"
+---
+
+
+# Daft
+
+[Daft](www.getdaft.io) is a Python/Rust-based distributed query engine with a
Python
jaychia commented on code in PR #9836:
URL: https://github.com/apache/iceberg/pull/9836#discussion_r1509756120
##
docs/docs/daft.md:
##
@@ -0,0 +1,148 @@
+---
+title: "Daft"
+---
+
+
+# Daft
+
+[Daft](www.getdaft.io) is a Python/Rust-based distributed query engine with a
Python
ajantha-bhat closed issue #1832: Finalise the proposal for including Partition
stats for Iceberg tables
URL: https://github.com/apache/iceberg/issues/1832
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to g
ajantha-bhat commented on issue #1832:
URL: https://github.com/apache/iceberg/issues/1832#issuecomment-1974134920
tracked by https://github.com/apache/iceberg/issues/8450
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use
github-actions[bot] commented on issue #1832:
URL: https://github.com/apache/iceberg/issues/1832#issuecomment-1974116300
This issue has been automatically marked as stale because it has been open
for 180 days with no activity. It will be closed in next 14 days if no further
activity occurs.
github-actions[bot] commented on issue #1797:
URL: https://github.com/apache/iceberg/issues/1797#issuecomment-1974116280
This issue has been automatically marked as stale because it has been open
for 180 days with no activity. It will be closed in next 14 days if no further
activity occurs.
github-actions[bot] commented on issue #1779:
URL: https://github.com/apache/iceberg/issues/1779#issuecomment-1974116268
This issue has been automatically marked as stale because it has been open
for 180 days with no activity. It will be closed in next 14 days if no further
activity occurs.
github-actions[bot] commented on issue #1764:
URL: https://github.com/apache/iceberg/issues/1764#issuecomment-1974116261
This issue has been automatically marked as stale because it has been open
for 180 days with no activity. It will be closed in next 14 days if no further
activity occurs.
jaychia commented on code in PR #9836:
URL: https://github.com/apache/iceberg/pull/9836#discussion_r1509704079
##
docs/docs/daft.md:
##
@@ -0,0 +1,148 @@
+---
+title: "Daft"
+---
+
+
+# Daft
+
+[Daft](www.getdaft.io) is a Python/Rust-based distributed query engine with a
Python
jaychia commented on code in PR #9836:
URL: https://github.com/apache/iceberg/pull/9836#discussion_r1509703725
##
docs/docs/daft.md:
##
@@ -0,0 +1,148 @@
+---
+title: "Daft"
+---
+
+
+# Daft
+
+[Daft](www.getdaft.io) is a Python/Rust-based distributed query engine with a
Python
jaychia commented on code in PR #9836:
URL: https://github.com/apache/iceberg/pull/9836#discussion_r1509702759
##
docs/docs/daft.md:
##
@@ -0,0 +1,148 @@
+---
+title: "Daft"
+---
+
+
+# Daft
+
+[Daft](www.getdaft.io) is a Python/Rust-based distributed query engine with a
Python
bitsondatadev commented on code in PR #9836:
URL: https://github.com/apache/iceberg/pull/9836#discussion_r1508089551
##
docs/docs/daft.md:
##
@@ -0,0 +1,148 @@
+---
+title: "Daft"
+---
+
+
+# Daft
+
+[Daft](www.getdaft.io) is a Python/Rust-based distributed query engine with a
jrouly opened a new pull request, #490:
URL: https://github.com/apache/iceberg-python/pull/490
The [upstream Iceberg
documentation](https://iceberg.apache.org/docs/1.4.0/aws/#glue-catalog-id)
details `glue.id` as a parameter which can be used to set the AWS Glue Catalog
ID (AWS Account ID)
himadripal commented on code in PR #9803:
URL: https://github.com/apache/iceberg/pull/9803#discussion_r1509513392
##
spark/v3.5/spark/src/test/java/org/apache/iceberg/spark/actions/TestRewriteDataFilesAction.java:
##
@@ -1463,6 +1465,130 @@ public void testSnapshotProperty() {
himadripal commented on code in PR #9803:
URL: https://github.com/apache/iceberg/pull/9803#discussion_r1509513392
##
spark/v3.5/spark/src/test/java/org/apache/iceberg/spark/actions/TestRewriteDataFilesAction.java:
##
@@ -1463,6 +1465,130 @@ public void testSnapshotProperty() {
RussellSpitzer commented on code in PR #9803:
URL: https://github.com/apache/iceberg/pull/9803#discussion_r1509501139
##
spark/v3.5/spark/src/test/java/org/apache/iceberg/spark/actions/TestRewriteDataFilesAction.java:
##
@@ -1463,6 +1465,130 @@ public void testSnapshotProperty()
himadripal commented on code in PR #9803:
URL: https://github.com/apache/iceberg/pull/9803#discussion_r1509447610
##
spark/v3.5/spark/src/test/java/org/apache/iceberg/spark/actions/TestRewriteDataFilesAction.java:
##
@@ -1463,6 +1465,130 @@ public void testSnapshotProperty() {
himadripal commented on code in PR #9803:
URL: https://github.com/apache/iceberg/pull/9803#discussion_r1509449270
##
spark/v3.5/spark/src/test/java/org/apache/iceberg/spark/actions/TestRewriteDataFilesAction.java:
##
@@ -1463,6 +1465,130 @@ public void testSnapshotProperty() {
stevenzwu commented on code in PR #9606:
URL: https://github.com/apache/iceberg/pull/9606#discussion_r1509462559
##
flink/v1.18/flink/src/main/java/org/apache/iceberg/flink/FlinkSchemaUtil.java:
##
@@ -64,26 +68,75 @@ public static Schema convert(TableSchema schema) {
RowTy
himadripal commented on code in PR #9803:
URL: https://github.com/apache/iceberg/pull/9803#discussion_r1509452612
##
spark/v3.5/spark/src/test/java/org/apache/iceberg/spark/actions/TestRewriteDataFilesAction.java:
##
@@ -1463,6 +1465,130 @@ public void testSnapshotProperty() {
himadripal commented on code in PR #9803:
URL: https://github.com/apache/iceberg/pull/9803#discussion_r1509449270
##
spark/v3.5/spark/src/test/java/org/apache/iceberg/spark/actions/TestRewriteDataFilesAction.java:
##
@@ -1463,6 +1465,130 @@ public void testSnapshotProperty() {
himadripal commented on code in PR #9803:
URL: https://github.com/apache/iceberg/pull/9803#discussion_r1509449270
##
spark/v3.5/spark/src/test/java/org/apache/iceberg/spark/actions/TestRewriteDataFilesAction.java:
##
@@ -1463,6 +1465,130 @@ public void testSnapshotProperty() {
himadripal commented on code in PR #9803:
URL: https://github.com/apache/iceberg/pull/9803#discussion_r1509447610
##
spark/v3.5/spark/src/test/java/org/apache/iceberg/spark/actions/TestRewriteDataFilesAction.java:
##
@@ -1463,6 +1465,130 @@ public void testSnapshotProperty() {
gaoshihang opened a new issue, #9851:
URL: https://github.com/apache/iceberg/issues/9851
### Apache Iceberg version
1.4.1
### Query engine
Other
### Please describe the bug 🐞
I try to using Databricks do Iceberg table compaction, But I encountered
this issu
jqin61 opened a new pull request, #489:
URL: https://github.com/apache/iceberg-python/pull/489
(no comment)
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe,
jackye1995 commented on code in PR #9695:
URL: https://github.com/apache/iceberg/pull/9695#discussion_r1509260686
##
open-api/rest-catalog-open-api.yaml:
##
@@ -3789,6 +4097,21 @@ components:
EmptyResponse:
$ref: '#/components/examples/ListNamespacesE
jackye1995 commented on code in PR #9695:
URL: https://github.com/apache/iceberg/pull/9695#discussion_r1509260212
##
open-api/rest-catalog-open-api.yaml:
##
@@ -3789,6 +4097,21 @@ components:
EmptyResponse:
$ref: '#/components/examples/ListNamespacesE
jackye1995 commented on code in PR #9695:
URL: https://github.com/apache/iceberg/pull/9695#discussion_r1509258659
##
open-api/rest-catalog-open-api.yaml:
##
@@ -3804,6 +4127,21 @@ components:
}
}
+UnprocessableEntityResponse:
+ description:
+
jackye1995 commented on code in PR #9695:
URL: https://github.com/apache/iceberg/pull/9695#discussion_r1509256679
##
open-api/rest-catalog-open-api.yaml:
##
@@ -537,6 +537,108 @@ paths:
5XX:
$ref: '#/components/responses/ServerErrorResponse'
+ /v1/{prefix}
ZENOTME commented on code in PR #176:
URL: https://github.com/apache/iceberg-rust/pull/176#discussion_r1509234137
##
crates/iceberg/src/writer/file_writer/parquet_writer.rs:
##
@@ -0,0 +1,594 @@
+// Licensed to the Apache Software Foundation (ASF) under one
+// or more contribut
RussellSpitzer commented on code in PR #9803:
URL: https://github.com/apache/iceberg/pull/9803#discussion_r1509208963
##
spark/v3.5/spark/src/test/java/org/apache/iceberg/spark/actions/TestRewriteDataFilesAction.java:
##
@@ -1463,6 +1465,130 @@ public void testSnapshotProperty()
kevinjqliu opened a new pull request, #488:
URL: https://github.com/apache/iceberg-python/pull/488
(no comment)
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscri
tomtongue opened a new pull request, #9849:
URL: https://github.com/apache/iceberg/pull/9849
Migrate the following "Read" in iceberg-core to JUnit 5 and AssertJ style
for https://github.com/apache/iceberg/issues/9085.
## Current Progress (same as in the issue above)
Read:
- [x]
kevinjqliu opened a new pull request, #487:
URL: https://github.com/apache/iceberg-python/pull/487
(no comment)
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscri
bitsondatadev commented on PR #9843:
URL: https://github.com/apache/iceberg/pull/9843#issuecomment-1973432067
lol I forgot this is from another directory higher than the docs...I know
relative links are better in the long run but ugh they're a pain to debug in
the beginning.
--
This is a
liurenjie1024 commented on code in PR #207:
URL: https://github.com/apache/iceberg-rust/pull/207#discussion_r1508603649
##
crates/iceberg/src/scan.rs:
##
@@ -445,4 +494,22 @@ mod tests {
format!("{}/3.parquet", &fixture.table_location)
);
}
+
+#[to
BsoBird commented on PR #9546:
URL: https://github.com/apache/iceberg/pull/9546#issuecomment-1973312992
@pvary Hi. can you check this?
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific
ismailsimsek commented on issue #9848:
URL: https://github.com/apache/iceberg/issues/9848#issuecomment-1973204063
Thank you @nastra i will check it
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go t
nastra commented on code in PR #9843:
URL: https://github.com/apache/iceberg/pull/9843#discussion_r1508961736
##
format/spec.md:
##
@@ -791,7 +788,7 @@ Each version of table metadata is stored in a metadata
folder under the table’
Notes:
-1. The file system table scheme is
nastra commented on code in PR #9843:
URL: https://github.com/apache/iceberg/pull/9843#discussion_r1508956844
##
format/spec.md:
##
@@ -791,7 +788,7 @@ Each version of table metadata is stored in a metadata
folder under the table’
Notes:
-1. The file system table scheme is
bk-mz commented on issue #9833:
URL: https://github.com/apache/iceberg/issues/9833#issuecomment-1973147758
I guess, we can close this.
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific
bk-mz closed issue #9833: Calling `rewrite_position_delete_files` rewrites into
same amount of files
URL: https://github.com/apache/iceberg/issues/9833
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go t
Fokko commented on code in PR #176:
URL: https://github.com/apache/iceberg-rust/pull/176#discussion_r1508929875
##
crates/iceberg/src/writer/file_writer/parquet_writer.rs:
##
@@ -0,0 +1,594 @@
+// Licensed to the Apache Software Foundation (ASF) under one
+// or more contributor
bk-mz commented on issue #9833:
URL: https://github.com/apache/iceberg/issues/9833#issuecomment-1973118389
Okay, clarified myself: iceberg will store hour partition as nr-of-hours
since 1970.
--
This is an automated message from the Apache Git Service.
To respond to the message, please lo
nastra commented on issue #9848:
URL: https://github.com/apache/iceberg/issues/9848#issuecomment-1973069717
Additionally, make sure to sync up the AWS SDK version to what the
respective [Iceberg
version](https://github.com/apache/iceberg/blob/f1459e214493149f30d13e757b91aa18479778d9/gradle/
nastra commented on issue #9848:
URL: https://github.com/apache/iceberg/issues/9848#issuecomment-1973065090
@ismailsimsek this is typically a sign of mixed dependency versions on the
classpath. I think the problem is that Debezium is using [Spark
3.3](https://github.com/memiiso/debezium-ser
bk-mz commented on issue #9833:
URL: https://github.com/apache/iceberg/issues/9833#issuecomment-1973061741
I investigated a little.
So it seems that iceberg keeps partitions mapped to some form of id. I.e.
`2024-02-29-06` partition is translated to `474425`. Apparently running both
r
Fokko closed issue #148: feat: Add expression builder and display.
URL: https://github.com/apache/iceberg-rust/issues/148
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To uns
Fokko merged PR #169:
URL: https://github.com/apache/iceberg-rust/pull/169
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: issues-unsubscr...@iceberg.ap
Fokko commented on code in PR #169:
URL: https://github.com/apache/iceberg-rust/pull/169#discussion_r1508885728
##
crates/iceberg/src/expr/mod.rs:
##
@@ -18,25 +18,129 @@
//! This module contains expressions.
mod term;
+
+use std::fmt::{Display, Formatter};
+
pub use term::
ismailsimsek opened a new issue, #9848:
URL: https://github.com/apache/iceberg/issues/9848
### Query engine
Java API and Hive Catalog
### Question
When using iceberg with Hive catalog getting following error on some
environments. The error randomly appears in different e
MehulBatra opened a new issue, #9847:
URL: https://github.com/apache/iceberg/issues/9847
### Apache Iceberg version
1.4.3 (latest release)
### Query engine
Other
### Please describe the bug 🐞
Under the catalog page to understand the Rest Catalog, User click
chenwyi2 closed issue #9071: when hdfs router restart, task failed with read
data files " xx parquet is not a parquet file (length is too low :0) " or
manifest "java.io.EOFException: Unexpected EOF with 4 bytes remaining to read
avro"
URL: https://github.com/apache/iceberg/issues/9071
--
T
tomtongue commented on issue #9085:
URL: https://github.com/apache/iceberg/issues/9085#issuecomment-1972721005
I'm working on the following currently (will update)
## Current Progress
Read:
- [ ] `MetadataTableScanTestBase` (extends `TableTestBase`) (WIP)
- [ ] `TestMetadata
wg1026688210 closed issue #1688: iceberg flink sink job can't restart due to
metadata location not found
URL: https://github.com/apache/iceberg/issues/1688
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above
boroknagyz commented on PR #9781:
URL: https://github.com/apache/iceberg/pull/9781#issuecomment-1972699931
Thanks @amogh-jahagirdar for taking a look. Then it seems to be a bug in
Hive and Impala.
Filed
- https://issues.apache.org/jira/browse/HIVE-28102
- https://issues.apache.org/j
boroknagyz closed pull request #9781: Core: RowDelta should conflict with
RewriteFiles operation
URL: https://github.com/apache/iceberg/pull/9781
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the
60 matches
Mail list logo