wanlce commented on issue #8510:
URL: https://github.com/apache/iceberg/issues/8510#issuecomment-1709634179
Sincerely hope to receive answers from the teachers @nastra @wypoon
Thanks in advance!
--
This is an automated message from the Apache Git Service.
To respond to the message, ple
Fokko opened a new issue, #8518:
URL: https://github.com/apache/iceberg/issues/8518
### Feature Request / Improvement
With the REST catalog setting properties, and updating the schema is
working. This is easy since the REST catalog is in charge of updating the
metadata, and writing a
Fokko commented on issue #8514:
URL: https://github.com/apache/iceberg/issues/8514#issuecomment-1709791580
@antonysouthworth-halter This is not implemented today but is high on the
list. Also, other users are looking for snapshot expiration, which is a very
similar operation. I've created
szehon-ho commented on PR #7105:
URL: https://github.com/apache/iceberg/pull/7105#issuecomment-1709898544
@ajantha-bhat i think that makes sense to me, discussion is here for
reference: https://github.com/apache/iceberg/pull/7105#discussion_r1318005645
Yea let's see if there is consensus.
szehon-ho commented on PR #8299:
URL: https://github.com/apache/iceberg/pull/8299#issuecomment-1709907691
Rebased on #3438 , TestCompression tests now pass, fyi @aokolnychyi when you
are back
--
This is an automated message from the Apache Git Service.
To respond to the message, please lo
szehon-ho commented on code in PR #8517:
URL: https://github.com/apache/iceberg/pull/8517#discussion_r1318413830
##
docs/configuration.md:
##
@@ -74,7 +74,7 @@ Iceberg tables support table properties to configure table
behavior, like the de
| write.metadata.metrics.column.col1
szehon-ho commented on PR #8517:
URL: https://github.com/apache/iceberg/pull/8517#issuecomment-1709914728
Thanks for pr, also please make the PR description clear what it does (we
can put the link to the issue in the PR description if you want)
--
This is an automated message from the Apa
Fokko commented on issue #8499:
URL: https://github.com/apache/iceberg/issues/8499#issuecomment-1709922231
Thanks @steinsgateted that would be awesome
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go
frankliee commented on issue #8487:
URL: https://github.com/apache/iceberg/issues/8487#issuecomment-1709973457
@Fokko Thanks for your reminder, I have found the reason is that the wrong
iceberg version is used.
--
This is an automated message from the Apache Git Service.
To respond to th
frankliee commented on issue #8487:
URL: https://github.com/apache/iceberg/issues/8487#issuecomment-1709976000
I could query the iceberg table by the latest version.
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
frankliee commented on issue #8482:
URL: https://github.com/apache/iceberg/issues/8482#issuecomment-1709979652
@Fokko Thanks for you reminder, the root cause is pip version, and pip 23.0
could compile pyiceberg correctly.
--
This is an automated message from the Apache Git Service.
To res
atifiu commented on code in PR #8517:
URL: https://github.com/apache/iceberg/pull/8517#discussion_r1318465020
##
docs/configuration.md:
##
@@ -74,7 +74,7 @@ Iceberg tables support table properties to configure table
behavior, like the de
| write.metadata.metrics.column.col1
atifiu commented on code in PR #8517:
URL: https://github.com/apache/iceberg/pull/8517#discussion_r1318465020
##
docs/configuration.md:
##
@@ -74,7 +74,7 @@ Iceberg tables support table properties to configure table
behavior, like the de
| write.metadata.metrics.column.col1
Fokko commented on issue #8487:
URL: https://github.com/apache/iceberg/issues/8487#issuecomment-1710007874
Thank you for letting me know. Also pyiceberg==0.5.0rc1 is available on PyPi
for testing :)
--
This is an automated message from the Apache Git Service.
To respond to the message, pl
Fokko closed issue #8487: Python: Cannot resolve avro file
URL: https://github.com/apache/iceberg/issues/8487
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-
Fokko commented on issue #8482:
URL: https://github.com/apache/iceberg/issues/8482#issuecomment-1710014853
@frankliee Thanks for letting me know. I've added a note on the website to
update `pip`: https://github.com/apache/iceberg/pull/8484 Let's close this one
as well, thanks for reporting
Fokko closed issue #8482: Python: Cannot install from source code.
URL: https://github.com/apache/iceberg/issues/8482
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubsc
sandflee opened a new pull request, #8519:
URL: https://github.com/apache/iceberg/pull/8519
#6850 add lazy snapshot loading for RESTCatalog, but RESTCatalogAdapter
doesn't process the 'snapshots' queryParam.
--
This is an automated message from the Apache Git Service.
To respond to the me
juanrondineau commented on issue #8333:
URL: https://github.com/apache/iceberg/issues/8333#issuecomment-1710250429
Hi, we are running spark jobs from DBT fwk, and we have the same issue when
we run a model, with merge strategie, that has a table with struct data_type
columns in its schema a
RussellSpitzer commented on code in PR #8517:
URL: https://github.com/apache/iceberg/pull/8517#discussion_r1318702274
##
docs/configuration.md:
##
@@ -74,7 +74,7 @@ Iceberg tables support table properties to configure table
behavior, like the de
| write.metadata.metrics.column
atifiu commented on code in PR #8517:
URL: https://github.com/apache/iceberg/pull/8517#discussion_r1318706970
##
docs/configuration.md:
##
@@ -74,7 +74,7 @@ Iceberg tables support table properties to configure table
behavior, like the de
| write.metadata.metrics.column.col1
ext-diego-duenas commented on issue #8333:
URL: https://github.com/apache/iceberg/issues/8333#issuecomment-1710293072
Just to add to the Thread, we made a test changing all data types to String
in the table with structs data type, and the error persist, so we don't think
the error is relate
amogh-jahagirdar opened a new pull request, #8520:
URL: https://github.com/apache/iceberg/pull/8520
For transactions, a `deletedFiles` set is maintained which keeps track of
the files to delete as part of the most recent commit. For simple transactions,
this set is not being cleared between
amogh-jahagirdar commented on PR #8520:
URL: https://github.com/apache/iceberg/pull/8520#issuecomment-1710405905
Still need to add test cases
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the s
rdblue commented on PR #3:
URL: https://github.com/apache/iceberg-go/pull/3#issuecomment-1710410048
@zeroshade, sorry for the delay! I'll find some time for reviews over here.
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub an
Xuanwo commented on issue #55:
URL: https://github.com/apache/iceberg-rust/issues/55#issuecomment-1710446025
I have a new idea for naming: How about using `Tabular`?
So we will have:
- `load_tabular()` / `load_table()` / `load_view()`
- `Tabular::Table` / `Tabular::View`
rdblue commented on code in PR #8397:
URL: https://github.com/apache/iceberg/pull/8397#discussion_r1318868914
##
core/src/main/java/org/apache/iceberg/BaseTransaction.java:
##
@@ -380,14 +375,9 @@ private void commitReplaceTransaction(boolean orCreate) {
} catch (RuntimeE
rdblue commented on code in PR #8397:
URL: https://github.com/apache/iceberg/pull/8397#discussion_r1318870175
##
core/src/main/java/org/apache/iceberg/BaseTransaction.java:
##
@@ -380,14 +375,9 @@ private void commitReplaceTransaction(boolean orCreate) {
} catch (RuntimeE
Samrose-Ahmed commented on issue #55:
URL: https://github.com/apache/iceberg-rust/issues/55#issuecomment-1710482809
> I have a new idea for naming: How about using `Tabular`?
>
> So we will have:
>
> - `load_tabular()` / `load_table()` / `load_view()`
> - `Tabular::Table(tabl
rdblue commented on PR #8397:
URL: https://github.com/apache/iceberg/pull/8397#issuecomment-1710483728
Looks good to me. Let's merge when tests are passing. Thanks,
@amogh-jahagirdar!
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to
amogh-jahagirdar commented on code in PR #8397:
URL: https://github.com/apache/iceberg/pull/8397#discussion_r1318884428
##
core/src/main/java/org/apache/iceberg/BaseTransaction.java:
##
@@ -380,14 +375,9 @@ private void commitReplaceTransaction(boolean orCreate) {
} catch
amogh-jahagirdar commented on code in PR #8397:
URL: https://github.com/apache/iceberg/pull/8397#discussion_r1318885267
##
core/src/main/java/org/apache/iceberg/BaseTransaction.java:
##
@@ -380,14 +375,9 @@ private void commitReplaceTransaction(boolean orCreate) {
} catch
Xuanwo commented on issue #55:
URL: https://github.com/apache/iceberg-rust/issues/55#issuecomment-171048
> I would avoid the confusion with the vendor.
Oh, I didn't take the vendor into consideration. I think tabular is a good
alternative to table like and widely used in pandas ec
JustinTimperio commented on code in PR #2:
URL: https://github.com/apache/iceberg-go/pull/2#discussion_r1318954109
##
partitions.go:
##
@@ -0,0 +1,218 @@
+// Licensed to the Apache Software Foundation (ASF) under one
+// or more contributor license agreements. See the NOTICE fi
JustinTimperio commented on code in PR #2:
URL: https://github.com/apache/iceberg-go/pull/2#discussion_r1318955697
##
partitions.go:
##
@@ -0,0 +1,218 @@
+// Licensed to the Apache Software Foundation (ASF) under one
+// or more contributor license agreements. See the NOTICE fi
amogh-jahagirdar commented on PR #8397:
URL: https://github.com/apache/iceberg/pull/8397#issuecomment-1710574693
Thanks for review @rdblue ! merging
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go t
amogh-jahagirdar merged PR #8397:
URL: https://github.com/apache/iceberg/pull/8397
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: issues-unsubscr...@ic
Fokko opened a new pull request, #8521:
URL: https://github.com/apache/iceberg/pull/8521
I think it would be good to include a pure Python fallback.
@rustyconover I'm seeing some weird errors here:
https://github.com/pola-rs/polars/actions/runs/6109489610/job/16580630135?pr=10375
--
hiteshbedre commented on PR #8491:
URL: https://github.com/apache/iceberg/pull/8491#issuecomment-1710683580
@amogh-jahagirdar who can help me with the next approval?
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
rafoid opened a new issue, #8522:
URL: https://github.com/apache/iceberg/issues/8522
### Apache Iceberg version
1.3.1 (latest release)
### Query engine
None
### Please describe the bug 🐞
When performing ALTER TABLE ... DROP COLUMN, it drops columns as expect
rafoid commented on issue #8522:
URL: https://github.com/apache/iceberg/issues/8522#issuecomment-1710706057
I think we need to modify the `commit()` method as following:
```
@Override
public void commit() {
TableMetadata update = applyChangesToMetadata(base.updateSchema(ap
rafoid opened a new pull request, #8523:
URL: https://github.com/apache/iceberg/pull/8523
This code intends to address the problem of allowing API dropping the last
column of a table mentioned here: https://github.com/apache/iceberg/issues/8522
--
This is an automated message from the Apa
github-actions[bot] commented on issue #7071:
URL: https://github.com/apache/iceberg/issues/7071#issuecomment-1710909025
This issue has been automatically marked as stale because it has been open
for 180 days with no activity. It will be closed in next 14 days if no further
activity occurs.
melvynator opened a new pull request, #274:
URL: https://github.com/apache/iceberg-docs/pull/274
Added clickhouse in the list of vendors
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specif
liurenjie1024 commented on issue #55:
URL: https://github.com/apache/iceberg-rust/issues/55#issuecomment-1710958778
> I have a new idea for naming: How about using `Tabular`?
>
> So we will have:
>
> * `load_tabular()` / `load_table()` / `load_view()`
> * `Tabular::Table(tabl
ConeyLiu commented on PR #8523:
URL: https://github.com/apache/iceberg/pull/8523#issuecomment-1710964389
What kind of scenario needs to drop all columns?
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to
frankliee opened a new pull request, #8524:
URL: https://github.com/apache/iceberg/pull/8524
I have tested pyiceberg on our hdfs cluster, and this pr fixed some bugs.
Changed.
1. Using optional parameters to create hdfs client, similar to gcs's style.
2. Fix `PyArrowFileIO.
rafoid commented on PR #8523:
URL: https://github.com/apache/iceberg/pull/8523#issuecomment-1711009177
@ConeyLiu That's exactly my point - under no circumstances a user should be
allowed to drop all columns. At this point the API is permissive enough for
such a scenario to occur.
--
This
rustyconover commented on PR #8521:
URL: https://github.com/apache/iceberg/pull/8521#issuecomment-1711014712
Hi @Fokko,
Reading the logs it looks like it's a packaging problem for Windows.
I'm pretty sure Cython works on Windows, but the wheel may not have the
necessary module
amogh-jahagirdar opened a new pull request, #8525:
URL: https://github.com/apache/iceberg/pull/8525
Currently there is no validation on delete files API for verifying that the
file to be deleted actually exists prior to the commit. This can cause
unexpected behavior, for example:
1.)
JanKaul commented on issue #55:
URL: https://github.com/apache/iceberg-rust/issues/55#issuecomment-1711086189
> I have a new idea for naming: How about using `Tabular`?
>
> So we will have:
>
> - `load_tabular()` / `load_table()` / `load_view()`
> - `Tabular::Table(table)` /
JanKaul commented on issue #55:
URL: https://github.com/apache/iceberg-rust/issues/55#issuecomment-1711087506
> > I have a new idea for naming: How about using `Tabular`?
> >
> > So we will have:
> >
> > * `load_tabular()` / `load_table()` / `load_view()`
> > * `Tabular::Tabl
liurenjie1024 opened a new issue, #8526:
URL: https://github.com/apache/iceberg/issues/8526
### Apache Iceberg version
1.3.1 (latest release)
### Query engine
None
### Please describe the bug 🐞
According to rest [open api's
spec](https://github.com/apache/i
liurenjie1024 commented on issue #8526:
URL: https://github.com/apache/iceberg/issues/8526#issuecomment-1711123130
I'm happy to take this if confirmed that it's a bug.
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use th
JanKaul commented on code in PR #42:
URL: https://github.com/apache/iceberg-rust/pull/42#discussion_r1319404484
##
crates/iceberg/src/transform/truncate.rs:
##
@@ -0,0 +1,177 @@
+// Licensed to the Apache Software Foundation (ASF) under one
+// or more contributor license agreem
chandu-1101 commented on issue #8333:
URL: https://github.com/apache/iceberg/issues/8333#issuecomment-1711162146
@juanrondineau , @ext-diego-duenas Glad to see updates on this thread.
@nastra even I don't think this is a schema issue!
@juanrondineau Can you explain further on
JanKaul commented on code in PR #56:
URL: https://github.com/apache/iceberg-rust/pull/56#discussion_r1319419895
##
crates/iceberg/src/spec/manifest_list.rs:
##
@@ -0,0 +1,881 @@
+// Licensed to the Apache Software Foundation (ASF) under one
+// or more contributor license agreem
JanKaul commented on code in PR #56:
URL: https://github.com/apache/iceberg-rust/pull/56#discussion_r1319441548
##
crates/iceberg/src/spec/manifest_list.rs:
##
@@ -0,0 +1,581 @@
+// Licensed to the Apache Software Foundation (ASF) under one
+// or more contributor license agreem
58 matches
Mail list logo
