Fokko merged PR #2157:
URL: https://github.com/apache/iceberg-python/pull/2157
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: issues-unsubscr...@iceber
Fokko merged PR #131:
URL: https://github.com/apache/iceberg-cpp/pull/131
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: issues-unsubscr...@iceberg.apa
dependabot[bot] closed pull request #13364: Build: Bump
software.amazon.awssdk:bom from 2.31.63 to 2.31.68
URL: https://github.com/apache/iceberg/pull/13364
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to
dependabot[bot] commented on PR #13364:
URL: https://github.com/apache/iceberg/pull/13364#issuecomment-3016283178
Superseded by #13424.
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specifi
dependabot[bot] opened a new pull request, #13424:
URL: https://github.com/apache/iceberg/pull/13424
Bumps software.amazon.awssdk:bom from 2.31.63 to 2.31.73.
[
from 3.3.0 to 3.4.0.
Release notes
Sourced from https://github.com/palanti
dependabot[bot] opened a new pull request, #13421:
URL: https://github.com/apache/iceberg/pull/13421
Bumps
[org.openapitools:openapi-generator-gradle-plugin](https://github.com/OpenAPITools/openapi-generator)
from 7.13.0 to 7.14.0.
Release notes
Sourced from https://github.com/Ope
dependabot[bot] opened a new pull request, #13420:
URL: https://github.com/apache/iceberg/pull/13420
Bumps [org.immutables:value](https://github.com/immutables/immutables) from
2.10.1 to 2.11.0.
Release notes
Sourced from https://github.com/immutables/immutables/releases";>org.immu
dependabot[bot] opened a new pull request, #13419:
URL: https://github.com/apache/iceberg/pull/13419
Bumps `derby` from 10.15.2.0 to 10.17.1.0.
Updates `org.apache.derby:derby` from 10.15.2.0 to 10.17.1.0
Updates `org.apache.derby:derbytools` from 10.15.2.0 to 10.17.1.0
D
dependabot[bot] commented on PR #13270:
URL: https://github.com/apache/iceberg/pull/13270#issuecomment-3016282994
Superseded by #13418.
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specifi
dependabot[bot] closed pull request #13089: Build: Bump
software.amazon.s3.analyticsaccelerator:analyticsaccelerator-s3 from 1.0.0 to
1.1.0
URL: https://github.com/apache/iceberg/pull/13089
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on
dependabot[bot] closed pull request #13272: Build: Bump junit from 5.12.2 to
5.13.1
URL: https://github.com/apache/iceberg/pull/13272
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific com
dependabot[bot] opened a new pull request, #13414:
URL: https://github.com/apache/iceberg/pull/13414
Bumps
[com.gradleup.shadow:shadow-gradle-plugin](https://github.com/GradleUp/shadow)
from 8.3.6 to 8.3.7.
Release notes
Sourced from https://github.com/GradleUp/shadow/releases";>c
dependabot[bot] opened a new pull request, #13418:
URL: https://github.com/apache/iceberg/pull/13418
Bumps `junit-platform` from 1.12.2 to 1.13.2.
Updates `org.junit.platform:junit-platform-launcher` from 1.12.2 to 1.13.2
Commits
See full diff in https://github.com/junit-team
dependabot[bot] opened a new pull request, #13417:
URL: https://github.com/apache/iceberg/pull/13417
Bumps
[software.amazon.s3.analyticsaccelerator:analyticsaccelerator-s3](https://github.com/awslabs/analytics-accelerator-s3)
from 1.0.0 to 1.2.0.
Release notes
Sourced from https:/
dependabot[bot] commented on PR #13089:
URL: https://github.com/apache/iceberg/pull/13089#issuecomment-3016282948
Superseded by #13417.
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specifi
dependabot[bot] commented on PR #13272:
URL: https://github.com/apache/iceberg/pull/13272#issuecomment-3016282772
Superseded by #13415.
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specifi
dependabot[bot] opened a new pull request, #13416:
URL: https://github.com/apache/iceberg/pull/13416
Bumps `testcontainers` from 1.21.2 to 1.21.3.
Updates `org.testcontainers:testcontainers` from 1.21.2 to 1.21.3
Release notes
Sourced from https://github.com/testcontainers/testco
dependabot[bot] opened a new pull request, #13415:
URL: https://github.com/apache/iceberg/pull/13415
Bumps `junit` from 5.12.2 to 5.13.2.
Updates `org.junit.jupiter:junit-jupiter` from 5.12.2 to 5.13.2
Release notes
Sourced from https://github.com/junit-team/junit-framework/relea
dependabot[bot] opened a new pull request, #13413:
URL: https://github.com/apache/iceberg/pull/13413
Bumps
[datamodel-code-generator](https://github.com/koxudaxi/datamodel-code-generator)
from 0.31.1 to 0.31.2.
Release notes
Sourced from https://github.com/koxudaxi/datamodel-code-
github-actions[bot] closed issue #1407: [Request] Area of Improvements for
Documentation
URL: https://github.com/apache/iceberg-python/issues/1407
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the
github-actions[bot] commented on issue #1407:
URL:
https://github.com/apache/iceberg-python/issues/1407#issuecomment-3016181500
This issue has been closed because it has not received any activity in the
last 14 days since being marked as 'stale'
--
This is an automated message from the A
github-actions[bot] commented on PR #12969:
URL: https://github.com/apache/iceberg/pull/12969#issuecomment-3016180075
This pull request has been marked as stale due to 30 days of inactivity. It
will be closed in 1 week if no further activity occurs. If you think that’s
incorrect or this pul
github-actions[bot] commented on PR #12667:
URL: https://github.com/apache/iceberg/pull/12667#issuecomment-3016180059
This pull request has been marked as stale due to 30 days of inactivity. It
will be closed in 1 week if no further activity occurs. If you think that’s
incorrect or this pul
github-actions[bot] commented on PR #12651:
URL: https://github.com/apache/iceberg/pull/12651#issuecomment-3016180053
This pull request has been marked as stale due to 30 days of inactivity. It
will be closed in 1 week if no further activity occurs. If you think that’s
incorrect or this pul
github-actions[bot] commented on issue #11890:
URL: https://github.com/apache/iceberg/issues/11890#issuecomment-3016180035
This issue has been automatically marked as stale because it has been open
for 180 days with no activity. It will be closed in next 14 days if no further
activity occur
github-actions[bot] commented on PR #9335:
URL: https://github.com/apache/iceberg/pull/9335#issuecomment-301617
This pull request has been closed due to lack of activity. This is not a
judgement on the merit of the PR in any way. It is just a way of keeping the PR
queue manageable. If y
github-actions[bot] closed pull request #9335: Core: Add reference snapshot
ID/timestamps to AllEntriesTable and AllManifestsTable
URL: https://github.com/apache/iceberg/pull/9335
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub a
rambleraptor commented on PR #2154:
URL: https://github.com/apache/iceberg-python/pull/2154#issuecomment-3016170663
I'm a little unclear what Catalog the REST integration tests run against, so
I can't say if there's been enough implemented to actually have a valid REST
Catalog test.
rambleraptor commented on code in PR #2154:
URL: https://github.com/apache/iceberg-python/pull/2154#discussion_r2173556886
##
pyiceberg/view/metadata.py:
##
@@ -0,0 +1,89 @@
+# Licensed to the Apache Software Foundation (ASF) under one
+# or more contributor license agreements.
rambleraptor opened a new issue, #2160:
URL: https://github.com/apache/iceberg-python/issues/2160
We should find a way to make sure that incorrect Literals raise a friendlier
error message than the standard Pydantic error message. Pydantic might be able
to do this for us.
_Originally
Anton-Tarazi commented on issue #2159:
URL:
https://github.com/apache/iceberg-python/issues/2159#issuecomment-3016154418
Being able to provide a "hint" seems like a decent workaround, but then we
have to rely on the user providing the correct filter, otherwise the upsert
won't work properl
jayceslesar commented on issue #2159:
URL:
https://github.com/apache/iceberg-python/issues/2159#issuecomment-3016142200
Haha I was just looking at this last week -- I wonder if it would make sense
for a user to be able to supply their own filter into the util? That was what
enabled me to s
Anton-Tarazi opened a new issue, #2159:
URL: https://github.com/apache/iceberg-python/issues/2159
### Feature Request / Improvement
## Feature Request / Improvement
Upserting large dataframes (tens of millions of rows) in un-usably slow due
to creating a massive `BooleanExpress
vinjai commented on PR #941:
URL: https://github.com/apache/iceberg-python/pull/941#issuecomment-3016019717
Hey @Fokko,
I tried the tests on a different machine. The tests are running fine.
Request you to run the workflow and merge this PR ahead.
Thanks
--
This is an aut
dentiny opened a new pull request, #1474:
URL: https://github.com/apache/iceberg-rust/pull/1474
## What changes are included in this PR?
Iceberg supports retry on commit:
https://iceberg.apache.org/docs/latest/configuration/#table-behavior-properties
To implement retry, I would lik
jayceslesar commented on code in PR #2068:
URL: https://github.com/apache/iceberg-python/pull/2068#discussion_r2173510707
##
tests/catalog/integration_test_bigquery_metastore.py:
##
Review Comment:
are special credentials needed to run this in CI?
--
This is an automate
jayceslesar commented on code in PR #2068:
URL: https://github.com/apache/iceberg-python/pull/2068#discussion_r2173510100
##
pyiceberg/catalog/bigquery_metastore.py:
##
@@ -0,0 +1,419 @@
+# Licensed to the Apache Software Foundation (ASF) under one
+# or more contributor license
jayceslesar commented on code in PR #2068:
URL: https://github.com/apache/iceberg-python/pull/2068#discussion_r2173509573
##
pyiceberg/catalog/bigquery_metastore.py:
##
@@ -0,0 +1,419 @@
+# Licensed to the Apache Software Foundation (ASF) under one
+# or more contributor license
jayceslesar commented on code in PR #2139:
URL: https://github.com/apache/iceberg-python/pull/2139#discussion_r2173506656
##
mkdocs/docs/api.md:
##
@@ -47,13 +47,11 @@ catalog:
warehouse: my-warehouse
```
-and loaded in python by calling `load_catalog(name="hive")` and
jayceslesar commented on PR #2089:
URL: https://github.com/apache/iceberg-python/pull/2089#issuecomment-3015999710
closing in favor of https://github.com/apache/iceberg-python/pull/2158
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to
jayceslesar opened a new pull request, #2158:
URL: https://github.com/apache/iceberg-python/pull/2158
Closes #2084
# Rationale for this change
Support pagination!
I looked at the rust iceberg implementation and noticed there is no laziness
there either so seems fine for the
jayceslesar closed pull request #2089: feat: support pagination in `list_*`
methods in rest catalog
URL: https://github.com/apache/iceberg-python/pull/2089
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to
kevinjqliu commented on issue #1836:
URL:
https://github.com/apache/iceberg-python/issues/1836#issuecomment-3015621718
> Looks like java iceberg does not have datafile level projection
implemented (eg: I don't seem to see filtering in the filescan related to
default values.)
@stevie
kevinjqliu opened a new pull request, #2157:
URL: https://github.com/apache/iceberg-python/pull/2157
# Rationale for this change
Manually update `multidict` dependency
Running `make install` gave the following warning:
```
Warning: The file chosen for install o
jayceslesar commented on PR #2089:
URL: https://github.com/apache/iceberg-python/pull/2089#issuecomment-3015531534
@kevinjqliu im gonna take another stab at this to see if we can accomplish
with less changes
--
This is an automated message from the Apache Git Service.
To respond to the me
jayceslesar commented on PR #2068:
URL: https://github.com/apache/iceberg-python/pull/2068#issuecomment-3015520546
Might be wise to also try and include the changes here
https://github.com/apache/iceberg/pull/13052 -- via
https://github.com/apache/iceberg/pull/12808#discussion_r2074868327
lishuxu commented on code in PR #112:
URL: https://github.com/apache/iceberg-cpp/pull/112#discussion_r2173350649
##
src/iceberg/table_scan.h:
##
@@ -0,0 +1,204 @@
+/*
+ * Licensed to the Apache Software Foundation (ASF) under one
+ * or more contributor license agreements. See
wgtmac commented on PR #131:
URL: https://github.com/apache/iceberg-cpp/pull/131#issuecomment-3015488252
Hmm...
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscri
jayceslesar commented on PR #2154:
URL: https://github.com/apache/iceberg-python/pull/2154#issuecomment-3015486498
Is it worth setting integration tests in [rest integration
tests](https://github.com/apache/iceberg-python/blob/main/tests/integration/test_rest_catalog.py)?
--
This
jayceslesar commented on code in PR #2154:
URL: https://github.com/apache/iceberg-python/pull/2154#discussion_r2173344552
##
pyiceberg/view/metadata.py:
##
@@ -0,0 +1,89 @@
+# Licensed to the Apache Software Foundation (ASF) under one
+# or more contributor license agreements.
wgtmac commented on code in PR #127:
URL: https://github.com/apache/iceberg-cpp/pull/127#discussion_r2173344474
##
src/iceberg/avro/avro_reader.cc:
##
@@ -96,11 +99,22 @@ class AvroBatchReader::Impl {
// Validate field ids in the file schema.
HasIdVisitor has_id_visito
jayceslesar commented on code in PR #2154:
URL: https://github.com/apache/iceberg-python/pull/2154#discussion_r2173331865
##
pyiceberg/view/metadata.py:
##
@@ -0,0 +1,89 @@
+# Licensed to the Apache Software Foundation (ASF) under one
+# or more contributor license agreements.
kumarpritam863 commented on PR #12460:
URL: https://github.com/apache/iceberg/pull/12460#issuecomment-3015329389
@bryanck can you please take a look.
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to
kumarpritam863 commented on PR #13357:
URL: https://github.com/apache/iceberg/pull/13357#issuecomment-3015328383
@Claudenw I did not get why every worker will try to create table if the
race condition is handled in the catalog itself. If race condition is handled
in the catalog then only on
MisterRaindrop commented on code in PR #127:
URL: https://github.com/apache/iceberg-cpp/pull/127#discussion_r2173277246
##
src/iceberg/avro/avro_reader.cc:
##
@@ -96,11 +99,22 @@ class AvroBatchReader::Impl {
// Validate field ids in the file schema.
HasIdVisitor has_i
MisterRaindrop commented on code in PR #127:
URL: https://github.com/apache/iceberg-cpp/pull/127#discussion_r2173277246
##
src/iceberg/avro/avro_reader.cc:
##
@@ -96,11 +99,22 @@ class AvroBatchReader::Impl {
// Validate field ids in the file schema.
HasIdVisitor has_i
zhjwpku commented on code in PR #112:
URL: https://github.com/apache/iceberg-cpp/pull/112#discussion_r2173250464
##
src/iceberg/snapshot.h:
##
@@ -222,6 +222,7 @@ struct ICEBERG_EXPORT DataOperation {
/// Snapshots are created by table operations.
struct ICEBERG_EXPORT Snapsho
madeirak commented on issue #13091:
URL: https://github.com/apache/iceberg/issues/13091#issuecomment-3015270711
Thx for reply.
Where can I find references to concurrency issues that may occur under
snapshot isolation?
maybe official references
Replied Message
| From
zhjwpku commented on PR #131:
URL: https://github.com/apache/iceberg-cpp/pull/131#issuecomment-3015251502
@wgtmac The CI failed on main with the following error messages:
```
/home/runner/work/iceberg-cpp/iceberg-cpp/src/iceberg/avro/avro_data_util.cc:74:37:
error: ‘SourceFieldInd
zhjwpku opened a new pull request, #131:
URL: https://github.com/apache/iceberg-cpp/pull/131
(no comment)
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-
Biman54 commented on issue #13091:
URL: https://github.com/apache/iceberg/issues/13091#issuecomment-3015234552
Currently, Iceberg does not support limiting conflict detection to a
specific partition or row filter during serializable isolation. However If your
workload would benefit from mor
prassee commented on issue #8322:
URL: https://github.com/apache/iceberg/issues/8322#issuecomment-3015065503
this issue still prevails for pyspark as well
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL ab
65 matches
Mail list logo