nastra merged PR #10700:
URL: https://github.com/apache/iceberg/pull/10700
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: issues-unsubscr...@iceberg.ap
nastra merged PR #10697:
URL: https://github.com/apache/iceberg/pull/10697
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: issues-unsubscr...@iceberg.ap
nastra merged PR #10699:
URL: https://github.com/apache/iceberg/pull/10699
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: issues-unsubscr...@iceberg.ap
muniatl commented on issue #928:
URL: https://github.com/apache/iceberg-python/issues/928#issuecomment-2227729433
Thanks kevinjqliu. From the other thread it doesn't look like pyarrow
supports S3 express one. Does anyone know timelines for Express One Zone
support?
--
This is an automate
BsoBird commented on code in PR #10623:
URL: https://github.com/apache/iceberg/pull/10623#discussion_r1677327810
##
core/src/main/java/org/apache/iceberg/hadoop/HadoopTableOperations.java:
##
@@ -159,18 +169,124 @@ public void commit(TableMetadata base, TableMetadata
metadata)
pvary commented on PR #10695:
URL: https://github.com/apache/iceberg/pull/10695#issuecomment-2227695699
@fengjiajie: This change was introduced, because in older Iceberg versions
the different statistics behaved differently. See:
https://github.com/apache/iceberg/pull/7643
The goal i
dependabot[bot] commented on PR #458:
URL: https://github.com/apache/iceberg-rust/pull/458#issuecomment-2227645226
OK, I won't notify you again about this release, but will get in touch when
a new version is available. If you'd rather skip all updates until the next
major or minor version,
liurenjie1024 closed pull request #458: chore(deps): Update datafusion
requirement from 39.0.0 to 40.0.0
URL: https://github.com/apache/iceberg-rust/pull/458
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above t
liurenjie1024 commented on PR #458:
URL: https://github.com/apache/iceberg-rust/pull/458#issuecomment-2227645066
Close this as it's not an easy upgrade
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to
fengjiajie commented on PR #10695:
URL: https://github.com/apache/iceberg/pull/10695#issuecomment-2227633742
Hi @pvary, I noticed you've worked on changes related to `toReadableMap`
before. Could you take a look at this pull request and provide some feedback?
This pull request aims t
BsoBird closed pull request #10688: Core:support http lock-manager
URL: https://github.com/apache/iceberg/pull/10688
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscr
liurenjie1024 commented on PR #458:
URL: https://github.com/apache/iceberg-rust/pull/458#issuecomment-2227611281
@dependabot rebase
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific co
liurenjie1024 merged PR #457:
URL: https://github.com/apache/iceberg-rust/pull/457
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: issues-unsubscr...@ic
liurenjie1024 closed issue #425: discussion: Refactor our integration tests to
make it more scalable.
URL: https://github.com/apache/iceberg-rust/issues/425
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to
liurenjie1024 merged PR #455:
URL: https://github.com/apache/iceberg-rust/pull/455
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: issues-unsubscr...@ic
liurenjie1024 closed issue #453: Refactor `file_io_s3_test.rs` to reuse
container for test.
URL: https://github.com/apache/iceberg-rust/issues/453
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the
syun64 closed pull request #915: Will not be merged: Spark timestamptz
discrepancy
URL: https://github.com/apache/iceberg-python/pull/915
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific
syun64 commented on code in PR #921:
URL: https://github.com/apache/iceberg-python/pull/921#discussion_r1677258384
##
pyiceberg/io/pyarrow.py:
##
@@ -1407,7 +1408,7 @@ def list(self, list_type: ListType, list_array:
Optional[pa.Array], value_array:
# This can b
liurenjie1024 commented on issue #412:
URL: https://github.com/apache/iceberg-rust/issues/412#issuecomment-2227589874
> Since I didn't note any objections, I've started working on an in-memory
implementation of `Catalog`. I can take a look at writing a sqlite based
implementation as well af
syun64 commented on code in PR #921:
URL: https://github.com/apache/iceberg-python/pull/921#discussion_r1677257692
##
pyiceberg/io/pyarrow.py:
##
@@ -1450,14 +1451,17 @@ def field_partner(self, partner_struct:
Optional[pa.Array], field_id: int, _: st
except ValueEr
BsoBird commented on code in PR #10623:
URL: https://github.com/apache/iceberg/pull/10623#discussion_r1669863261
##
core/src/main/java/org/apache/iceberg/hadoop/HadoopTableOperations.java:
##
@@ -159,18 +169,124 @@ public void commit(TableMetadata base, TableMetadata
metadata)
BsoBird commented on code in PR #10623:
URL: https://github.com/apache/iceberg/pull/10623#discussion_r1669863261
##
core/src/main/java/org/apache/iceberg/hadoop/HadoopTableOperations.java:
##
@@ -159,18 +169,124 @@ public void commit(TableMetadata base, TableMetadata
metadata)
syun64 commented on code in PR #921:
URL: https://github.com/apache/iceberg-python/pull/921#discussion_r1677248853
##
pyiceberg/schema.py:
##
@@ -324,6 +324,11 @@ def field_ids(self) -> Set[int]:
"""Return the IDs of the current schema."""
return set(self._name
github-actions[bot] commented on issue #269:
URL: https://github.com/apache/iceberg-python/issues/269#issuecomment-2227533587
This issue has been automatically marked as stale because it has been open
for 180 days with no activity. It will be closed in next 14 days if no further
activity oc
Fokko commented on code in PR #921:
URL: https://github.com/apache/iceberg-python/pull/921#discussion_r1677191050
##
pyiceberg/schema.py:
##
@@ -324,6 +324,11 @@ def field_ids(self) -> Set[int]:
"""Return the IDs of the current schema."""
return set(self._name_
Fokko commented on code in PR #921:
URL: https://github.com/apache/iceberg-python/pull/921#discussion_r1677190423
##
pyiceberg/io/pyarrow.py:
##
@@ -1450,14 +1451,17 @@ def field_partner(self, partner_struct:
Optional[pa.Array], field_id: int, _: st
except ValueErr
Fokko commented on code in PR #921:
URL: https://github.com/apache/iceberg-python/pull/921#discussion_r1677190233
##
pyiceberg/io/pyarrow.py:
##
@@ -2214,13 +2200,16 @@ def _dataframe_to_data_files(
property_name=TableProperties.WRITE_TARGET_FILE_SIZE_BYTES,
de
Fokko closed issue #925: Calling load_table().scan().to_arrow() emits error on
empty "names" field in name mapping
URL: https://github.com/apache/iceberg-python/issues/925
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use t
Fokko commented on PR #927:
URL: https://github.com/apache/iceberg-python/pull/927#issuecomment-2227455479
Thanks for fixing this @spock-abadai and thanks for the review @kevinjqliu 🙌
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to
Fokko merged PR #927:
URL: https://github.com/apache/iceberg-python/pull/927
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: issues-unsubscr...@iceberg.
Fokko commented on code in PR #921:
URL: https://github.com/apache/iceberg-python/pull/921#discussion_r1677184500
##
pyiceberg/schema.py:
##
@@ -1616,3 +1621,145 @@ def _(file_type: FixedType, read_type: IcebergType) ->
IcebergType:
return read_type
else:
rdblue commented on code in PR #10691:
URL: https://github.com/apache/iceberg/pull/10691#discussion_r1677182372
##
core/src/main/java/org/apache/iceberg/util/ParallelIterable.java:
##
@@ -20,65 +20,69 @@
import java.io.Closeable;
import java.io.IOException;
+import java.util
rdblue commented on code in PR #10691:
URL: https://github.com/apache/iceberg/pull/10691#discussion_r1677181515
##
core/src/main/java/org/apache/iceberg/util/ParallelIterable.java:
##
@@ -126,6 +141,7 @@ private boolean checkTasks() {
} catch (InterruptedException e
syun64 commented on code in PR #921:
URL: https://github.com/apache/iceberg-python/pull/921#discussion_r1677181195
##
pyiceberg/io/pyarrow.py:
##
@@ -2214,13 +2200,16 @@ def _dataframe_to_data_files(
property_name=TableProperties.WRITE_TARGET_FILE_SIZE_BYTES,
d
rdblue commented on code in PR #10691:
URL: https://github.com/apache/iceberg/pull/10691#discussion_r1677181134
##
core/src/main/java/org/apache/iceberg/util/ParallelIterable.java:
##
@@ -192,4 +209,65 @@ public synchronized T next() {
return queue.poll();
}
}
+
+
rdblue commented on code in PR #10691:
URL: https://github.com/apache/iceberg/pull/10691#discussion_r1677181095
##
core/src/main/java/org/apache/iceberg/util/ParallelIterable.java:
##
@@ -192,4 +209,65 @@ public synchronized T next() {
return queue.poll();
}
}
+
+
syun64 commented on code in PR #921:
URL: https://github.com/apache/iceberg-python/pull/921#discussion_r1677181030
##
pyiceberg/schema.py:
##
@@ -1616,3 +1621,145 @@ def _(file_type: FixedType, read_type: IcebergType) ->
IcebergType:
return read_type
else:
rdblue commented on code in PR #10691:
URL: https://github.com/apache/iceberg/pull/10691#discussion_r1677179876
##
core/src/main/java/org/apache/iceberg/util/ParallelIterable.java:
##
@@ -136,19 +152,20 @@ private boolean checkTasks() {
}
}
- return !close
rdblue commented on code in PR #10691:
URL: https://github.com/apache/iceberg/pull/10691#discussion_r1677179126
##
core/src/main/java/org/apache/iceberg/util/ParallelIterable.java:
##
@@ -192,4 +209,65 @@ public synchronized T next() {
return queue.poll();
}
}
+
+
rdblue commented on code in PR #10691:
URL: https://github.com/apache/iceberg/pull/10691#discussion_r1677178824
##
core/src/main/java/org/apache/iceberg/util/ParallelIterable.java:
##
@@ -88,16 +92,26 @@ private ParallelIterator(
@Override
public void close() {
kevinjqliu commented on code in PR #921:
URL: https://github.com/apache/iceberg-python/pull/921#discussion_r1677166736
##
tests/integration/test_add_files.py:
##
@@ -501,14 +501,11 @@ def test_add_files_fails_on_schema_mismatch(spark:
SparkSession, session_catalog
kevinjqliu commented on issue #928:
URL: https://github.com/apache/iceberg-python/issues/928#issuecomment-2227406405
I think the error might be coming from the underlying
`pyarrow.fs.S3FileSystem` class which is used to interact with s3
https://arrow.apache.org/docs/python/generated/pyarr
syun64 commented on code in PR #921:
URL: https://github.com/apache/iceberg-python/pull/921#discussion_r1676970868
##
pyiceberg/io/pyarrow.py:
##
@@ -1450,14 +1451,17 @@ def field_partner(self, partner_struct:
Optional[pa.Array], field_id: int, _: st
except ValueEr
munip opened a new issue, #928:
URL: https://github.com/apache/iceberg-python/issues/928
### Question
I have been able to access a S3 bucket with pyIceberg using SqlCatalog
successfully with
catalog = SqlCatalog(
"default",
**{
"uri": f"sqlite:///{warehouse_path}/pyiceberg
munip opened a new issue, #10702:
URL: https://github.com/apache/iceberg/issues/10702
I have been able to access a S3 bucket with pyIceberg using SqlCatalog
successfully with
catalog = SqlCatalog(
"default",
**{
"uri": f"sqlite:///{warehouse_path}/pyiceberg_catalo
dependabot[bot] opened a new pull request, #458:
URL: https://github.com/apache/iceberg-rust/pull/458
Updates the requirements on
[datafusion](https://github.com/apache/datafusion) to permit the latest version.
Commits
https://github.com/apache/datafusion/commit/4cae81363e29f01
dependabot[bot] opened a new pull request, #457:
URL: https://github.com/apache/iceberg-rust/pull/457
Bumps [crate-ci/typos](https://github.com/crate-ci/typos) from 1.23.1 to
1.23.2.
Release notes
Sourced from https://github.com/crate-ci/typos/releases";>crate-ci/typos's
releases.
ming95 commented on code in PR #9905:
URL: https://github.com/apache/iceberg/pull/9905#discussion_r1677119220
##
orc/src/main/java/org/apache/iceberg/orc/ORCSchemaUtil.java:
##
@@ -23,7 +23,9 @@
import java.util.Objects;
import java.util.Optional;
import java.util.stream.
ming95 commented on code in PR #9905:
URL: https://github.com/apache/iceberg/pull/9905#discussion_r1677119029
##
orc/src/main/java/org/apache/iceberg/orc/ORCSchemaUtil.java:
##
@@ -296,24 +304,36 @@ private static TypeDescription buildOrcProjection(
list.ele
Fokko commented on code in PR #922:
URL: https://github.com/apache/iceberg-python/pull/922#discussion_r1677113136
##
pyiceberg/catalog/glue.py:
##
@@ -117,6 +124,12 @@
ICEBERG_FIELD_OPTIONAL = "iceberg.field.optional"
ICEBERG_FIELD_CURRENT = "iceberg.field.current"
+GLUE_PRO
prasanna-ds opened a new issue, #10701:
URL: https://github.com/apache/iceberg/issues/10701
### Apache Iceberg version
1.4.2
### Query engine
None
### Please describe the bug 🐞
I am using [Apache XTable](https://github.com/apache/incubator-xtable) to
conver
HonahX commented on code in PR #922:
URL: https://github.com/apache/iceberg-python/pull/922#discussion_r1677094692
##
mkdocs/docs/configuration.md:
##
@@ -22,35 +22,11 @@ hide:
- under the License.
-->
-# Catalogs
-
-PyIceberg currently has native support for REST, SQL,
HonahX commented on PR #922:
URL: https://github.com/apache/iceberg-python/pull/922#issuecomment-2227281955
> I wonder if we can treat the old property names (i.e. aws_access_key_id)
as an alias for the fallback config (client.access-key-id) versus fully
deprecating it in 0.8.0
@kevi
HonahX commented on code in PR #922:
URL: https://github.com/apache/iceberg-python/pull/922#discussion_r1677091804
##
pyiceberg/io/__init__.py:
##
@@ -320,6 +331,13 @@ def _infer_file_io_from_scheme(path: str, properties:
Properties) -> Optional[Fi
return None
+def _ge
dependabot[bot] opened a new pull request, #115:
URL: https://github.com/apache/iceberg-go/pull/115
Bumps
[github.com/aws/aws-sdk-go-v2/config](https://github.com/aws/aws-sdk-go-v2)
from 1.27.16 to 1.27.26.
Commits
https://github.com/aws/aws-sdk-go-v2/commit/0599931efcf551dc63
dependabot[bot] closed pull request #109: build(deps): bump
github.com/aws/aws-sdk-go-v2/config from 1.27.16 to 1.27.24
URL: https://github.com/apache/iceberg-go/pull/109
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use th
dependabot[bot] commented on PR #109:
URL: https://github.com/apache/iceberg-go/pull/109#issuecomment-2227266672
Superseded by #115.
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific c
dependabot[bot] commented on PR #110:
URL: https://github.com/apache/iceberg-go/pull/110#issuecomment-2227266133
Superseded by #114.
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific c
dependabot[bot] opened a new pull request, #114:
URL: https://github.com/apache/iceberg-go/pull/114
Bumps
[github.com/aws/aws-sdk-go-v2/service/s3](https://github.com/aws/aws-sdk-go-v2)
from 1.48.0 to 1.58.2.
Commits
https://github.com/aws/aws-sdk-go-v2/commit/0599931efcf551dc
dependabot[bot] closed pull request #110: build(deps): bump
github.com/aws/aws-sdk-go-v2/service/s3 from 1.48.0 to 1.58.0
URL: https://github.com/apache/iceberg-go/pull/110
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use
dependabot[bot] commented on PR #107:
URL: https://github.com/apache/iceberg-go/pull/107#issuecomment-2227264698
Superseded by #113.
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific c
dependabot[bot] closed pull request #107: build(deps): bump
github.com/aws/aws-sdk-go-v2 from 1.27.0 to 1.30.1
URL: https://github.com/apache/iceberg-go/pull/107
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL abo
dependabot[bot] opened a new pull request, #113:
URL: https://github.com/apache/iceberg-go/pull/113
Bumps [github.com/aws/aws-sdk-go-v2](https://github.com/aws/aws-sdk-go-v2)
from 1.27.0 to 1.30.3.
Commits
https://github.com/aws/aws-sdk-go-v2/commit/0599931efcf551dc63f84ec669d7
dependabot[bot] commented on PR #103:
URL: https://github.com/apache/iceberg-go/pull/103#issuecomment-2227263366
Superseded by #112.
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific c
dependabot[bot] closed pull request #103: build(deps): bump
github.com/aws/aws-sdk-go-v2/service/glue from 1.73.1 to 1.89.0
URL: https://github.com/apache/iceberg-go/pull/103
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and us
dependabot[bot] opened a new pull request, #112:
URL: https://github.com/apache/iceberg-go/pull/112
Bumps
[github.com/aws/aws-sdk-go-v2/service/glue](https://github.com/aws/aws-sdk-go-v2)
from 1.73.1 to 1.91.0.
Changelog
Sourced from https://github.com/aws/aws-sdk-go-v2/blob/servi
Fokko merged PR #10698:
URL: https://github.com/apache/iceberg/pull/10698
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: issues-unsubscr...@iceberg.apa
Fokko commented on code in PR #921:
URL: https://github.com/apache/iceberg-python/pull/921#discussion_r1677063050
##
pyiceberg/io/pyarrow.py:
##
@@ -2079,36 +2083,63 @@ def _check_schema_compatible(table_schema: Schema,
other_schema: pa.Schema, down
Raises:
ValueE
68 matches
Mail list logo
