adutra commented on code in PR #10256:
URL: https://github.com/apache/iceberg/pull/10256#discussion_r1590646919
##
core/src/main/java/org/apache/iceberg/rest/RESTSessionCatalog.java:
##
@@ -215,6 +215,12 @@ public void initialize(String name, Map
unresolved) {
this.paths =
adutra commented on code in PR #10256:
URL: https://github.com/apache/iceberg/pull/10256#discussion_r1590651661
##
core/src/main/java/org/apache/iceberg/rest/RESTSessionCatalog.java:
##
@@ -215,6 +215,12 @@ public void initialize(String name, Map
unresolved) {
this.paths =
Fokko commented on issue #124:
URL: https://github.com/apache/iceberg-rust/issues/124#issuecomment-2095389830
With Iceberg, the manifests are written to a target size (8 megabyte) by
default. Each manifest is bound to the same schema and partition, so you can
re-use the evaluators here. I w
manuzhang commented on PR #10160:
URL: https://github.com/apache/iceberg/pull/10160#issuecomment-2095436514
@pvary @nastra any more comments?
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the s
marvinlanhenke commented on issue #124:
URL: https://github.com/apache/iceberg-rust/issues/124#issuecomment-2095442660
> How do you feel starting with one task for one manifest file
you mean:
- spawn a new task for each manifest, load the manifest
(entry.load_manifest(...).await?)
Fokko commented on issue #338:
URL: https://github.com/apache/iceberg-rust/issues/338#issuecomment-2095451994
I think creating a field-id to a field-name map is a good (interim) solution.
Keep in mind that the next Avro release is planned for this week:
https://lists.apache.org/thread
Fokko commented on issue #124:
URL: https://github.com/apache/iceberg-rust/issues/124#issuecomment-2095455322
> so if we have a manifest_list with e.g. 5 entries, 1 is pruned
(ManifestEvaluator) we'd effectively spawn 4 tasks, to load the manifest and
handle all the data files; is this corr
Fokko merged PR #10160:
URL: https://github.com/apache/iceberg/pull/10160
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: issues-unsubscr...@iceberg.apa
Fokko merged PR #10267:
URL: https://github.com/apache/iceberg/pull/10267
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: issues-unsubscr...@iceberg.apa
liurenjie1024 commented on issue #124:
URL: https://github.com/apache/iceberg-rust/issues/124#issuecomment-2095481603
> > How do you feel starting with one task for one manifest file
>
> you mean:
>
> * spawn a new task for each manifest, load the manifest
(entry.load_manifest(
osscm commented on issue #10205:
URL: https://github.com/apache/iceberg/issues/10205#issuecomment-2095492489
thanks @flyrain
using `namespace` to include `catalog-name` can also work.
though then what will be the use of `catalog-id`
Though IMO, as Spark and Trino using hive'
chenwyi2 commented on code in PR #9447:
URL: https://github.com/apache/iceberg/pull/9447#discussion_r1590740653
##
spark/v3.5/spark/src/main/java/org/apache/iceberg/spark/procedures/RewriteManifestsProcedure.java:
##
@@ -118,4 +126,15 @@ private InternalRow[] toOutputRows(Rewrit
javrasya opened a new issue, #10274:
URL: https://github.com/apache/iceberg/issues/10274
### Apache Iceberg version
1.4.3
### Query engine
Spark
### Please describe the bug 🐞
We have added to columns in a nested struct field by using Iceberg Java API.
I can
wForget commented on issue #10251:
URL: https://github.com/apache/iceberg/issues/10251#issuecomment-2095570106
> Feel free to test the Iceberg 1.5.2 staged artifacts
Kyuubi CI with iceberg 1.5.2 RC0 also works fine.
https://github.com/apache/kyuubi/pull/6361
--
This is an automated
ZENOTME commented on issue #341:
URL: https://github.com/apache/iceberg-rust/issues/341#issuecomment-2095633576
Thanks! @Dysprosium0626 Sorry for replying late. Our original idea here is
to construct the delete schema outside the EqualityDeleteFileWriter.
```
let equality_ids = vec.
The warehouse property is just a
dependabot[bot] opened a new pull request, #706:
URL: https://github.com/apache/iceberg-python/pull/706
Bumps [werkzeug](https://github.com/pallets/werkzeug) from 3.0.1 to 3.0.3.
Release notes
Sourced from https://github.com/pallets/werkzeug/releases";>werkzeug's
releases.
3
gupteaj commented on issue #352:
URL: https://github.com/apache/iceberg-rust/issues/352#issuecomment-2096739753
@Fokko , @liurenjie1024
what changes are we looking for ?
Since rust is using option to hold snapshot id internally, but writing as -1
for V2 manifest files.
Does it need
dependabot[bot] opened a new pull request, #707:
URL: https://github.com/apache/iceberg-python/pull/707
Bumps [jinja2](https://github.com/pallets/jinja) from 3.1.3 to 3.1.4.
Release notes
Sourced from https://github.com/pallets/jinja/releases";>jinja2's releases.
3.1.4
Thi
dependabot[bot] opened a new pull request, #708:
URL: https://github.com/apache/iceberg-python/pull/708
Bumps [jinja2](https://github.com/pallets/jinja) from 3.1.3 to 3.1.4.
Release notes
Sourced from https://github.com/pallets/jinja/releases";>jinja2's releases.
3.1.4
Thi
flyrain commented on issue #10205:
URL: https://github.com/apache/iceberg/issues/10205#issuecomment-2096945405
I think we are talking about the same thing here. I don't think there is a
need to change the REST spec.
--
This is an automated message from the Apache Git Service.
To respond t
MehulBatra commented on issue #705:
URL: https://github.com/apache/iceberg-python/issues/705#issuecomment-2096955905
I would love to take a shot at it.
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to g
flyrain commented on code in PR #10256:
URL: https://github.com/apache/iceberg/pull/10256#discussion_r1591587764
##
core/src/main/java/org/apache/iceberg/rest/RESTSessionCatalog.java:
##
@@ -215,6 +215,12 @@ public void initialize(String name, Map
unresolved) {
this.paths
dimas-b opened a new issue, #10279:
URL: https://github.com/apache/iceberg/issues/10279
### Apache Iceberg version
1.5.0
### Query engine
Spark
### Please describe the bug 🐞
What a table is partitioned by a column that contains `#` in the name, some
inserts
flyrain commented on code in PR #10256:
URL: https://github.com/apache/iceberg/pull/10256#discussion_r1591603492
##
core/src/main/java/org/apache/iceberg/rest/RESTSessionCatalog.java:
##
@@ -215,6 +215,12 @@ public void initialize(String name, Map
unresolved) {
this.paths
nastra commented on PR #9008:
URL: https://github.com/apache/iceberg/pull/9008#issuecomment-2097095003
@jacobmarble sorry for the delay here. I'm traveling this week and should be
able to get to this PR after the Iceberg summit
--
This is an automated message from the Apache Git Service.
zeodtr commented on issue #338:
URL: https://github.com/apache/iceberg-rust/issues/338#issuecomment-2097101287
@a-agmon My concerns are as follows:
1. The `manifest_file_schema_fields` hashmap should be calculated only once
in an application's lifetime (for performance).
2. There are m
manuzhang commented on issue #8655:
URL: https://github.com/apache/iceberg/issues/8655#issuecomment-2097170237
I think you need to check with AWS support. It looks to be related to Glue
arg parser.
--
This is an automated message from the Apache Git Service.
To respond to the message, ple
HonahX commented on code in PR #701:
URL: https://github.com/apache/iceberg-python/pull/701#discussion_r1591764194
##
pyiceberg/catalog/hive.py:
##
@@ -111,6 +122,13 @@
HIVE2_COMPATIBLE = "hive.hive2-compatible"
HIVE2_COMPATIBLE_DEFAULT = False
+DEFAULT_LOCK_CHECK_MIN_WAIT_T
frankliee commented on code in PR #701:
URL: https://github.com/apache/iceberg-python/pull/701#discussion_r1591771902
##
pyiceberg/catalog/hive.py:
##
@@ -111,6 +122,13 @@
HIVE2_COMPATIBLE = "hive.hive2-compatible"
HIVE2_COMPATIBLE_DEFAULT = False
+DEFAULT_LOCK_CHECK_MIN_WAI
HonahX commented on code in PR #701:
URL: https://github.com/apache/iceberg-python/pull/701#discussion_r1591768312
##
pyiceberg/catalog/hive.py:
##
@@ -356,11 +371,46 @@ def _create_lock_request(self, database_name: str,
table_name: str) -> LockReque
return lock_requ
HonahX commented on code in PR #701:
URL: https://github.com/apache/iceberg-python/pull/701#discussion_r1591782640
##
pyiceberg/catalog/hive.py:
##
@@ -111,6 +122,13 @@
HIVE2_COMPATIBLE = "hive.hive2-compatible"
HIVE2_COMPATIBLE_DEFAULT = False
+DEFAULT_LOCK_CHECK_MIN_WAIT_T
HonahX commented on code in PR #704:
URL: https://github.com/apache/iceberg-python/pull/704#discussion_r1591786106
##
tests/integration/test_writes/test_writes.py:
##
@@ -833,3 +833,13 @@ def test_sanitize_character_partitioned(catalog: Catalog)
-> None:
)
assert le
HonahX merged PR #696:
URL: https://github.com/apache/iceberg-python/pull/696
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: issues-unsubscr...@iceberg
HonahX merged PR #697:
URL: https://github.com/apache/iceberg-python/pull/697
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: issues-unsubscr...@iceberg
oku95 commented on issue #8655:
URL: https://github.com/apache/iceberg/issues/8655#issuecomment-209746
Thanks will check, does this behavior by default on in all version of
iceberg ?
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on
HonahX commented on code in PR #703:
URL: https://github.com/apache/iceberg-python/pull/703#discussion_r1591829611
##
pyiceberg/transforms.py:
##
@@ -349,6 +356,13 @@ def dedup_name(self) -> str:
def preserves_order(self) -> bool:
return True
+@abstractmethod
HonahX merged PR #699:
URL: https://github.com/apache/iceberg-python/pull/699
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: issues-unsubscr...@iceberg
HonahX merged PR #706:
URL: https://github.com/apache/iceberg-python/pull/706
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: issues-unsubscr...@iceberg
HonahX merged PR #707:
URL: https://github.com/apache/iceberg-python/pull/707
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: issues-unsubscr...@iceberg
dependabot[bot] commented on PR #708:
URL: https://github.com/apache/iceberg-python/pull/708#issuecomment-2097489594
Looks like jinja2 is up-to-date now, so this is no longer needed.
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to Gi
dependabot[bot] closed pull request #708: Build: Bump jinja2 from 3.1.3 to 3.1.4
URL: https://github.com/apache/iceberg-python/pull/708
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific co
a-agmon commented on issue #338:
URL: https://github.com/apache/iceberg-rust/issues/338#issuecomment-2097495570
Thanks @zeodtr ,
We can certainly cache the manifest schema, and also recurse on the fields
read from the file.
Implementing a more efficient reader is also possible but ind
HonahX commented on code in PR #703:
URL: https://github.com/apache/iceberg-python/pull/703#discussion_r1591829611
##
pyiceberg/transforms.py:
##
@@ -349,6 +356,13 @@ def dedup_name(self) -> str:
def preserves_order(self) -> bool:
return True
+@abstractmethod
frankliee commented on code in PR #701:
URL: https://github.com/apache/iceberg-python/pull/701#discussion_r1591903957
##
pyiceberg/catalog/hive.py:
##
@@ -111,6 +122,13 @@
HIVE2_COMPATIBLE = "hive.hive2-compatible"
HIVE2_COMPATIBLE_DEFAULT = False
+DEFAULT_LOCK_CHECK_MIN_WAI
71 matches
Mail list logo
