xuzhiwen1255 commented on code in PR #5642:
URL: https://github.com/apache/iceberg/pull/5642#discussion_r959223612
##
flink/v1.15/flink/src/main/java/org/apache/iceberg/flink/sink/IcebergStreamWriter.java:
##
@@ -87,6 +89,7 @@ public void endInput() throws IOException {
//
xuzhiwen1255 commented on code in PR #5642:
URL: https://github.com/apache/iceberg/pull/5642#discussion_r959222044
##
flink/v1.15/flink/src/main/java/org/apache/iceberg/flink/sink/IcebergStreamWriter.java:
##
@@ -87,6 +89,7 @@ public void endInput() throws IOException {
//
kbendick commented on code in PR #5642:
URL: https://github.com/apache/iceberg/pull/5642#discussion_r959219452
##
flink/v1.15/flink/src/main/java/org/apache/iceberg/flink/sink/IcebergStreamWriter.java:
##
@@ -87,6 +89,7 @@ public void endInput() throws IOException {
// rema
kbendick commented on code in PR #5642:
URL: https://github.com/apache/iceberg/pull/5642#discussion_r959219452
##
flink/v1.15/flink/src/main/java/org/apache/iceberg/flink/sink/IcebergStreamWriter.java:
##
@@ -87,6 +89,7 @@ public void endInput() throws IOException {
// rema
kbendick commented on code in PR #5642:
URL: https://github.com/apache/iceberg/pull/5642#discussion_r959217458
##
flink/v1.15/flink/src/main/java/org/apache/iceberg/flink/sink/IcebergStreamWriter.java:
##
@@ -87,6 +89,7 @@ public void endInput() throws IOException {
// rema
tongwei commented on issue #5677:
URL: https://github.com/apache/iceberg/issues/5677#issuecomment-1232531922
[
](url)
--
This is an automated message from the Apache
kbendick commented on code in PR #5642:
URL: https://github.com/apache/iceberg/pull/5642#discussion_r959214832
##
flink/v1.15/flink/src/main/java/org/apache/iceberg/flink/sink/IcebergStreamWriter.java:
##
@@ -87,6 +89,7 @@ public void endInput() throws IOException {
// rema
tongwei opened a new issue, #5677:
URL: https://github.com/apache/iceberg/issues/5677
### Query engine
spark
### Question
When I test iceberg with alluxio and spark, I notice that locality is
disable by default when FileSystem scheme is not hdfs. To enable this I can
on
xuzhiwen1255 commented on code in PR #5642:
URL: https://github.com/apache/iceberg/pull/5642#discussion_r959214446
##
flink/v1.15/flink/src/main/java/org/apache/iceberg/flink/sink/IcebergStreamWriter.java:
##
@@ -87,6 +89,7 @@ public void endInput() throws IOException {
//
lvyanquan commented on code in PR #5662:
URL: https://github.com/apache/iceberg/pull/5662#discussion_r959213698
##
docs/spark-queries.md:
##
@@ -318,12 +318,15 @@ To show a table's current partitions:
SELECT * FROM prod.db.table.partitions
```
-| partition | record_count | f
kbendick commented on code in PR #5642:
URL: https://github.com/apache/iceberg/pull/5642#discussion_r959213199
##
flink/v1.15/flink/src/main/java/org/apache/iceberg/flink/sink/IcebergStreamWriter.java:
##
@@ -87,6 +89,7 @@ public void endInput() throws IOException {
// rema
xuzhiwen1255 commented on PR #5642:
URL: https://github.com/apache/iceberg/pull/5642#issuecomment-1232511957
> Hey @xuzhiwen1255, thanks for the patch!
>
> I’ve been out very sick, but this seems important. I’ll do my best to take
a look as soon as possible. Thanks Steven for reviewin
xuzhiwen1255 commented on code in PR #5642:
URL: https://github.com/apache/iceberg/pull/5642#discussion_r959197838
##
flink/v1.15/flink/src/main/java/org/apache/iceberg/flink/sink/IcebergStreamWriter.java:
##
@@ -87,6 +89,7 @@ public void endInput() throws IOException {
//
szehon-ho commented on code in PR #5662:
URL: https://github.com/apache/iceberg/pull/5662#discussion_r959194801
##
docs/spark-queries.md:
##
@@ -318,12 +318,15 @@ To show a table's current partitions:
SELECT * FROM prod.db.table.partitions
```
-| partition | record_count | f
kbendick commented on code in PR #5642:
URL: https://github.com/apache/iceberg/pull/5642#discussion_r959194058
##
flink/v1.15/flink/src/main/java/org/apache/iceberg/flink/sink/IcebergStreamWriter.java:
##
@@ -87,6 +89,7 @@ public void endInput() throws IOException {
// rema
dotjdk opened a new issue, #5676:
URL: https://github.com/apache/iceberg/issues/5676
### Apache Iceberg version
0.14.0 (latest release)
### Query engine
Spark
### Please describe the bug 🐞
On a format version 2 table, dropping an old partition column on an i
kbendick commented on PR #5642:
URL: https://github.com/apache/iceberg/pull/5642#issuecomment-1232500424
Hey @xuzhiwen1255, thanks for the patch!
I’ve been out very sick, but this seems important. I’ll do my best to take a
look as soon as possible. Thanks Steven for reviewing.
--
T
pvary commented on PR #131:
URL: https://github.com/apache/iceberg-docs/pull/131#issuecomment-1232472565
@samredai: I see that all of the comments were fixed. If you also think
that the page is ready to be pushed, then I would be happy to merge.
Thanks, Peter
--
This is an autom
stevenzwu commented on code in PR #5642:
URL: https://github.com/apache/iceberg/pull/5642#discussion_r959153410
##
flink/v1.15/flink/src/main/java/org/apache/iceberg/flink/sink/IcebergStreamWriter.java:
##
@@ -87,6 +89,7 @@ public void endInput() throws IOException {
// rem
dmgcodevil opened a new issue, #5675:
URL: https://github.com/apache/iceberg/issues/5675
### Query engine
Flink
### Question
We have a streaming Flink job that continously consumes records from Kafka
and stores them into Iceberg.
The
[RewriteDataFilesAction](https:/
badbye commented on issue #2586:
URL: https://github.com/apache/iceberg/issues/2586#issuecomment-1232392801
To fully support geometry, there are lots of things to do.
1. Add geometry type.
2. Partitioning.
3. Filtering.
4. Writing and reading.
Firstly, we must figure out
lvyanquan commented on code in PR #5662:
URL: https://github.com/apache/iceberg/pull/5662#discussion_r959097698
##
docs/spark-queries.md:
##
@@ -318,12 +318,20 @@ To show a table's current partitions:
SELECT * FROM prod.db.table.partitions
```
-| partition | record_count | f
hililiwei commented on code in PR #4904:
URL: https://github.com/apache/iceberg/pull/4904#discussion_r959093861
##
flink/v1.15/flink/src/main/java/org/apache/iceberg/flink/sink/writer/StreamWriter.java:
##
@@ -0,0 +1,107 @@
+/*
+ * Licensed to the Apache Software Foundation (ASF
jzhuge commented on code in PR #4925:
URL: https://github.com/apache/iceberg/pull/4925#discussion_r959053085
##
api/src/main/java/org/apache/iceberg/view/ViewVersion.java:
##
@@ -0,0 +1,71 @@
+/*
+ * Licensed to the Apache Software Foundation (ASF) under one
+ * or more contribu
jzhuge commented on code in PR #4925:
URL: https://github.com/apache/iceberg/pull/4925#discussion_r959052594
##
api/src/main/java/org/apache/iceberg/view/ViewVersion.java:
##
@@ -0,0 +1,71 @@
+/*
+ * Licensed to the Apache Software Foundation (ASF) under one
+ * or more contribu
jzhuge commented on code in PR #4925:
URL: https://github.com/apache/iceberg/pull/4925#discussion_r959050316
##
api/src/main/java/org/apache/iceberg/catalog/ViewCatalog.java:
##
@@ -0,0 +1,153 @@
+/*
+ * Licensed to the Apache Software Foundation (ASF) under one
+ * or more cont
github-actions[bot] commented on issue #4257:
URL: https://github.com/apache/iceberg/issues/4257#issuecomment-1232301235
This issue has been automatically marked as stale because it has been open
for 180 days with no activity. It will be closed in next 14 days if no further
activity occurs.
sumeetgajjar commented on PR #5647:
URL: https://github.com/apache/iceberg/pull/5647#issuecomment-1232267521
A gentle ping @Fokko @samredai
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the sp
sumeetgajjar commented on PR #5645:
URL: https://github.com/apache/iceberg/pull/5645#issuecomment-1232267477
A gentle ping @Fokko @samredai
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the sp
jzhuge commented on PR #4925:
URL: https://github.com/apache/iceberg/pull/4925#issuecomment-1232176520
Merged Amogh's PR, rebased, and applied spotless.
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to
Fokko commented on PR #5672:
URL: https://github.com/apache/iceberg/pull/5672#issuecomment-1232104623
Waiting for https://github.com/apache/iceberg/pull/5627
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL abov
Fokko commented on code in PR #5627:
URL: https://github.com/apache/iceberg/pull/5627#discussion_r958866429
##
python/pyiceberg/table/partitioning.py:
##
@@ -157,3 +159,20 @@ def compatible_with(self, other: "PartitionSpec") -> bool:
UNPARTITIONED_PARTITION_SPEC = Partition
Fokko commented on code in PR #5627:
URL: https://github.com/apache/iceberg/pull/5627#discussion_r958853761
##
python/pyiceberg/table/metadata.py:
##
@@ -327,24 +334,43 @@ def check_sort_orders(cls, values: Dict[str, Any]):
based on the spec. Implementations must throw an e
Fokko commented on code in PR #5627:
URL: https://github.com/apache/iceberg/pull/5627#discussion_r958853064
##
python/pyiceberg/schema.py:
##
@@ -638,3 +724,61 @@ def map(self, map_type: MapType, key_result: int,
value_result: int) -> int:
def primitive(self, primitive:
Fokko commented on code in PR #5627:
URL: https://github.com/apache/iceberg/pull/5627#discussion_r958815658
##
python/pyiceberg/schema.py:
##
@@ -638,3 +724,61 @@ def map(self, map_type: MapType, key_result: int,
value_result: int) -> int:
def primitive(self, primitive:
Fokko commented on code in PR #5627:
URL: https://github.com/apache/iceberg/pull/5627#discussion_r958814479
##
python/pyiceberg/schema.py:
##
@@ -276,6 +279,32 @@ def primitive(self, primitive: PrimitiveType) -> T:
"""Visit a PrimitiveType"""
+class PreOrderSchemaVi
findepi commented on PR #5021:
URL: https://github.com/apache/iceberg/pull/5021#issuecomment-1231966833
Thank you for the merge!
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comme
findepi commented on PR #4741:
URL: https://github.com/apache/iceberg/pull/4741#issuecomment-1231967878
Rebased after #5021 has been merged to make Conflicts disappear.
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use t
Fokko merged PR #5674:
URL: https://github.com/apache/iceberg/pull/5674
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: issues-unsubscr...@iceberg.apach
bitsondatadev commented on PR #131:
URL: https://github.com/apache/iceberg-docs/pull/131#issuecomment-1231925458
Checking in here @rdblue and @samredai. Is anything holding this up?
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to Git
Fokko commented on code in PR #5665:
URL: https://github.com/apache/iceberg/pull/5665#discussion_r958677816
##
spark/v3.3/spark/src/main/java/org/apache/iceberg/spark/source/SparkTable.java:
##
@@ -212,7 +211,7 @@ public Set capabilities() {
@Override
public MetadataColu
rizaon commented on code in PR #4518:
URL: https://github.com/apache/iceberg/pull/4518#discussion_r958669856
##
core/src/main/java/org/apache/iceberg/ManifestFiles.java:
##
@@ -300,4 +328,14 @@ private static ManifestFile copyManifestInternal(
return writer.toManifestFile
rdblue merged PR #5021:
URL: https://github.com/apache/iceberg/pull/5021
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: issues-unsubscr...@iceberg.apac
amogh-jahagirdar commented on code in PR #5669:
URL: https://github.com/apache/iceberg/pull/5669#discussion_r958663366
##
core/src/main/java/org/apache/iceberg/RemoveSnapshots.java:
##
@@ -623,22 +667,82 @@ private Set findFilesToDelete(
return filesToDelete;
}
+ // H
Fokko opened a new pull request, #5674:
URL: https://github.com/apache/iceberg/pull/5674
Currently it is missing:
```
root@88de3a02961f:/# pip install
"git+https://github.com/apache/iceberg.git#subdirectory=python[pyarrow]"^C
root@88de3a02961f:/# pyiceberg
Traceback (most rec
pvary commented on code in PR #4518:
URL: https://github.com/apache/iceberg/pull/4518#discussion_r958600742
##
core/src/main/java/org/apache/iceberg/ManifestFiles.java:
##
@@ -300,4 +328,14 @@ private static ManifestFile copyManifestInternal(
return writer.toManifestFile(
msb1 commented on issue #5630:
URL: https://github.com/apache/iceberg/issues/5630#issuecomment-1231783307
If you are using gradle and creating shadow jar; do not use minimize()...
Was doing build with
shadowJar {
minimize()
zip64 true
}
in buil
huaxingao commented on code in PR #5638:
URL: https://github.com/apache/iceberg/pull/5638#discussion_r958586790
##
spark/v3.3/spark/src/test/java/org/apache/iceberg/spark/source/TestSparkTable.java:
##
@@ -47,14 +55,39 @@ public void removeTable() {
@Test
public void tes
samredai commented on PR #4801:
URL: https://github.com/apache/iceberg/pull/4801#issuecomment-1231689951
@rdblue when you have a chance can you take another look at this?
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use
rajan-v opened a new issue, #5673:
URL: https://github.com/apache/iceberg/issues/5673
### Feature Request / Improvement
Support for another interface in DeleteFiles
_DeleteFiles deleteOffsetFromDataFile(Map
dataFileAndOffsetFileMap)_
https://iceberg.apache.org/javadoc/master/o
Shane-Yu closed issue #5671: The upsert mode can query the historical version
of the data under certain conditions
URL: https://github.com/apache/iceberg/issues/5671
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
UR
Fokko opened a new pull request, #5672:
URL: https://github.com/apache/iceberg/pull/5672
The API wasn't consistent everywhere. Now the ids will just initialize at 1,
so the user doesn't have to do this.
--
This is an automated message from the Apache Git Service.
To respond to the message
Shane-Yu commented on issue #5671:
URL: https://github.com/apache/iceberg/issues/5671#issuecomment-1231565348
@rdblue @openinx @stevenzwu @kbendick Can you guys take some time to look
at this？
--
This is an automated message from the Apache Git Service.
To respond to the message, please
Shane-Yu opened a new issue, #5671:
URL: https://github.com/apache/iceberg/issues/5671
### Apache Iceberg version
0.13.1
### Query engine
Hive
### Please describe the bug 🐞
In Iceberg upsert mode, create v2 table like this：
> create table upsert_up
54 matches
Mail list logo
