smileyboy2019 commented on issue #10372:
URL: https://github.com/apache/iceberg/issues/10372#issuecomment-2136665243
是支持生命周期的TTL,同时设置归档目录,到期的数据自动归档历史数据路径里面
//TTL时间设置,超过7天数据自动删除
CREATE TABLE my_table ( id INT, name STRING ) PARTITIONED BY (dt STRING,
city STRING) TBLPROPERTIES (
Fokko merged PR #775:
URL: https://github.com/apache/iceberg-python/pull/775
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: issues-unsubscr...@iceberg.
manuzhang commented on PR #10252:
URL: https://github.com/apache/iceberg/pull/10252#issuecomment-2136545206
It looks to be related to runner

--
This is an a
manuzhang closed pull request #10252: Spark 3.5: Only traverse ancestors of
current snapshot when building changelog scan
URL: https://github.com/apache/iceberg/pull/10252
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use t
Fokko merged PR #776:
URL: https://github.com/apache/iceberg-python/pull/776
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: issues-unsubscr...@iceberg.
manuzhang commented on PR #10252:
URL: https://github.com/apache/iceberg/pull/10252#issuecomment-2136502711
Not sure why some CI runs get cancelled.
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go t
amogh-jahagirdar commented on code in PR #9695:
URL: https://github.com/apache/iceberg/pull/9695#discussion_r1618157387
##
open-api/rest-catalog-open-api.yaml:
##
@@ -2106,6 +2210,32 @@ components:
items:
$ref: '#/components/schemas/PartitionStatisticsFil
amogh-jahagirdar commented on code in PR #9695:
URL: https://github.com/apache/iceberg/pull/9695#discussion_r1618157387
##
open-api/rest-catalog-open-api.yaml:
##
@@ -2106,6 +2210,32 @@ components:
items:
$ref: '#/components/schemas/PartitionStatisticsFil
flyrain commented on PR #10252:
URL: https://github.com/apache/iceberg/pull/10252#issuecomment-2136479142
retest this please
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
manuzhang closed pull request #10252: Spark 3.5: Only traverse ancestors of
current snapshot when building changelog scan
URL: https://github.com/apache/iceberg/pull/10252
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use t
manuzhang closed pull request #10252: Spark 3.5: Only traverse ancestors of
current snapshot when building changelog scan
URL: https://github.com/apache/iceberg/pull/10252
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use t
kevinjqliu commented on issue #774:
URL: https://github.com/apache/iceberg-python/issues/774#issuecomment-2136348284
Great suggestion! It'll be good to balance contents between the README and
the pyiceberg website (https://py.iceberg.apache.org/)
--
This is an automated message from t
kevinjqliu commented on issue #763:
URL: https://github.com/apache/iceberg-python/issues/763#issuecomment-2136335963
We discussed this issue in the monthly sync and agreed that this is a useful
feature. We'll first implement the read side in `pyiceberg`. The write side is
complicated due to
zeroshade commented on PR #91:
URL: https://github.com/apache/iceberg-go/pull/91#issuecomment-2136258091
CC @Fokko @wolfeidau @nastra
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific
zeroshade opened a new pull request, #91:
URL: https://github.com/apache/iceberg-go/pull/91
Building on #76, this PR implements the interfaces and basic implementations
of BooleanExpressions, bound and unbound predicates, and a series of wrapper
functions for convenience. It also adds tests
dependabot[bot] opened a new pull request, #776:
URL: https://github.com/apache/iceberg-python/pull/776
Bumps [coverage](https://github.com/nedbat/coveragepy) from 7.5.2 to 7.5.3.
Changelog
Sourced from https://github.com/nedbat/coveragepy/blob/master/CHANGES.rst";>coverage's
chang
dependabot[bot] opened a new pull request, #775:
URL: https://github.com/apache/iceberg-python/pull/775
Bumps [pydantic](https://github.com/pydantic/pydantic) from 2.7.1 to 2.7.2.
Release notes
Sourced from https://github.com/pydantic/pydantic/releases";>pydantic's
releases.
amogh-jahagirdar commented on PR #4912:
URL: https://github.com/apache/iceberg/pull/4912#issuecomment-2136044924
Hey @puchengy I'm wokring on it! I am aiming to have a PR out sometime this
week to address this.
--
This is an automated message from the Apache Git Service.
To respond to th
puchengy commented on PR #4912:
URL: https://github.com/apache/iceberg/pull/4912#issuecomment-2136041865
@amogh-jahagirdar Hello, i wonder is there any update on this? Our clients
from time to time hit the issue and cause some interruptions to their workload.
Thanks!
--
This is an automa
szehon-ho commented on code in PR #10288:
URL: https://github.com/apache/iceberg/pull/10288#discussion_r1617834879
##
spark/v3.5/spark/src/main/java/org/apache/iceberg/spark/actions/AnalyzeTableSparkAction.java:
##
@@ -0,0 +1,150 @@
+/*
+ * Licensed to the Apache Software Founda
jlhester commented on PR #603:
URL: https://github.com/apache/iceberg-python/pull/603#issuecomment-2136012377
Thanks @syun64 for implementing this! It would be pretty useful for some
work I'm doing. When do you think this will be released? I see it's on the
[near term roadmap](https://githu
pvary commented on code in PR #10370:
URL: https://github.com/apache/iceberg/pull/10370#discussion_r1617641116
##
flink/v1.19/flink/src/test/java/org/apache/iceberg/flink/source/TestIcebergSourceFailover.java:
##
@@ -124,7 +124,7 @@ public void testBoundedWithSavepoint() throws
ajantha-bhat commented on code in PR #10374:
URL: https://github.com/apache/iceberg/pull/10374#discussion_r1617622341
##
site/docs/archive.md:
##
@@ -0,0 +1,34 @@
+---
+title: "Archive"
+---
+
+
+Documentations of Iceberg versions older than 1.4.0 are no longer maintained.
Here
stevenzwu commented on PR #10373:
URL: https://github.com/apache/iceberg/pull/10373#issuecomment-2135677546
> Upstream callers of the transaction/snapshot producer APIs such as engines
like Spark currently handle CommitStateUnknown exceptions to avoid cleaning up
data files when it's unclea
Xuanwo commented on issue #385:
URL: https://github.com/apache/iceberg-rust/issues/385#issuecomment-2135636174
I believe we should enable the storage we want in `iceberg` crate.
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub
c-thiel closed pull request #384: Add "services-s3" feature for opendal
URL: https://github.com/apache/iceberg-rust/pull/384
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To
jacobmarble commented on PR #9008:
URL: https://github.com/apache/iceberg/pull/9008#issuecomment-2135579590
@nastra or @rdblue - friendly reminder to review this
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL
c-thiel opened a new pull request, #384:
URL: https://github.com/apache/iceberg-rust/pull/384
(no comment)
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e
manuzhang commented on code in PR #10374:
URL: https://github.com/apache/iceberg/pull/10374#discussion_r1617496387
##
site/docs/archive.md:
##
@@ -0,0 +1,34 @@
+---
+title: "Archive"
+---
+
+
+Documentations of Iceberg versions older than 1.4.0 are no longer maintained.
Here ar
Fokko commented on PR #76:
URL: https://github.com/apache/iceberg-go/pull/76#issuecomment-2135444853
@zeroshade Awesome, let's get this in! 🚀
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the
Fokko merged PR #76:
URL: https://github.com/apache/iceberg-go/pull/76
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: issues-unsubscr...@iceberg.apache
zeroshade commented on PR #76:
URL: https://github.com/apache/iceberg-go/pull/76#issuecomment-2135416145
updated and fixed the conflicts @Fokko! :smile:
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to
Fokko commented on PR #10388:
URL: https://github.com/apache/iceberg/pull/10388#issuecomment-2135363789
> but the link checker is very-very flaky
Yes, I agree, it is creating more frustration than actually helping right
now :( I'm okay with disabling it until we find something better
Fokko commented on issue #10390:
URL: https://github.com/apache/iceberg/issues/10390#issuecomment-2135357197
Removing the roadmap was an attempt to have fewer places where we track
things, so it would become more likely to keep things in sync.
I think we should keep the milestones a t
jbonofre commented on issue #10390:
URL: https://github.com/apache/iceberg/issues/10390#issuecomment-2135157480
roadmap page has been removed to avoid confusion as it was not up to date.
We proposed/discussed to replace with a link on GitHub issues using
milestone tag. That said, I'm not
ajantha-bhat commented on issue #10390:
URL: https://github.com/apache/iceberg/issues/10390#issuecomment-2135151506
https://github.com/apache/iceberg/projects?query=is%3Aopen&type=classic is
not well maintained as of now. Also It only captures ongoing projects. Roadmaps
usually will also in
gphilipp commented on issue #10390:
URL: https://github.com/apache/iceberg/issues/10390#issuecomment-2135144837
Maybe just add a pointer to
https://github.com/apache/iceberg/projects?query=is%3Aopen&type=classic in
https://iceberg.apache.org/roadmap/?
--
This is an automated message from
ajantha-bhat commented on code in PR #10374:
URL: https://github.com/apache/iceberg/pull/10374#discussion_r1617179538
##
site/docs/archive.md:
##
@@ -0,0 +1,34 @@
+---
+title: "Archive"
+---
+
+
+Documentations of Iceberg versions older than 1.4.0 are no longer maintained.
Here
gphilipp commented on issue #10390:
URL: https://github.com/apache/iceberg/issues/10390#issuecomment-2135116057
Thanks, I also found out. It'd be nice to point to _something_. For example,
Delta Lake has a placeholder page which points to
https://github.com/orgs/delta-io/projects/10/views/1
ajantha-bhat commented on issue #10390:
URL: https://github.com/apache/iceberg/issues/10390#issuecomment-2135110463
It was removed after discussion in
https://github.com/apache/iceberg/pull/9941
--
This is an automated message from the Apache Git Service.
To respond to the message, please
hantangwangd commented on PR #10369:
URL: https://github.com/apache/iceberg/pull/10369#issuecomment-2135076025
Hi @nastra, can you please take a look at this fix when available? Thanks a
lot!
--
This is an automated message from the Apache Git Service.
To respond to the message, please lo
gphilipp opened a new issue, #10390:
URL: https://github.com/apache/iceberg/issues/10390
### Query engine
_No response_
### Question
This page yields a 404: https://iceberg.apache.org/roadmap/
Is this where the roadmap is supposed to be?
--
This is an autom
ggershinsky opened a new pull request, #7770:
URL: https://github.com/apache/iceberg/pull/7770
(no comment)
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe,
ggershinsky closed pull request #7770: Manifest list encryption
URL: https://github.com/apache/iceberg/pull/7770
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe,
aajisaka commented on code in PR #10276:
URL: https://github.com/apache/iceberg/pull/10276#discussion_r1616950141
##
aws/src/main/java/org/apache/iceberg/aws/glue/IcebergToGlueConverter.java:
##
@@ -234,8 +258,26 @@ static void setTableInputInformation(
Optional.ofNullabl
jbonofre commented on code in PR #10386:
URL: https://github.com/apache/iceberg/pull/10386#discussion_r1616817365
##
dev/revapi:
##
@@ -0,0 +1,86 @@
+#!/usr/bin/env bash
+
+#
+# Licensed to the Apache Software Foundation (ASF) under one or more
+# contributor license agreements.
jbonofre commented on PR #10386:
URL: https://github.com/apache/iceberg/pull/10386#issuecomment-2134605932
You can see it's not source breaking change. We just check source breaks
(not semantic or binary).
--
This is an automated message from the Apache Git Service.
To respond to the mess
Fokko commented on code in PR #10386:
URL: https://github.com/apache/iceberg/pull/10386#discussion_r1616786126
##
dev/revapi:
##
@@ -0,0 +1,86 @@
+#!/usr/bin/env bash
+
+#
+# Licensed to the Apache Software Foundation (ASF) under one or more
+# contributor license agreements. S
Fokko commented on issue #10378:
URL: https://github.com/apache/iceberg/issues/10378#issuecomment-2134575602
Thanks for caching these @manuzhang. Let me know if you need any help!
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHu
Fokko merged PR #10269:
URL: https://github.com/apache/iceberg/pull/10269
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: issues-unsubscr...@iceberg.apa
Fokko commented on issue #10389:
URL: https://github.com/apache/iceberg/issues/10389#issuecomment-2134571953
Hey @Manoranjan93 Thanks for reaching out!
Iceberg has absolute paths, so you cannot just copy the files as the paths
in the metadata still point to S3. The best way to copy th
Fokko merged PR #591:
URL: https://github.com/apache/iceberg-python/pull/591
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: issues-unsubscr...@iceberg.
chinmay-bhat commented on code in PR #748:
URL: https://github.com/apache/iceberg-python/pull/748#discussion_r1616717181
##
pyiceberg/table/__init__.py:
##
@@ -1290,6 +1291,19 @@ def snapshot_by_name(self, name: str) ->
Optional[Snapshot]:
return self.snapshot_by_i
ajantha-bhat commented on PR #10183:
URL: https://github.com/apache/iceberg/pull/10183#issuecomment-2134518588
If not this, we need other ways to solve this problem. Currently a proposal
can be split into multiple tasks.
We don't know how many tasks completed and how many pending.
chinmay-bhat commented on code in PR #748:
URL: https://github.com/apache/iceberg-python/pull/748#discussion_r1616717556
##
pyiceberg/table/snapshots.py:
##
@@ -412,3 +417,12 @@ def _update_totals(total_property: str, added_property:
str, removed_property: s
def set_when_posit
chinmay-bhat commented on code in PR #748:
URL: https://github.com/apache/iceberg-python/pull/748#discussion_r1616717181
##
pyiceberg/table/__init__.py:
##
@@ -1290,6 +1291,19 @@ def snapshot_by_name(self, name: str) ->
Optional[Snapshot]:
return self.snapshot_by_i
chinmay-bhat commented on code in PR #748:
URL: https://github.com/apache/iceberg-python/pull/748#discussion_r1616712540
##
pyiceberg/table/__init__.py:
##
@@ -1290,6 +1291,19 @@ def snapshot_by_name(self, name: str) ->
Optional[Snapshot]:
return self.snapshot_by_i
57 matches
Mail list logo