Re: [I] Support metadata compaction [iceberg-python]

ZENOTME commented on issue #270: URL: https://github.com/apache/iceberg-python/issues/270#issuecomment-2713768454 Hi, recently I'm trying to investigate support rewrite manifest in iceberg-rust. And the design of iceberg-rust is following iceberg-python, basically, but for now, rewrite mani

Re: [I] Support metadata compaction [iceberg-python]

kevinjqliu commented on issue #270: URL: https://github.com/apache/iceberg-python/issues/270#issuecomment-2715348757 feel free to help review the PR :) i haven't gotten to it yet -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHu

Re: [I] Support metadata compaction [iceberg-python]

ZENOTME commented on issue #270: URL: https://github.com/apache/iceberg-python/issues/270#issuecomment-2715188414 > Looks like @amitgilad3 has already started a PR for Rewrite manifests in https://github.com/apache/iceberg-python/pull/1661 Thanks @kevinjqliu! It's a good reference.

Re: [I] Support metadata compaction [iceberg-python]

kevinjqliu commented on issue #270: URL: https://github.com/apache/iceberg-python/issues/270#issuecomment-2715133884 Looks like @amitgilad3 has already started a PR for Rewrite manifests in #1661 -- This is an automated message from the Apache Git Service. To respond to the message,

Re: [I] Support metadata compaction [iceberg-python]

kevinjqliu commented on issue #270: URL: https://github.com/apache/iceberg-python/issues/270#issuecomment-2715129289 Hi @ZENOTME thanks for bringing this up. In pyiceberg, `_SnapshotProducer` defines the general structure of "things that are changed to produce a new snapshot." The `

Re: [I] Support metadata compaction [iceberg-python]

kevinjqliu commented on issue #270: URL: https://github.com/apache/iceberg-python/issues/270#issuecomment-2641296013 sure thing @amitgilad3 Based on the conversation above, it looks like some of the components are already implemented -- This is an automated message from the Apache Gi

Re: [I] Support metadata compaction [iceberg-python]

amitgilad3 commented on issue #270: URL: https://github.com/apache/iceberg-python/issues/270#issuecomment-2640349961 Hey, was wondering if there are no blockers if i can try to implement this?? -- This is an automated message from the Apache Git Service. To respond to the message, please l

Re: [I] Support metadata compaction [iceberg-python]

github-actions[bot] commented on issue #270: URL: https://github.com/apache/iceberg-python/issues/270#issuecomment-2336882412 This issue has been closed because it has not received any activity in the last 14 days since being marked as 'stale' -- This is an automated message from the Apac

Re: [I] Support metadata compaction [iceberg-python]

github-actions[bot] closed issue #270: Support metadata compaction URL: https://github.com/apache/iceberg-python/issues/270 -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. To u

Re: [I] Support metadata compaction [iceberg-python]

github-actions[bot] commented on issue #270: URL: https://github.com/apache/iceberg-python/issues/270#issuecomment-2309065680 This issue has been automatically marked as stale because it has been open for 180 days with no activity. It will be closed in next 14 days if no further activity oc

Re: [I] Support metadata compaction [iceberg-python]

HonahX commented on issue #270: URL: https://github.com/apache/iceberg-python/issues/270#issuecomment-1965963701 Based on offline discussion with @Fokko, I will focus on implementing the `MergeAppend` which supports these keys - `commit.manifest-merge.enabled` - `commit.manifest.min-co