Re: [PR] feat: delete orphaned files [iceberg-python]

jayceslesar commented on code in PR #1958: URL: https://github.com/apache/iceberg-python/pull/1958#discussion_r2117819890 ## pyiceberg/table/inspect.py: ## @@ -678,6 +689,28 @@ def all_manifests(self) -> "pa.Table": ) return pa.concat_tables(manifests_by_snapsh

Re: [PR] feat: delete orphaned files [iceberg-python]

smaheshwar-pltr commented on code in PR #1958: URL: https://github.com/apache/iceberg-python/pull/1958#discussion_r2102924653 ## pyiceberg/table/inspect.py: ## @@ -678,6 +689,28 @@ def all_manifests(self) -> "pa.Table": ) return pa.concat_tables(manifests_by_sn

Re: [PR] feat: delete orphaned files [iceberg-python]

smaheshwar-pltr commented on code in PR #1958: URL: https://github.com/apache/iceberg-python/pull/1958#discussion_r2102918617 ## pyiceberg/table/inspect.py: ## @@ -678,6 +689,28 @@ def all_manifests(self) -> "pa.Table": ) return pa.concat_tables(manifests_by_sn

Re: [PR] feat: delete orphaned files [iceberg-python]

jayceslesar commented on code in PR #1958: URL: https://github.com/apache/iceberg-python/pull/1958#discussion_r2094180958 ## pyiceberg/table/__init__.py: ## @@ -1023,6 +1024,15 @@ def inspect(self) -> InspectTable: """ return InspectTable(self) +@property

Re: [PR] feat: delete orphaned files [iceberg-python]

jayceslesar commented on code in PR #1958: URL: https://github.com/apache/iceberg-python/pull/1958#discussion_r2094180938 ## pyiceberg/table/inspect.py: ## @@ -665,10 +666,16 @@ def data_files(self, snapshot_id: Optional[int] = None) -> "pa.Table": def delete_files(self, s

Re: [PR] feat: delete orphaned files [iceberg-python]

Fokko commented on code in PR #1958: URL: https://github.com/apache/iceberg-python/pull/1958#discussion_r2093644910 ## pyiceberg/table/inspect.py: ## @@ -657,3 +665,62 @@ def all_manifests(self) -> "pa.Table": lambda args: self._generate_manifests_table(*args), [(sn

Re: [PR] feat: delete orphaned files [iceberg-python]

Fokko commented on code in PR #1958: URL: https://github.com/apache/iceberg-python/pull/1958#discussion_r2093644910 ## pyiceberg/table/inspect.py: ## @@ -657,3 +665,62 @@ def all_manifests(self) -> "pa.Table": lambda args: self._generate_manifests_table(*args), [(sn

Re: [PR] feat: delete orphaned files [iceberg-python]

Fokko commented on code in PR #1958: URL: https://github.com/apache/iceberg-python/pull/1958#discussion_r2093643789 ## pyiceberg/table/inspect.py: ## @@ -678,6 +685,28 @@ def all_manifests(self) -> "pa.Table": ) return pa.concat_tables(manifests_by_snapshots)

Re: [PR] feat: delete orphaned files [iceberg-python]

Fokko commented on code in PR #1958: URL: https://github.com/apache/iceberg-python/pull/1958#discussion_r2093643789 ## pyiceberg/table/inspect.py: ## @@ -678,6 +685,28 @@ def all_manifests(self) -> "pa.Table": ) return pa.concat_tables(manifests_by_snapshots)

Re: [PR] feat: delete orphaned files [iceberg-python]

Fokko commented on PR #1958: URL: https://github.com/apache/iceberg-python/pull/1958#issuecomment-2876816044 > i like the idea of having all the table maintenance functions together, similar to delta table's [optimize](https://delta-io.github.io/delta-rs/api/delta_table/#deltalake.DeltaTabl

Re: [PR] feat: delete orphaned files [iceberg-python]

jayceslesar commented on code in PR #1958: URL: https://github.com/apache/iceberg-python/pull/1958#discussion_r2075436721 ## pyiceberg/table/__init__.py: ## @@ -1371,6 +1375,45 @@ def to_polars(self) -> pl.LazyFrame: return pl.scan_iceberg(self) +def delete_orph

Re: [PR] feat: delete orphaned files [iceberg-python]

jayceslesar commented on code in PR #1958: URL: https://github.com/apache/iceberg-python/pull/1958#discussion_r2075436721 ## pyiceberg/table/__init__.py: ## @@ -1371,6 +1375,45 @@ def to_polars(self) -> pl.LazyFrame: return pl.scan_iceberg(self) +def delete_orph

Re: [PR] feat: delete orphaned files [iceberg-python]

Fokko commented on code in PR #1958: URL: https://github.com/apache/iceberg-python/pull/1958#discussion_r2074880885 ## pyiceberg/table/__init__.py: ## @@ -1371,6 +1375,45 @@ def to_polars(self) -> pl.LazyFrame: return pl.scan_iceberg(self) +def delete_orphaned_f

Re: [PR] feat: delete orphaned files [iceberg-python]

jayceslesar commented on code in PR #1958: URL: https://github.com/apache/iceberg-python/pull/1958#discussion_r2072668166 ## pyiceberg/table/__init__.py: ## @@ -1371,6 +1376,28 @@ def to_polars(self) -> pl.LazyFrame: return pl.scan_iceberg(self) +def delete_orph

Re: [PR] feat: delete orphaned files [iceberg-python]

jayceslesar commented on code in PR #1958: URL: https://github.com/apache/iceberg-python/pull/1958#discussion_r2072667388 ## pyiceberg/table/inspect.py: ## @@ -657,3 +665,62 @@ def all_manifests(self) -> "pa.Table": lambda args: self._generate_manifests_table(*args)

Re: [PR] feat: delete orphaned files [iceberg-python]

jayceslesar commented on code in PR #1958: URL: https://github.com/apache/iceberg-python/pull/1958#discussion_r2072662780 ## pyiceberg/table/inspect.py: ## @@ -657,3 +665,62 @@ def all_manifests(self) -> "pa.Table": lambda args: self._generate_manifests_table(*args)

Re: [PR] feat: delete orphaned files [iceberg-python]

jayceslesar commented on code in PR #1958: URL: https://github.com/apache/iceberg-python/pull/1958#discussion_r2072661982 ## pyiceberg/table/__init__.py: ## @@ -1371,6 +1376,28 @@ def to_polars(self) -> pl.LazyFrame: return pl.scan_iceberg(self) +def delete_orph

Re: [PR] feat: delete orphaned files [iceberg-python]

jayceslesar commented on PR #1958: URL: https://github.com/apache/iceberg-python/pull/1958#issuecomment-2849311767 > a meta question, wydt of moving the orphan file function to its own file/namespace, similar to how to use `.inspect`. > > i like the idea of having all the table mainte

Re: [PR] feat: delete orphaned files [iceberg-python]

jayceslesar commented on PR #1958: URL: https://github.com/apache/iceberg-python/pull/1958#issuecomment-2849311662 > orphaned_files I think that makes sense -- would https://github.com/apache/iceberg-python/pull/1880 end up there too? Also ideally there is a CLI that exposes al

Re: [PR] feat: delete orphaned files [iceberg-python]

kevinjqliu commented on PR #1958: URL: https://github.com/apache/iceberg-python/pull/1958#issuecomment-2848894707 a meta question, wydt of moving the orphan file function to its own file/namespace, similar to how to use `.inspect`. i like the idea of having all the table maintenance

Re: [PR] feat: delete orphaned files [iceberg-python]

kevinjqliu commented on code in PR #1958: URL: https://github.com/apache/iceberg-python/pull/1958#discussion_r2072493113 ## pyiceberg/table/__init__.py: ## @@ -1371,6 +1376,28 @@ def to_polars(self) -> pl.LazyFrame: return pl.scan_iceberg(self) +def delete_orpha

Re: [PR] feat: delete orphaned files [iceberg-python]

kevinjqliu commented on code in PR #1958: URL: https://github.com/apache/iceberg-python/pull/1958#discussion_r2072491310 ## pyiceberg/table/__init__.py: ## @@ -1371,6 +1376,28 @@ def to_polars(self) -> pl.LazyFrame: return pl.scan_iceberg(self) +def delete_orpha

Re: [PR] feat: delete orphaned files [iceberg-python]

jayceslesar commented on code in PR #1958: URL: https://github.com/apache/iceberg-python/pull/1958#discussion_r2072452077 ## pyiceberg/table/__init__.py: ## @@ -1371,6 +1375,45 @@ def to_polars(self) -> pl.LazyFrame: return pl.scan_iceberg(self) +def delete_orph

Re: [PR] feat: delete orphaned files [iceberg-python]

jayceslesar commented on code in PR #1958: URL: https://github.com/apache/iceberg-python/pull/1958#discussion_r2072448127 ## pyiceberg/table/inspect.py: ## @@ -657,3 +665,37 @@ def all_manifests(self) -> "pa.Table": lambda args: self._generate_manifests_table(*args)

Re: [PR] feat: delete orphaned files [iceberg-python]

jayceslesar commented on code in PR #1958: URL: https://github.com/apache/iceberg-python/pull/1958#discussion_r2072448127 ## pyiceberg/table/inspect.py: ## @@ -657,3 +665,37 @@ def all_manifests(self) -> "pa.Table": lambda args: self._generate_manifests_table(*args)

Re: [PR] feat: delete orphaned files [iceberg-python]

jayceslesar commented on code in PR #1958: URL: https://github.com/apache/iceberg-python/pull/1958#discussion_r2072446025 ## pyiceberg/table/inspect.py: ## @@ -657,3 +665,37 @@ def all_manifests(self) -> "pa.Table": lambda args: self._generate_manifests_table(*args)

Re: [PR] feat: delete orphaned files [iceberg-python]

jayceslesar commented on code in PR #1958: URL: https://github.com/apache/iceberg-python/pull/1958#discussion_r2072446025 ## pyiceberg/table/inspect.py: ## @@ -657,3 +665,37 @@ def all_manifests(self) -> "pa.Table": lambda args: self._generate_manifests_table(*args)

Re: [PR] feat: delete orphaned files [iceberg-python]

jayceslesar commented on code in PR #1958: URL: https://github.com/apache/iceberg-python/pull/1958#discussion_r2072445679 ## pyiceberg/table/inspect.py: ## @@ -657,3 +665,37 @@ def all_manifests(self) -> "pa.Table": lambda args: self._generate_manifests_table(*args)

Re: [PR] feat: delete orphaned files [iceberg-python]

jayceslesar commented on code in PR #1958: URL: https://github.com/apache/iceberg-python/pull/1958#discussion_r2072442519 ## pyiceberg/table/inspect.py: ## @@ -657,3 +665,37 @@ def all_manifests(self) -> "pa.Table": lambda args: self._generate_manifests_table(*args)

Re: [PR] feat: delete orphaned files [iceberg-python]

jayceslesar commented on code in PR #1958: URL: https://github.com/apache/iceberg-python/pull/1958#discussion_r2072436797 ## pyiceberg/table/inspect.py: ## @@ -657,3 +665,37 @@ def all_manifests(self) -> "pa.Table": lambda args: self._generate_manifests_table(*args)

Re: [PR] feat: delete orphaned files [iceberg-python]

jayceslesar commented on code in PR #1958: URL: https://github.com/apache/iceberg-python/pull/1958#discussion_r2072436539 ## pyiceberg/table/inspect.py: ## @@ -657,3 +665,37 @@ def all_manifests(self) -> "pa.Table": lambda args: self._generate_manifests_table(*args)

Re: [PR] feat: delete orphaned files [iceberg-python]

smaheshwar-pltr commented on code in PR #1958: URL: https://github.com/apache/iceberg-python/pull/1958#discussion_r2072429901 ## pyiceberg/table/inspect.py: ## @@ -657,3 +665,37 @@ def all_manifests(self) -> "pa.Table": lambda args: self._generate_manifests_table(*a

Re: [PR] feat: delete orphaned files [iceberg-python]

jayceslesar commented on code in PR #1958: URL: https://github.com/apache/iceberg-python/pull/1958#discussion_r2072189663 ## pyiceberg/table/__init__.py: ## @@ -1371,6 +1375,45 @@ def to_polars(self) -> pl.LazyFrame: return pl.scan_iceberg(self) +def delete_orph

Re: [PR] feat: delete orphaned files [iceberg-python]

jayceslesar commented on code in PR #1958: URL: https://github.com/apache/iceberg-python/pull/1958#discussion_r2072162712 ## pyiceberg/table/__init__.py: ## @@ -1371,6 +1375,45 @@ def to_polars(self) -> pl.LazyFrame: return pl.scan_iceberg(self) +def delete_orph

Re: [PR] feat: delete orphaned files [iceberg-python]

jayceslesar commented on code in PR #1958: URL: https://github.com/apache/iceberg-python/pull/1958#discussion_r2072162570 ## pyiceberg/table/inspect.py: ## @@ -645,10 +645,10 @@ def data_files(self, snapshot_id: Optional[int] = None) -> "pa.Table": def delete_files(self, s

Re: [PR] feat: delete orphaned files [iceberg-python]

Fokko commented on code in PR #1958: URL: https://github.com/apache/iceberg-python/pull/1958#discussion_r2071124751 ## pyiceberg/table/__init__.py: ## @@ -1371,6 +1375,45 @@ def to_polars(self) -> pl.LazyFrame: return pl.scan_iceberg(self) +def delete_orphaned_f

Re: [PR] feat: delete orphaned files [iceberg-python]

jayceslesar commented on code in PR #1958: URL: https://github.com/apache/iceberg-python/pull/1958#discussion_r2067548613 ## pyiceberg/table/__init__.py: ## @@ -1371,6 +1375,45 @@ def to_polars(self) -> pl.LazyFrame: return pl.scan_iceberg(self) +def delete_orph

Re: [PR] feat: delete orphaned files [iceberg-python]

jayceslesar commented on code in PR #1958: URL: https://github.com/apache/iceberg-python/pull/1958#discussion_r2067540543 ## pyiceberg/table/inspect.py: ## @@ -645,10 +645,10 @@ def data_files(self, snapshot_id: Optional[int] = None) -> "pa.Table": def delete_files(self, s

Re: [PR] feat: delete orphaned files [iceberg-python]

jayceslesar commented on code in PR #1958: URL: https://github.com/apache/iceberg-python/pull/1958#discussion_r2067532346 ## pyiceberg/table/__init__.py: ## @@ -1371,6 +1375,45 @@ def to_polars(self) -> pl.LazyFrame: return pl.scan_iceberg(self) +def delete_orph