Re: [PR] WIP: Incremental Append Scan [iceberg-python]

2024-03-22 Thread via GitHub
hililiwei commented on PR #533: URL: https://github.com/apache/iceberg-python/pull/533#issuecomment-2014591526 In the latest code commit, I tinkered with the class inheritance by introducing a new base class, BaseIncrementalScan, which inherits from TableScan. I also pushed the snapshot_id

Re: [PR] WIP: Incremental Append Scan [iceberg-python]

2024-03-19 Thread via GitHub
hililiwei commented on code in PR #533: URL: https://github.com/apache/iceberg-python/pull/533#discussion_r1530464016 ## pyiceberg/table/__init__.py: ## @@ -1578,6 +1595,120 @@ def to_ray(self) -> ray.data.dataset.Dataset: return ray.data.from_arrow(self.to_arrow())