Re: [PR] Added support for Polars DataFrame and LazyFarame [iceberg-python]

2025-02-10 Thread via GitHub
kevinjqliu commented on code in PR #1614: URL: https://github.com/apache/iceberg-python/pull/1614#discussion_r1949930665 ## mkdocs/docs/api.md: ## @@ -1533,3 +1533,141 @@ df.show(2) (Showing first 2 rows) ``` + +### Polars + +PyIceberg interfaces closely with Polars Datafram

Re: [PR] Added support for Polars DataFrame and LazyFarame [iceberg-python]

2025-02-10 Thread via GitHub
kevinjqliu commented on PR #1614: URL: https://github.com/apache/iceberg-python/pull/1614#issuecomment-2649301216 can you rebase off main? looks like theres a conflict -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use t

Re: [PR] Added support for Polars DataFrame and LazyFarame [iceberg-python]

2025-02-10 Thread via GitHub
yigal-rozenberg commented on code in PR #1614: URL: https://github.com/apache/iceberg-python/pull/1614#discussion_r1949896700 ## mkdocs/docs/api.md: ## @@ -1533,3 +1533,111 @@ df.show(2) (Showing first 2 rows) ``` + +### Polars + +PyIceberg interfaces closely with Polars Dat

Re: [PR] Added support for Polars DataFrame and LazyFarame [iceberg-python]

2025-02-10 Thread via GitHub
yigal-rozenberg commented on code in PR #1614: URL: https://github.com/apache/iceberg-python/pull/1614#discussion_r1949880005 ## pyiceberg/table/__init__.py: ## @@ -1624,6 +1638,19 @@ def to_ray(self) -> ray.data.dataset.Dataset: return ray.data.from_arrow(self.to_arr

Re: [PR] Added support for Polars DataFrame and LazyFarame [iceberg-python]

2025-02-08 Thread via GitHub
kevinjqliu commented on code in PR #1614: URL: https://github.com/apache/iceberg-python/pull/1614#discussion_r1947932757 ## mkdocs/docs/api.md: ## @@ -1533,3 +1533,111 @@ df.show(2) (Showing first 2 rows) ``` + +### Polars + +PyIceberg interfaces closely with Polars Datafram

Re: [PR] Added support for Polars DataFrame and LazyFarame [iceberg-python]

2025-02-06 Thread via GitHub
yigal-rozenberg commented on PR #1614: URL: https://github.com/apache/iceberg-python/pull/1614#issuecomment-2641279700 love the idea! Will research in how to implement. In the mean time, I believe this specific change request is straight forward, and allow both DataFrame, and LazyFrame

Re: [PR] Added support for Polars DataFrame and LazyFarame [iceberg-python]

2025-02-06 Thread via GitHub
corleyma commented on PR #1614: URL: https://github.com/apache/iceberg-python/pull/1614#issuecomment-2641089912 Separately, rather than adding more library-specific conversion code, it might make sense for pyiceberg to start leveraging the [PyCapsule protocol](https://arrow.apache.org/docs/

Re: [PR] Added support for Polars DataFrame and LazyFarame [iceberg-python]

2025-02-06 Thread via GitHub
corleyma commented on PR #1614: URL: https://github.com/apache/iceberg-python/pull/1614#issuecomment-2641053258 > Polars 'scan_iceberg' uses PyIceberg to create the LazyFrame: > https://github.com/pola-rs/polars/blob/9359ed576d972dce257346fcd62c8857f3d23277/py-polars/polars/io/iceberg.py#