Re: [PR] Add as_arrow() to Schema class [iceberg-python]

2024-03-19 Thread via GitHub
Fokko commented on PR #532: URL: https://github.com/apache/iceberg-python/pull/532#issuecomment-2006356086 Thanks @ndrluis for adding this, and @kevinjqliu for joining the conversation 👍 -- This is an automated message from the Apache Git Service. To respond to the message, please log on

Re: [PR] Add as_arrow() to Schema class [iceberg-python]

2024-03-19 Thread via GitHub
Fokko merged PR #532: URL: https://github.com/apache/iceberg-python/pull/532 -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. To unsubscribe, e-mail: issues-unsubscr...@iceberg.

Re: [PR] Add as_arrow() to Schema class [iceberg-python]

2024-03-18 Thread via GitHub
kevinjqliu commented on PR #532: URL: https://github.com/apache/iceberg-python/pull/532#issuecomment-2005060452 (reposting from slack) This is great. Exposing the Iceberg Table's schema as pyarrow schema will also solve the problem I was having here https://github.com/apache/iceb

Re: [PR] Add as_arrow() to Schema class [iceberg-python]

2024-03-18 Thread via GitHub
Fokko commented on code in PR #532: URL: https://github.com/apache/iceberg-python/pull/532#discussion_r1529234952 ## pyiceberg/schema.py: ## @@ -180,6 +182,12 @@ def as_struct(self) -> StructType: """Return the schema as a struct.""" return StructType(*self.fie

[PR] Add as_arrow() to Schema class [iceberg-python]

2024-03-18 Thread via GitHub
ndrluis opened a new pull request, #532: URL: https://github.com/apache/iceberg-python/pull/532 Use case ``` import pyarrow as pa import pandas as pd table = catalog.load_table('some_schema.table_name') schema = table.schema().as_arrow() data = { 'id_job':