[I] to_pandas() API which converts iceberg table scan to a pd.DataFrame will lost datetime data type and row order [iceberg-python]

[via GitHub]

zeddit opened a new issue, #132:
URL: https://github.com/apache/iceberg-python/issues/132

   ### Apache Iceberg version
   
   0.5.0 (latest release)
   
   ### Please describe the bug 🐞
   
   the code snippets look like below:
   ```
   table = catalog.load_table("default.sample_table")
   scan = table.scan()
   # for pyarrow
   patable = scan.to_arrow()
   # result shows
   ## pyarrow.Table
   ## date: date32[day]
   ## time: time64[us]
   
   # for pandas dataframe
   df = scan.to_pandas()
   df.info()
   ## date: object
   ## time: object
   ```
   
   and when creating table with `sort_order`, pyiceberg won't read them out 
while keeping the order as stated in table schema. 
   e.g. we sort the table with `sorted_by = ARRAY['date','time']`, however, the 
result df will have rows with early time behind the later one.
   
   


-- 
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.

To unsubscribe, e-mail: issues-unsubscr...@iceberg.apache.org.apache.org

For queries about this service, please contact Infrastructure at:
us...@infra.apache.org


---------------------------------------------------------------------
To unsubscribe, e-mail: issues-unsubscr...@iceberg.apache.org
For additional commands, e-mail: issues-h...@iceberg.apache.org