NikitaMatskevich opened a new issue, #2698:
URL: https://github.com/apache/iceberg-python/issues/2698

   ### Apache Iceberg version
   
   0.10.0 (latest release)
   
   ### Please describe the bug 🐞
   
   Starting from version 20, Pyarrow has support for Azure filesystems.
   
   ABFS URIs have this 
[format](https://learn.microsoft.com/en-us/azure/storage/blobs/data-lake-storage-introduction-abfs-uri):
 abfs[s]://<file_system>@<account_name>.dfs.core.windows.net/<path>/<file_name>
   
   But Pyarrow library expects the following path format for Azure: 
abfs[s]://<file_system>/<path>/<file_name>.
   
   As you see, the part "@<account_name>.<dfs|blob>.core.windows.net" prevents 
users to use pyarrow file io in Azure environment. This issue CAN be fixed in 
Pyiceberg by removing account_name part.
   
   The proposed [fix](https://github.com/apache/iceberg-python/pull/2683) is 
just to start a conversation around the issue. I am not 100% sure how and where 
this should be fixed.
   
   We know similar issues do not occur with Fsspec file io.
   
   ### Willingness to contribute
   
   - [x] I can contribute a fix for this bug independently
   - [ ] I would be willing to contribute a fix for this bug with guidance from 
the Iceberg community
   - [ ] I cannot contribute a fix for this bug at this time


-- 
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.

To unsubscribe, e-mail: [email protected]

For queries about this service, please contact Infrastructure at:
[email protected]


---------------------------------------------------------------------
To unsubscribe, e-mail: [email protected]
For additional commands, e-mail: [email protected]

Reply via email to