nicor88 commented on issue #1404: URL: https://github.com/apache/iceberg-python/issues/1404#issuecomment-2538292876
It looks like that the warehouse location of those S3 tables doesn't support List operations. I tried to point my local warehouse (using SQLite) to the warehouse location of an S3 table, just to validate if all could work, and I got this error: > # AWS Error UNKNOWN (HTTP status 405) during ListObjectsV2 operation: Unable to parse ExceptionName: MethodNotAllowed Message: The specified method is not allowed against this resource. The issue seems to come from pyarrow, that does this check: ``` if not overwrite and self.exists() is True: raise FileExistsError(f"Cannot create file, already exists: {self.location}") output_file = self._filesystem.open_output_stream(self._path, buffer_size=self._buffer_size) ``` The `self.exists()`, triggers under the hood a list operation, that it's not supported..... -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. To unsubscribe, e-mail: issues-unsubscr...@iceberg.apache.org For queries about this service, please contact Infrastructure at: us...@infra.apache.org --------------------------------------------------------------------- To unsubscribe, e-mail: issues-unsubscr...@iceberg.apache.org For additional commands, e-mail: issues-h...@iceberg.apache.org