ming12713 opened a new issue, #13788: URL: https://github.com/apache/iceberg/issues/13788
### Apache Iceberg version 1.9.2 (latest release) ### Query engine Spark ### Please describe the bug 🐞 Hello, The native RestCatalog does not support deleting orphan files when used with Spark. I've referenced the following GitHub links for context: - https://github.com/apache/iceberg/pull/7914 - https://github.com/apache/iceberg/issues/11541 My Spark configuration is as follows: spark version: 3.5.6 ```bash bin/spark-sql \ --packages "org.projectnessie.nessie-integrations:nessie-spark-extensions-3.5_2.12:0.104.3,org.apache.hadoop:hadoop-aws:3.4.0,org.apache.hadoop:hadoop-common:3.4.0,org.apache.iceberg:iceberg-spark-runtime-3.5_2.12:1.9.0,com.amazonaws:aws-java-sdk-bundle:1.12.745" \ --conf spark.sql.extensions=org.projectnessie.spark.extensions.NessieSparkSessionExtensions,org.apache.iceberg.spark.extensions.IcebergSparkSessionExtensions \ --conf spark.sql.catalog.nessie=org.apache.iceberg.spark.SparkCatalog \ --conf spark.sql.catalog.nessie.type=rest \ --conf spark.sql.catalog.nessie.uri=http://10.0.160.110:31107/iceberg/main \ --conf spark.sql.catalog.nessie.s3.delete-batch-size=1 \ --conf spark.sql.catalog.nessie.s3.path-style-access=true \ --conf spark.sql.catalog.nessie.warehouse=s3://warehouse/ \ --conf spark.sql.catalog.nessie.s3.endpoint=http://xxxxxxx \ --conf spark.sql.catalog.nessie.s3.endpoint.region=cn-east-1 \ --conf spark.hadoop.fs.s3.impl=org.apache.hadoop.fs.s3a.S3AFileSystem \ --conf spark.hadoop.fs.AbstractFileSystem.s3.impl=org.apache.hadoop.fs.s3a.S3A \ --conf spark.hadoop.fs.s3a.access.key=xxxxxxx \ --conf spark.hadoop.fs.s3a.secret.key=xxxxxx \ --conf spark.hadoop.fs.s3a.path.style.access=true \ --conf spark.hadoop.fs.s3a.endpoint=http://xxxxxx \ --conf spark.hadoop.fs.s3a.endpoint.region=cn-east-1 \ --conf spark.hadoop.fs.s3a.metrics.enable=false \ --conf spark.sql.catalogImplementation=in-memory ``` ```bash CALL nessie.system.remove_orphan_files(table => 'nessie.demo.dim_map_prod', older_than => TIMESTAMP '2025-08-09T00:00:00.000Z', dry_run => false); ``` The following error occurred: ```bash spark-sql (demo)> CALL nessie.system.remove_orphan_files(table => 'nessie.demo.dim_map_prod',older_than => TIMESTAMP '2025-08-09T00:00:00.000Z',dry_run => false); 25/08/12 11:15:06 WARN S3FileIO: Encountered failure when deleting batch java.lang.IllegalArgumentException: Invalid S3 URI: 'http://lxx.xxxx.com/warehouse?delete' at org.apache.iceberg.rest.ErrorHandlers$DefaultErrorHandler.accept(ErrorHandlers.java:230) at org.apache.iceberg.rest.ErrorHandlers$DefaultErrorHandler.accept(ErrorHandlers.java:212) at org.apache.iceberg.rest.HTTPClient.throwFailure(HTTPClient.java:215) at org.apache.iceberg.rest.HTTPClient.execute(HTTPClient.java:299) at org.apache.iceberg.rest.BaseHTTPClient.post(BaseHTTPClient.java:100) at org.apache.iceberg.aws.s3.signer.S3V4RestSignerClient.sign(S3V4RestSignerClient.java:256) at software.amazon.awssdk.core.internal.http.pipeline.stages.SigningStage.lambda$signRequest$4(SigningStage.java:154) at software.amazon.awssdk.core.internal.util.MetricUtils.measureDuration(MetricUtils.java:63) at software.amazon.awssdk.core.internal.http.pipeline.stages.SigningStage.signRequest(SigningStage.java:153) at software.amazon.awssdk.core.internal.http.pipeline.stages.SigningStage.execute(SigningStage.java:72) at software.amazon.awssdk.core.internal.http.pipeline.stages.SigningStage.execute(SigningStage.java:50) at software.amazon.awssdk.core.internal.http.pipeline.RequestPipelineBuilder$ComposingRequestPipelineStage.execute(RequestPipelineBuilder.java:206) at software.amazon.awssdk.core.internal.http.pipeline.RequestPipelineBuilder$ComposingRequestPipelineStage.execute(RequestPipelineBuilder.java:206) at software.amazon.awssdk.core.internal.http.pipeline.RequestPipelineBuilder$ComposingRequestPipelineStage.execute(RequestPipelineBuilder.java:206) at software.amazon.awssdk.core.internal.http.pipeline.RequestPipelineBuilder$ComposingRequestPipelineStage.execute(RequestPipelineBuilder.java:206) at software.amazon.awssdk.core.internal.http.pipeline.RequestPipelineBuilder$ComposingRequestPipelineStage.execute(RequestPipelineBuilder.java:206) at software.amazon.awssdk.core.internal.http.pipeline.stages.ApiCallAttemptTimeoutTrackingStage.execute(ApiCallAttemptTimeoutTrackingStage.java:74) at software.amazon.awssdk.core.internal.http.pipeline.stages.ApiCallAttemptTimeoutTrackingStage.execute(ApiCallAttemptTimeoutTrackingStage.java:43) at software.amazon.awssdk.core.internal.http.pipeline.stages.TimeoutExceptionHandlingStage.execute(TimeoutExceptionHandlingStage.java:79) at software.amazon.awssdk.core.internal.http.pipeline.stages.TimeoutExceptionHandlingStage.execute(TimeoutExceptionHandlingStage.java:41) at software.amazon.awssdk.core.internal.http.pipeline.stages.ApiCallAttemptMetricCollectionStage.execute(ApiCallAttemptMetricCollectionStage.java:55) at software.amazon.awssdk.core.internal.http.pipeline.stages.ApiCallAttemptMetricCollectionStage.execute(ApiCallAttemptMetricCollectionStage.java:39) at software.amazon.awssdk.core.internal.http.pipeline.stages.RetryableStage2.executeRequest(RetryableStage2.java:93) at software.amazon.awssdk.core.internal.http.pipeline.stages.RetryableStage2.execute(RetryableStage2.java:56) at software.amazon.awssdk.core.internal.http.pipeline.stages.RetryableStage2.execute(RetryableStage2.java:36) at software.amazon.awssdk.core.internal.http.pipeline.RequestPipelineBuilder$ComposingRequestPipelineStage.execute(RequestPipelineBuilder.java:206) at software.amazon.awssdk.core.internal.http.StreamManagingStage.execute(StreamManagingStage.java:53) at software.amazon.awssdk.core.internal.http.StreamManagingStage.execute(StreamManagingStage.java:35) at software.amazon.awssdk.core.internal.http.pipeline.stages.ApiCallTimeoutTrackingStage.executeWithTimer(ApiCallTimeoutTrackingStage.java:82) at software.amazon.awssdk.core.internal.http.pipeline.stages.ApiCallTimeoutTrackingStage.execute(ApiCallTimeoutTrackingStage.java:62) at software.amazon.awssdk.core.internal.http.pipeline.stages.ApiCallTimeoutTrackingStage.execute(ApiCallTimeoutTrackingStage.java:43) at software.amazon.awssdk.core.internal.http.pipeline.stages.ApiCallMetricCollectionStage.execute(ApiCallMetricCollectionStage.java:50) at software.amazon.awssdk.core.internal.http.pipeline.stages.ApiCallMetricCollectionStage.execute(ApiCallMetricCollectionStage.java:32) at software.amazon.awssdk.core.internal.http.pipeline.RequestPipelineBuilder$ComposingRequestPipelineStage.execute(RequestPipelineBuilder.java:206) at software.amazon.awssdk.core.internal.http.pipeline.RequestPipelineBuilder$ComposingRequestPipelineStage.execute(RequestPipelineBuilder.java:206) at software.amazon.awssdk.core.internal.http.pipeline.stages.ExecutionFailureExceptionReportingStage.execute(ExecutionFailureExceptionReportingStage.java:37) at software.amazon.awssdk.core.internal.http.pipeline.stages.ExecutionFailureExceptionReportingStage.execute(ExecutionFailureExceptionReportingStage.java:26) at software.amazon.awssdk.core.internal.http.AmazonSyncHttpClient$RequestExecutionBuilderImpl.execute(AmazonSyncHttpClient.java:210) at software.amazon.awssdk.core.internal.handler.BaseSyncClientHandler.invoke(BaseSyncClientHandler.java:103) at software.amazon.awssdk.core.internal.handler.BaseSyncClientHandler.doExecute(BaseSyncClientHandler.java:173) at software.amazon.awssdk.core.internal.handler.BaseSyncClientHandler.lambda$execute$1(BaseSyncClientHandler.java:80) at software.amazon.awssdk.core.internal.handler.BaseSyncClientHandler.measureApiCallSuccess(BaseSyncClientHandler.java:182) at software.amazon.awssdk.core.internal.handler.BaseSyncClientHandler.execute(BaseSyncClientHandler.java:74) at software.amazon.awssdk.core.client.handler.SdkSyncClientHandler.execute(SdkSyncClientHandler.java:45) at software.amazon.awssdk.awscore.client.handler.AwsSyncClientHandler.execute(AwsSyncClientHandler.java:53) at software.amazon.awssdk.services.s3.DefaultS3Client.deleteObjects(DefaultS3Client.java:3626) at org.apache.iceberg.aws.s3.S3FileIO.deleteBatch(S3FileIO.java:333) at org.apache.iceberg.aws.s3.S3FileIO.lambda$deleteFiles$3(S3FileIO.java:271) at java.base/java.util.concurrent.FutureTask.run(FutureTask.java:264) at java.base/java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1136) at java.base/java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:635) at java.base/java.lang.Thread.run(Thread.java:840) 25/08/12 11:15:06 WARN S3FileIO: Failed to delete object at path s3://warehouse/demo/dim_map_prod_7de53d0a-c474-44cc-a3d6-56b457c7cc32/metadata/00000-b5049807-1ada-46b0-9f65-d893d4cfb9f0.metadata.json 25/08/12 11:15:06 WARN S3FileIO: Failed to delete object at path s3://warehouse/demo/dim_map_prod_7de53d0a-c474-44cc-a3d6-56b457c7cc32/metadata/00000-fea4c313-f67e-4a79-aa6b-fdd79d553f5c.metadata.json 25/08/12 11:15:06 WARN S3FileIO: Failed to delete object at path s3://warehouse/demo/dim_map_prod_7de53d0a-c474-44cc-a3d6-56b457c7cc32/metadata/00000-b10b568d-d721-4c77-84aa-37d9c8ed0139.metadata.json 25/08/12 11:15:06 WARN S3FileIO: Failed to delete object at path s3://warehouse/demo/dim_map_prod_7de53d0a-c474-44cc-a3d6-56b457c7cc32/metadata/00000-04522b52-b80a-41d7-af03-54495c52f2f8.metadata.json 25/08/12 11:15:06 WARN S3FileIO: Failed to delete object at path s3://warehouse/demo/dim_map_prod_7de53d0a-c474-44cc-a3d6-56b457c7cc32/metadata/00000-bad68433-f065-4032-b60e-2826186339f0.metadata.json 25/08/12 11:15:06 WARN S3FileIO: Failed to delete object at path s3://warehouse/demo/dim_map_prod_7de53d0a-c474-44cc-a3d6-56b457c7cc32/metadata/00000-97d508e8-2a95-4ba2-90ef-ea8ddded01a5.metadata.json 25/08/12 11:15:06 WARN S3FileIO: Failed to delete object at path s3://warehouse/demo/dim_map_prod_7de53d0a-c474-44cc-a3d6-56b457c7cc32/metadata/00000-f5356bc8-e4dd-4356-9cef-9ad6b7de6e51.metadata.json 25/08/12 11:15:06 WARN S3FileIO: Failed to delete object at path s3://warehouse/demo/dim_map_prod_7de53d0a-c474-44cc-a3d6-56b457c7cc32/metadata/00000-04d944ab-9878-49dc-b9ca-ebc08d54f957.metadata.json 25/08/12 11:15:06 WARN S3FileIO: Failed to delete object at path s3://warehouse/demo/dim_map_prod_7de53d0a-c474-44cc-a3d6-56b457c7cc32/metadata/00000-8c515f02-e051-48ea-afa4-e1fff220fcbf.metadata.json 25/08/12 11:15:06 WARN S3FileIO: Failed to delete object at path s3://warehouse/demo/dim_map_prod_7de53d0a-c474-44cc-a3d6-56b457c7cc32/metadata/00000-855b3999-9665-43a2-8a8c-171c8841e5a7.metadata.json 25/08/12 11:15:06 WARN S3FileIO: Failed to delete object at path s3://warehouse/demo/dim_map_prod_7de53d0a-c474-44cc-a3d6-56b457c7cc32/metadata/00000-222ad0ed-3dc9-48a6-b236-ac91eadae51b.metadata.json 25/08/12 11:15:06 WARN S3FileIO: Failed to delete object at path s3://warehouse/demo/dim_map_prod_7de53d0a-c474-44cc-a3d6-56b457c7cc32/metadata/00000-99ad973a-b0ee-4a06-bde8-b7d85e387ea3.metadata.json 25/08/12 11:15:06 WARN S3FileIO: Failed to delete object at path s3://warehouse/demo/dim_map_prod_7de53d0a-c474-44cc-a3d6-56b457c7cc32/metadata/00000-8530cfcf-7d60-40d2-9cd3-ec2b6c872018.metadata.json 25/08/12 11:15:06 WARN S3FileIO: Failed to delete object at path s3://warehouse/demo/dim_map_prod_7de53d0a-c474-44cc-a3d6-56b457c7cc32/metadata/00000-a7523e9e-32d5-447c-990f-7e2c90949dd8.metadata.json 25/08/12 11:15:06 WARN S3FileIO: Failed to delete object at path s3://warehouse/demo/dim_map_prod_7de53d0a-c474-44cc-a3d6-56b457c7cc32/metadata/00000-d6da2f02-cc7f-4804-9f27-027cbbfc0717.metadata.json 25/08/12 11:15:06 WARN S3FileIO: Failed to delete object at path s3://warehouse/demo/dim_map_prod_7de53d0a-c474-44cc-a3d6-56b457c7cc32/metadata/00000-152a6e7e-83f7-4edb-9e98-1dd599e6843c.metadata.json 25/08/12 11:15:06 WARN S3FileIO: Failed to delete object at path s3://warehouse/demo/dim_map_prod_7de53d0a-c474-44cc-a3d6-56b457c7cc32/metadata/00000-f71594b5-29ab-4896-8d09-bd02736adca4.metadata.json 25/08/12 11:15:06 WARN S3FileIO: Failed to delete object at path s3://warehouse/demo/dim_map_prod_7de53d0a-c474-44cc-a3d6-56b457c7cc32/metadata/00000-8726d25b-22b3-4898-89e1-6cbab980ef9c.metadata.json 25/08/12 11:15:06 WARN S3FileIO: Failed to delete object at path s3://warehouse/demo/dim_map_prod_7de53d0a-c474-44cc-a3d6-56b457c7cc32/metadata/00000-1901ec7c-bf6e-4c6f-b1e2-feb2a48f08d7.metadata.json 25/08/12 11:15:06 WARN S3FileIO: Failed to delete object at path s3://warehouse/demo/dim_map_prod_7de53d0a-c474-44cc-a3d6-56b457c7cc32/metadata/00000-c9f29468-a0d7-4be6-b8d6-f89b2b1e7b4b.metadata.json 25/08/12 11:15:06 WARN S3FileIO: Failed to delete object at path s3://warehouse/demo/dim_map_prod_7de53d0a-c474-44cc-a3d6-56b457c7cc32/metadata/00000-585290f6-bf11-4c9b-8cae-d03b06ec136f.metadata.json 25/08/12 11:15:06 WARN S3FileIO: Failed to delete object at path s3://warehouse/demo/dim_map_prod_7de53d0a-c474-44cc-a3d6-56b457c7cc32/metadata/00000-d4668ebd-62e4-40b6-9109-cfe7e9c67695.metadata.json 25/08/12 11:15:06 WARN S3FileIO: Failed to delete object at path s3://warehouse/demo/dim_map_prod_7de53d0a-c474-44cc-a3d6-56b457c7cc32/metadata/00000-7124c678-5468-434e-a5e1-af6d4810cc64.metadata.json 25/08/12 11:15:06 WARN S3FileIO: Failed to delete object at path s3://warehouse/demo/dim_map_prod_7de53d0a-c474-44cc-a3d6-56b457c7cc32/metadata/00000-8c9c8695-f674-4262-857f-fb35346abce5.metadata.json 25/08/12 11:15:06 WARN S3FileIO: Failed to delete object at path s3://warehouse/demo/dim_map_prod_7de53d0a-c474-44cc-a3d6-56b457c7cc32/metadata/00000-8403b0e1-ae97-4f36-95f5-5b0259872b14.metadata.json 25/08/12 11:15:06 WARN S3FileIO: Failed to delete object at path s3://warehouse/demo/dim_map_prod_7de53d0a-c474-44cc-a3d6-56b457c7cc32/metadata/00000-f10cc13f-c42b-4dc3-abb7-206b4a5de2e2.metadata.json 25/08/12 11:15:06 WARN S3FileIO: Failed to delete object at path s3://warehouse/demo/dim_map_prod_7de53d0a-c474-44cc-a3d6-56b457c7cc32/metadata/00000-a95bff8e-c456-4c73-8bb5-e59031f37305.metadata.json 25/08/12 11:15:06 WARN S3FileIO: Failed to delete object at path s3://warehouse/demo/dim_map_prod_7de53d0a-c474-44cc-a3d6-56b457c7cc32/metadata/00000-63bdb100-e675-4668-a6ee-94e88524b254.metadata.json 25/08/12 11:15:06 WARN S3FileIO: Failed to delete object at path s3://warehouse/demo/dim_map_prod_7de53d0a-c474-44cc-a3d6-56b457c7cc32/metadata/00000-0adfa00c-5b1d-450a-951f-66c9bae2c00b.metadata.json 25/08/12 11:15:06 WARN S3FileIO: Failed to delete object at path s3://warehouse/demo/dim_map_prod_7de53d0a-c474-44cc-a3d6-56b457c7cc32/metadata/00000-13da01e0-9285-4f5f-81cd-c3bdb6fc5ea4.metadata.json 25/08/12 11:15:06 WARN S3FileIO: Failed to delete object at path s3://warehouse/demo/dim_map_prod_7de53d0a-c474-44cc-a3d6-56b457c7cc32/metadata/00000-7a204376-4814-40af-8f5c-b5ae29009b83.metadata.json 25/08/12 11:15:06 WARN S3FileIO: Failed to delete object at path s3://warehouse/demo/dim_map_prod_7de53d0a-c474-44cc-a3d6-56b457c7cc32/metadata/00000-aa53c57d-282d-4fb3-a4b3-31927af43a1f.metadata.json 25/08/12 11:15:06 WARN S3FileIO: Failed to delete object at path s3://warehouse/demo/dim_map_prod_7de53d0a-c474-44cc-a3d6-56b457c7cc32/metadata/00000-a208e285-9e69-4729-bdf7-37dfbdf033cf.metadata.json 25/08/12 11:15:06 WARN S3FileIO: Failed to delete object at path s3://warehouse/demo/dim_map_prod_7de53d0a-c474-44cc-a3d6-56b457c7cc32/metadata/00000-0e15043b-5704-4dcb-82da-90b5b0a0b16d.metadata.json 25/08/12 11:15:06 WARN S3FileIO: Failed to delete object at path s3://warehouse/demo/dim_map_prod_7de53d0a-c474-44cc-a3d6-56b457c7cc32/metadata/00000-779c50a0-35a1-49cb-b008-26ae8cf150cd.metadata.json 25/08/12 11:15:06 WARN S3FileIO: Failed to delete object at path s3://warehouse/demo/dim_map_prod_7de53d0a-c474-44cc-a3d6-56b457c7cc32/metadata/00000-01874781-20a6-4f28-bc60-85bf0be49f91.metadata.json 25/08/12 11:15:06 WARN S3FileIO: Failed to delete object at path s3://warehouse/demo/dim_map_prod_7de53d0a-c474-44cc-a3d6-56b457c7cc32/metadata/00000-b20b3b1f-adb6-4a51-a11b-0130aedbd1fe.metadata.json 25/08/12 11:15:06 WARN S3FileIO: Failed to delete object at path s3://warehouse/demo/dim_map_prod_7de53d0a-c474-44cc-a3d6-56b457c7cc32/metadata/00000-56a75f48-7d0a-42f6-b5ec-06c55bb9e08b.metadata.json 25/08/12 11:15:06 WARN S3FileIO: Failed to delete object at path s3://warehouse/demo/dim_map_prod_7de53d0a-c474-44cc-a3d6-56b457c7cc32/metadata/00000-d24b2413-e5b0-40ed-a898-a49b0418a75f.metadata.json 25/08/12 11:15:06 WARN S3FileIO: Failed to delete object at path s3://warehouse/demo/dim_map_prod_7de53d0a-c474-44cc-a3d6-56b457c7cc32/metadata/00000-416626fa-1cc6-4bee-ab21-23fc8d4a7595.metadata.json 25/08/12 11:15:06 WARN S3FileIO: Failed to delete object at path s3://warehouse/demo/dim_map_prod_7de53d0a-c474-44cc-a3d6-56b457c7cc32/metadata/00000-3a71fdf1-8053-422b-b74b-f979d088aad6.metadata.json 25/08/12 11:15:06 WARN S3FileIO: Failed to delete object at path s3://warehouse/demo/dim_map_prod_7de53d0a-c474-44cc-a3d6-56b457c7cc32/metadata/00000-72c58aa6-f90a-4e80-8f87-d300d7f3b3f8.metadata.json 25/08/12 11:15:06 WARN S3FileIO: Failed to delete object at path s3://warehouse/demo/dim_map_prod_7de53d0a-c474-44cc-a3d6-56b457c7cc32/metadata/00000-61289d39-819f-406d-a21c-cfead17d72d2.metadata.json 25/08/12 11:15:06 WARN S3FileIO: Failed to delete object at path s3://warehouse/demo/dim_map_prod_7de53d0a-c474-44cc-a3d6-56b457c7cc32/metadata/00000-9782eb49-70a2-4987-9591-e374efe98a89.metadata.json 25/08/12 11:15:06 WARN S3FileIO: Failed to delete object at path s3://warehouse/demo/dim_map_prod_7de53d0a-c474-44cc-a3d6-56b457c7cc32/metadata/00000-2ccb8ec4-b76b-4265-b687-cc84c1997f90.metadata.json 25/08/12 11:15:06 WARN S3FileIO: Failed to delete object at path s3://warehouse/demo/dim_map_prod_7de53d0a-c474-44cc-a3d6-56b457c7cc32/metadata/00000-3d3dd8b0-32ce-43a6-b34b-db3614d42a17.metadata.json 25/08/12 11:15:06 WARN S3FileIO: Failed to delete object at path s3://warehouse/demo/dim_map_prod_7de53d0a-c474-44cc-a3d6-56b457c7cc32/metadata/00000-1259cbd2-cba6-427f-b371-9665a6b15656.metadata.json 25/08/12 11:15:06 WARN S3FileIO: Failed to delete object at path s3://warehouse/demo/dim_map_prod_7de53d0a-c474-44cc-a3d6-56b457c7cc32/metadata/00000-3a55fcd0-4cec-4fc7-b909-15f69d25b4d7.metadata.json 25/08/12 11:15:06 WARN S3FileIO: Failed to delete object at path s3://warehouse/demo/dim_map_prod_7de53d0a-c474-44cc-a3d6-56b457c7cc32/metadata/00000-aaf609a0-1f42-4c6a-9355-4eb4290d17dc.metadata.json 25/08/12 11:15:06 WARN S3FileIO: Failed to delete object at path s3://warehouse/demo/dim_map_prod_7de53d0a-c474-44cc-a3d6-56b457c7cc32/metadata/00000-c93a4fbc-9f17-4a2f-9f2a-fa98c661c81c.metadata.json 25/08/12 11:15:06 WARN S3FileIO: Failed to delete object at path s3://warehouse/demo/dim_map_prod_7de53d0a-c474-44cc-a3d6-56b457c7cc32/metadata/00000-20e5c53a-b120-4b2b-898c-92a418b5c510.metadata.json 25/08/12 11:15:06 WARN S3FileIO: Failed to delete object at path s3://warehouse/demo/dim_map_prod_7de53d0a-c474-44cc-a3d6-56b457c7cc32/metadata/00000-94daa6dd-20a8-45e5-a5d4-3703b1ead849.metadata.json 25/08/12 11:15:06 WARN S3FileIO: Failed to delete object at path s3://warehouse/demo/dim_map_prod_7de53d0a-c474-44cc-a3d6-56b457c7cc32/metadata/00000-2634945f-98ff-4008-a307-ce26986369bc.metadata.json 25/08/12 11:15:06 WARN S3FileIO: Failed to delete object at path s3://warehouse/demo/dim_map_prod_7de53d0a-c474-44cc-a3d6-56b457c7cc32/metadata/00000-ca42025e-f2a3-478f-ae58-6f3f1e3b8b84.metadata.json 25/08/12 11:15:06 WARN S3FileIO: Failed to delete object at path s3://warehouse/demo/dim_map_prod_7de53d0a-c474-44cc-a3d6-56b457c7cc32/metadata/00000-f635c8ca-0553-41e9-b56e-f2a79900010b.metadata.json 25/08/12 11:15:06 WARN S3FileIO: Failed to delete object at path s3://warehouse/demo/dim_map_prod_7de53d0a-c474-44cc-a3d6-56b457c7cc32/metadata/00000-c426d875-272e-48b2-a130-9b29a3ac0e60.metadata.json 25/08/12 11:15:06 WARN S3FileIO: Failed to delete object at path s3://warehouse/demo/dim_map_prod_7de53d0a-c474-44cc-a3d6-56b457c7cc32/metadata/00000-06163fa0-9026-4c09-8c52-7064b8ec1939.metadata.json 25/08/12 11:15:06 WARN S3FileIO: Failed to delete object at path s3://warehouse/demo/dim_map_prod_7de53d0a-c474-44cc-a3d6-56b457c7cc32/metadata/00000-c988948b-9c33-43c1-800a-651355291ae2.metadata.json 25/08/12 11:15:06 WARN S3FileIO: Failed to delete object at path s3://warehouse/demo/dim_map_prod_7de53d0a-c474-44cc-a3d6-56b457c7cc32/metadata/00000-4c6a6f63-d976-4e26-bc42-b61b4cec5093.metadata.json 25/08/12 11:15:06 WARN S3FileIO: Failed to delete object at path s3://warehouse/demo/dim_map_prod_7de53d0a-c474-44cc-a3d6-56b457c7cc32/metadata/00000-3c91c5bf-de7d-48fd-9f37-bfca8ecce33a.metadata.json 25/08/12 11:15:06 WARN S3FileIO: Failed to delete object at path s3://warehouse/demo/dim_map_prod_7de53d0a-c474-44cc-a3d6-56b457c7cc32/metadata/00000-bf8d437a-487d-4fa1-a301-7b57ce0908bf.metadata.json 25/08/12 11:15:06 WARN S3FileIO: Failed to delete object at path s3://warehouse/demo/dim_map_prod_7de53d0a-c474-44cc-a3d6-56b457c7cc32/metadata/00000-4b12898b-02f5-42b2-a65c-fd6fb9330a9d.metadata.json 25/08/12 11:15:06 WARN S3FileIO: Failed to delete object at path s3://warehouse/demo/dim_map_prod_7de53d0a-c474-44cc-a3d6-56b457c7cc32/metadata/00000-fdf86902-03ff-4844-80d0-7767b41f3c08.metadata.json 25/08/12 11:15:06 WARN S3FileIO: Failed to delete object at path s3://warehouse/demo/dim_map_prod_7de53d0a-c474-44cc-a3d6-56b457c7cc32/metadata/00000-3c83c45d-b950-410c-9961-202abfa47cde.metadata.json 25/08/12 11:15:06 WARN S3FileIO: Failed to delete object at path s3://warehouse/demo/dim_map_prod_7de53d0a-c474-44cc-a3d6-56b457c7cc32/metadata/00000-287fa81e-6719-447b-820a-2a196518e9a9.metadata.json 25/08/12 11:15:06 WARN S3FileIO: Failed to delete object at path s3://warehouse/demo/dim_map_prod_7de53d0a-c474-44cc-a3d6-56b457c7cc32/metadata/00000-f1ee00cb-ffdb-4a59-96f9-e6da251566f9.metadata.json 25/08/12 11:15:06 WARN DeleteOrphanFilesSparkAction: Deleted only 0 of 66 files using bulk deletes s3://warehouse/demo/dim_map_prod_7de53d0a-c474-44cc-a3d6-56b457c7cc32/metadata/00000-01874781-20a6-4f28-bc60-85bf0be49f91.metadata.json s3://warehouse/demo/dim_map_prod_7de53d0a-c474-44cc-a3d6-56b457c7cc32/metadata/00000-04522b52-b80a-41d7-af03-54495c52f2f8.metadata.json s3://warehouse/demo/dim_map_prod_7de53d0a-c474-44cc-a3d6-56b457c7cc32/metadata/00000-04d944ab-9878-49dc-b9ca-ebc08d54f957.metadata.json s3://warehouse/demo/dim_map_prod_7de53d0a-c474-44cc-a3d6-56b457c7cc32/metadata/00000-06163fa0-9026-4c09-8c52-7064b8ec1939.metadata.json s3://warehouse/demo/dim_map_prod_7de53d0a-c474-44cc-a3d6-56b457c7cc32/metadata/00000-0adfa00c-5b1d-450a-951f-66c9bae2c00b.metadata.json s3://warehouse/demo/dim_map_prod_7de53d0a-c474-44cc-a3d6-56b457c7cc32/metadata/00000-0e15043b-5704-4dcb-82da-90b5b0a0b16d.metadata.json s3://warehouse/demo/dim_map_prod_7de53d0a-c474-44cc-a3d6-56b457c7cc32/metadata/00000-1259cbd2-cba6-427f-b371-9665a6b15656.metadata.json s3://warehouse/demo/dim_map_prod_7de53d0a-c474-44cc-a3d6-56b457c7cc32/metadata/00000-13da01e0-9285-4f5f-81cd-c3bdb6fc5ea4.metadata.json s3://warehouse/demo/dim_map_prod_7de53d0a-c474-44cc-a3d6-56b457c7cc32/metadata/00000-152a6e7e-83f7-4edb-9e98-1dd599e6843c.metadata.json s3://warehouse/demo/dim_map_prod_7de53d0a-c474-44cc-a3d6-56b457c7cc32/metadata/00000-1901ec7c-bf6e-4c6f-b1e2-feb2a48f08d7.metadata.json s3://warehouse/demo/dim_map_prod_7de53d0a-c474-44cc-a3d6-56b457c7cc32/metadata/00000-20e5c53a-b120-4b2b-898c-92a418b5c510.metadata.json s3://warehouse/demo/dim_map_prod_7de53d0a-c474-44cc-a3d6-56b457c7cc32/metadata/00000-222ad0ed-3dc9-48a6-b236-ac91eadae51b.metadata.json s3://warehouse/demo/dim_map_prod_7de53d0a-c474-44cc-a3d6-56b457c7cc32/metadata/00000-2634945f-98ff-4008-a307-ce26986369bc.metadata.json s3://warehouse/demo/dim_map_prod_7de53d0a-c474-44cc-a3d6-56b457c7cc32/metadata/00000-287fa81e-6719-447b-820a-2a196518e9a9.metadata.json s3://warehouse/demo/dim_map_prod_7de53d0a-c474-44cc-a3d6-56b457c7cc32/metadata/00000-2ccb8ec4-b76b-4265-b687-cc84c1997f90.metadata.json s3://warehouse/demo/dim_map_prod_7de53d0a-c474-44cc-a3d6-56b457c7cc32/metadata/00000-3a55fcd0-4cec-4fc7-b909-15f69d25b4d7.metadata.json s3://warehouse/demo/dim_map_prod_7de53d0a-c474-44cc-a3d6-56b457c7cc32/metadata/00000-3a71fdf1-8053-422b-b74b-f979d088aad6.metadata.json s3://warehouse/demo/dim_map_prod_7de53d0a-c474-44cc-a3d6-56b457c7cc32/metadata/00000-3c83c45d-b950-410c-9961-202abfa47cde.metadata.json s3://warehouse/demo/dim_map_prod_7de53d0a-c474-44cc-a3d6-56b457c7cc32/metadata/00000-3c91c5bf-de7d-48fd-9f37-bfca8ecce33a.metadata.json s3://warehouse/demo/dim_map_prod_7de53d0a-c474-44cc-a3d6-56b457c7cc32/metadata/00000-3d3dd8b0-32ce-43a6-b34b-db3614d42a17.metadata.json s3://warehouse/demo/dim_map_prod_7de53d0a-c474-44cc-a3d6-56b457c7cc32/metadata/00000-416626fa-1cc6-4bee-ab21-23fc8d4a7595.metadata.json s3://warehouse/demo/dim_map_prod_7de53d0a-c474-44cc-a3d6-56b457c7cc32/metadata/00000-4b12898b-02f5-42b2-a65c-fd6fb9330a9d.metadata.json s3://warehouse/demo/dim_map_prod_7de53d0a-c474-44cc-a3d6-56b457c7cc32/metadata/00000-4c6a6f63-d976-4e26-bc42-b61b4cec5093.metadata.json s3://warehouse/demo/dim_map_prod_7de53d0a-c474-44cc-a3d6-56b457c7cc32/metadata/00000-56a75f48-7d0a-42f6-b5ec-06c55bb9e08b.metadata.json s3://warehouse/demo/dim_map_prod_7de53d0a-c474-44cc-a3d6-56b457c7cc32/metadata/00000-585290f6-bf11-4c9b-8cae-d03b06ec136f.metadata.json s3://warehouse/demo/dim_map_prod_7de53d0a-c474-44cc-a3d6-56b457c7cc32/metadata/00000-61289d39-819f-406d-a21c-cfead17d72d2.metadata.json s3://warehouse/demo/dim_map_prod_7de53d0a-c474-44cc-a3d6-56b457c7cc32/metadata/00000-63bdb100-e675-4668-a6ee-94e88524b254.metadata.json s3://warehouse/demo/dim_map_prod_7de53d0a-c474-44cc-a3d6-56b457c7cc32/metadata/00000-7124c678-5468-434e-a5e1-af6d4810cc64.metadata.json s3://warehouse/demo/dim_map_prod_7de53d0a-c474-44cc-a3d6-56b457c7cc32/metadata/00000-72c58aa6-f90a-4e80-8f87-d300d7f3b3f8.metadata.json s3://warehouse/demo/dim_map_prod_7de53d0a-c474-44cc-a3d6-56b457c7cc32/metadata/00000-779c50a0-35a1-49cb-b008-26ae8cf150cd.metadata.json s3://warehouse/demo/dim_map_prod_7de53d0a-c474-44cc-a3d6-56b457c7cc32/metadata/00000-7a204376-4814-40af-8f5c-b5ae29009b83.metadata.json s3://warehouse/demo/dim_map_prod_7de53d0a-c474-44cc-a3d6-56b457c7cc32/metadata/00000-8403b0e1-ae97-4f36-95f5-5b0259872b14.metadata.json s3://warehouse/demo/dim_map_prod_7de53d0a-c474-44cc-a3d6-56b457c7cc32/metadata/00000-8530cfcf-7d60-40d2-9cd3-ec2b6c872018.metadata.json s3://warehouse/demo/dim_map_prod_7de53d0a-c474-44cc-a3d6-56b457c7cc32/metadata/00000-855b3999-9665-43a2-8a8c-171c8841e5a7.metadata.json s3://warehouse/demo/dim_map_prod_7de53d0a-c474-44cc-a3d6-56b457c7cc32/metadata/00000-8726d25b-22b3-4898-89e1-6cbab980ef9c.metadata.json s3://warehouse/demo/dim_map_prod_7de53d0a-c474-44cc-a3d6-56b457c7cc32/metadata/00000-8c515f02-e051-48ea-afa4-e1fff220fcbf.metadata.json s3://warehouse/demo/dim_map_prod_7de53d0a-c474-44cc-a3d6-56b457c7cc32/metadata/00000-8c9c8695-f674-4262-857f-fb35346abce5.metadata.json s3://warehouse/demo/dim_map_prod_7de53d0a-c474-44cc-a3d6-56b457c7cc32/metadata/00000-94daa6dd-20a8-45e5-a5d4-3703b1ead849.metadata.json s3://warehouse/demo/dim_map_prod_7de53d0a-c474-44cc-a3d6-56b457c7cc32/metadata/00000-9782eb49-70a2-4987-9591-e374efe98a89.metadata.json s3://warehouse/demo/dim_map_prod_7de53d0a-c474-44cc-a3d6-56b457c7cc32/metadata/00000-97d508e8-2a95-4ba2-90ef-ea8ddded01a5.metadata.json s3://warehouse/demo/dim_map_prod_7de53d0a-c474-44cc-a3d6-56b457c7cc32/metadata/00000-99ad973a-b0ee-4a06-bde8-b7d85e387ea3.metadata.json s3://warehouse/demo/dim_map_prod_7de53d0a-c474-44cc-a3d6-56b457c7cc32/metadata/00000-a208e285-9e69-4729-bdf7-37dfbdf033cf.metadata.json s3://warehouse/demo/dim_map_prod_7de53d0a-c474-44cc-a3d6-56b457c7cc32/metadata/00000-a7523e9e-32d5-447c-990f-7e2c90949dd8.metadata.json s3://warehouse/demo/dim_map_prod_7de53d0a-c474-44cc-a3d6-56b457c7cc32/metadata/00000-a95bff8e-c456-4c73-8bb5-e59031f37305.metadata.json s3://warehouse/demo/dim_map_prod_7de53d0a-c474-44cc-a3d6-56b457c7cc32/metadata/00000-aa53c57d-282d-4fb3-a4b3-31927af43a1f.metadata.json s3://warehouse/demo/dim_map_prod_7de53d0a-c474-44cc-a3d6-56b457c7cc32/metadata/00000-aaf609a0-1f42-4c6a-9355-4eb4290d17dc.metadata.json s3://warehouse/demo/dim_map_prod_7de53d0a-c474-44cc-a3d6-56b457c7cc32/metadata/00000-b10b568d-d721-4c77-84aa-37d9c8ed0139.metadata.json s3://warehouse/demo/dim_map_prod_7de53d0a-c474-44cc-a3d6-56b457c7cc32/metadata/00000-b20b3b1f-adb6-4a51-a11b-0130aedbd1fe.metadata.json s3://warehouse/demo/dim_map_prod_7de53d0a-c474-44cc-a3d6-56b457c7cc32/metadata/00000-b5049807-1ada-46b0-9f65-d893d4cfb9f0.metadata.json s3://warehouse/demo/dim_map_prod_7de53d0a-c474-44cc-a3d6-56b457c7cc32/metadata/00000-bad68433-f065-4032-b60e-2826186339f0.metadata.json s3://warehouse/demo/dim_map_prod_7de53d0a-c474-44cc-a3d6-56b457c7cc32/metadata/00000-bf8d437a-487d-4fa1-a301-7b57ce0908bf.metadata.json s3://warehouse/demo/dim_map_prod_7de53d0a-c474-44cc-a3d6-56b457c7cc32/metadata/00000-c426d875-272e-48b2-a130-9b29a3ac0e60.metadata.json s3://warehouse/demo/dim_map_prod_7de53d0a-c474-44cc-a3d6-56b457c7cc32/metadata/00000-c93a4fbc-9f17-4a2f-9f2a-fa98c661c81c.metadata.json s3://warehouse/demo/dim_map_prod_7de53d0a-c474-44cc-a3d6-56b457c7cc32/metadata/00000-c988948b-9c33-43c1-800a-651355291ae2.metadata.json s3://warehouse/demo/dim_map_prod_7de53d0a-c474-44cc-a3d6-56b457c7cc32/metadata/00000-c9f29468-a0d7-4be6-b8d6-f89b2b1e7b4b.metadata.json s3://warehouse/demo/dim_map_prod_7de53d0a-c474-44cc-a3d6-56b457c7cc32/metadata/00000-ca42025e-f2a3-478f-ae58-6f3f1e3b8b84.metadata.json s3://warehouse/demo/dim_map_prod_7de53d0a-c474-44cc-a3d6-56b457c7cc32/metadata/00000-d24b2413-e5b0-40ed-a898-a49b0418a75f.metadata.json s3://warehouse/demo/dim_map_prod_7de53d0a-c474-44cc-a3d6-56b457c7cc32/metadata/00000-d4668ebd-62e4-40b6-9109-cfe7e9c67695.metadata.json s3://warehouse/demo/dim_map_prod_7de53d0a-c474-44cc-a3d6-56b457c7cc32/metadata/00000-d6da2f02-cc7f-4804-9f27-027cbbfc0717.metadata.json s3://warehouse/demo/dim_map_prod_7de53d0a-c474-44cc-a3d6-56b457c7cc32/metadata/00000-f10cc13f-c42b-4dc3-abb7-206b4a5de2e2.metadata.json s3://warehouse/demo/dim_map_prod_7de53d0a-c474-44cc-a3d6-56b457c7cc32/metadata/00000-f1ee00cb-ffdb-4a59-96f9-e6da251566f9.metadata.json s3://warehouse/demo/dim_map_prod_7de53d0a-c474-44cc-a3d6-56b457c7cc32/metadata/00000-f5356bc8-e4dd-4356-9cef-9ad6b7de6e51.metadata.json s3://warehouse/demo/dim_map_prod_7de53d0a-c474-44cc-a3d6-56b457c7cc32/metadata/00000-f635c8ca-0553-41e9-b56e-f2a79900010b.metadata.json s3://warehouse/demo/dim_map_prod_7de53d0a-c474-44cc-a3d6-56b457c7cc32/metadata/00000-f71594b5-29ab-4896-8d09-bd02736adca4.metadata.json s3://warehouse/demo/dim_map_prod_7de53d0a-c474-44cc-a3d6-56b457c7cc32/metadata/00000-fdf86902-03ff-4844-80d0-7767b41f3c08.metadata.json s3://warehouse/demo/dim_map_prod_7de53d0a-c474-44cc-a3d6-56b457c7cc32/metadata/00000-fea4c313-f67e-4a79-aa6b-fdd79d553f5c.metadata.json Time taken: 1.166 seconds, Fetched 66 row(s) ### Willingness to contribute - [ ] I can contribute a fix for this bug independently - [ ] I would be willing to contribute a fix for this bug with guidance from the Iceberg community - [ ] I cannot contribute a fix for this bug at this time -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. To unsubscribe, e-mail: [email protected] For queries about this service, please contact Infrastructure at: [email protected] --------------------------------------------------------------------- To unsubscribe, e-mail: [email protected] For additional commands, e-mail: [email protected]
