Re: [gdal-dev] Failing to write to s3 using GTiff driver.

2022-08-16 Thread William Roper
Thanks for helping track it down! On Tue, 16 Aug 2022 at 14:05, Even Rouault wrote: > William, > > COG: Generating overviews of the imagery: start >> S3: GetFileSize( >> https://my-bucket.s3.amazonaws.com/test_batch_output/test.tif.ovr.tmp)=0 >> response_code=404 >> S3: /vsis3/my-bucket/test_ba

Re: [gdal-dev] Failing to write to s3 using GTiff driver.

2022-08-16 Thread Even Rouault
William, COG: Generating overviews of the imagery: start S3: GetFileSize(https://my-bucket.s3.amazonaws.com/test_batch_output/test.tif.ovr.tmp)=0  response_code=404 S3: /vsis3/my-bucket/test_batch_output/test.tif.ovr.tmp is not a object GTiff: File being created as a

Re: [gdal-dev] Failing to write to s3 using GTiff driver.

2022-08-16 Thread William Roper
I've included the rest of the debug below. It starts hitting 404s (I guess because the objects don't exist) almost straight away: > S3: GetFileSize( > https://my-bucket.s3.amazonaws.com/test_batch_output/test.tif.warped.tif.tmp)=0 > response_code=404 > S3: /vsis3/my-bucket/test_batch_output/test.

Re: [gdal-dev] Failing to write to s3 using GTiff driver.

2022-08-16 Thread William Roper
Thanks for the reply Even. I've run with "--debug on" and I think the interesting bit is: GDAL: GDALWarpKernel()::GWKCubicNoMasksOrDstDensityOnlyByte() > Src=0,15684,6x73 Dst=686,22448,98x92 > WARP: Using 1 threads > GDAL: GDALWarpKernel()::GWKCubicNoMasksOrDstDensityOnlyByte() > Src=0,15750,4x72

Re: [gdal-dev] Failing to write to s3 using GTiff driver.

2022-08-16 Thread Even Rouault
William, can you add "--debug on" and retry to see if more hints are emitted about what's going on. Even Le 15/08/2022 à 11:45, William Roper a écrit : Hi list, I'm trying to convert a GeoTiff on s3 into a COG, that will also live on s3. I'm working on EC2 instances, or fargate containers,

[gdal-dev] Failing to write to s3 using GTiff driver.

2022-08-15 Thread William Roper
Hi list, I'm trying to convert a GeoTiff on s3 into a COG, that will also live on s3. I'm working on EC2 instances, or fargate containers, because local download and upload speeds are a bit slow. gdalwarp \ --config AWS_SECRET_ACCESS_KEY \ --config AWS_ACCESS_KEY_ID \ --config CPL_VSIL_US