Re: [gdal-dev] Write overviews directly to S3

2017-05-18 Thread Jeremy Palmer
Hi Peter, On 19/05/2017, at 4:38 AM, Peter Schmitt mailto:pschm...@gmail.com>> wrote: We have come up with one technique to read/write directly to/from s3 using /vsis3/ and a simple file writer class a colleague wrote: https://gist.github.com/pedros007/55c6e33224596fb4d8e9e6b68b24ed9b In fact

Re: [gdal-dev] Write overviews directly to S3

2017-05-18 Thread Even Rouault
> > Even - I found methods to check for VSI errors: > https://gist.github.com/pedros007/55c6e33224596fb4d8e9e6b68b24ed9b#file-simp > levsimemfile-py-L73-L74 > > Are these intended for public consumption? With care... > When reading from a > /vsimem/foo.shp with gdal-2.2.0, gdal.VSIGetLastError

Re: [gdal-dev] Write overviews directly to S3

2017-05-18 Thread Peter Schmitt
Hi Jeremy, We have come up with one technique to read/write directly to/from s3 using /vsis3/ and a simple file writer class a colleague wrote: https://gist.github.com/pedros007/55c6e33224596fb4d8e9e6b68b24ed9b In fact, I used this last week to add internal overviews to some of our images in S3.

Re: [gdal-dev] Write overviews directly to S3

2017-05-18 Thread Jeremy Palmer
Hi Even, On 18/05/2017, at 9:12 PM, Even Rouault mailto:even.roua...@spatialys.com>> wrote: > > Is is possible to directly write external overview to a S3 bucket? With GDAL > 2.1.2 I get an error reporting that seek is not supported when writing to > vsis3: No, /vsis3/ only supports sequential

Re: [gdal-dev] Write overviews directly to S3

2017-05-18 Thread Even Rouault
Hi Jeremy, > > Is is possible to directly write external overview to a S3 bucket? With GDAL > 2.1.2 I get an error reporting that seek is not supported when writing to > vsis3: No, /vsis3/ only supports sequential writing in files (the original use case was to generate and upload a huge CSV fi

[gdal-dev] Write overviews directly to S3

2017-05-18 Thread Jeremy Palmer
Hi All, Is is possible to directly write external overview to a S3 bucket? With GDAL 2.1.2 I get an error reporting that seek is not supported when writing to vsis3: gdaladdo /vsis3/my-bucket/data/1000.tif 2 ERROR 6: Seek not supported on writable /vsis3 files ERROR 1: _tiffSeekProc:Resource tem