[gdal-dev] gdal_rasterize and virtual rasters

2019-03-20 Thread Guy Doulberg
Hi guys, I am trying my luck here, I looked up this question in the web but no success, Is there a file format of raster type that returns the product of gdal_rasterize. I am thinking of something like a VRT file, that its attributes tell gdal how to run gdal_rasterize on top of vectors layers.

[gdal-dev] Fwd: Add overviews there is a difference between interleave

2019-01-08 Thread Guy Doulberg
Hi guys I am trying to fix artifacts that the gdaladdo is creating in the overview I am working on. The gdal version I am working with is 2.3.2 In general I have a big vrt file (RGB) on top of COGs with internal masks. There are places in the original rasters that we mask the values. But when

[gdal-dev] VRT, how should I create overviews on the mask

2018-11-29 Thread Guy Doulberg
Hi guys I am using a VRT in front of many geotif rasters, the size of the vrt could be in thousands I am using gdaladdo on that vrt to per-calculate overviews, and I get an ovr file. In the orginal vrt file I have also definition of a mask, basically each of the origin files has mask, so I am us

[gdal-dev] Nodata value and overviews

2018-10-24 Thread Guy Doulberg
Hi guys I have a raster with NODATA value defined I am creating overviews on top of that raster, using the gdaladdo When using the overviews should I consider the NODATA value when reading the pixels, or all pixels in the overviews are valid? When calculating the overviews does gdaladdo conside

Re: [gdal-dev] Offsets in url of geotiff

2018-08-23 Thread Guy Doulberg
Thanks, that will do exactly what I wanted, I wasn't ware of the behavior in VRT On Thu, Aug 23, 2018 at 10:25 AM, Even Rouault wrote: > On jeudi 23 août 2018 09:29:27 CEST Guy Doulberg wrote: > > Hi > > > > I want to share with you an idea I had, > > &

[gdal-dev] Offsets in url of geotiff

2018-08-22 Thread Guy Doulberg
Hi I want to share with you an idea I had, I am storing rasters as cloud optimized GeoTiff, these rasters can cover very big areas. I was thinking it could be super, if I could share a link to my colleagues of a raster with the offset they need encoded in the raster. for example: url = "/vsicu

Re: [gdal-dev] Cache when dealing with several processes and COG

2018-07-05 Thread Guy Doulberg
I am using compression, Guy On Tue, Jul 3, 2018 at 7:34 PM, Sean Gillies wrote: > Hi Guy, > > On Tue, Jul 3, 2018 at 12:06 AM Guy Doulberg wrote: > >> Hi guys, >> >> I am working on a tileserver use case on top of cogs. >> >> I want to find a cac

Re: [gdal-dev] Tiled GeoTiff that reduce the amount of reads in XYZ maps

2018-07-02 Thread Guy Doulberg
guys deal with this case? On Sun, Jun 17, 2018 at 5:25 PM, Guy Doulberg wrote: > it is 1/3 because the original was not compressed, > > anyhow I am still getting too many requests when fetching a tile, maybe my > read code is not doing what I think it is doing > > > > On

[gdal-dev] Cache when dealing with several processes and COG

2018-07-02 Thread Guy Doulberg
Hi guys, I am working on a tileserver use case on top of cogs. I want to find a cache mechanism to my architecture. The tile-server architecture is several python processes(gunicorn) running on several VMs. I understand how GDAL caches the curl blocks or the raster using intra-process caching,

Re: [gdal-dev] Tiled GeoTiff that reduce the amount of reads in XYZ maps

2018-06-17 Thread Guy Doulberg
it is 1/3 because the original was not compressed, anyhow I am still getting too many requests when fetching a tile, maybe my read code is not doing what I think it is doing On Sun, Jun 17, 2018 at 4:51 PM, Guy Doulberg wrote: > Thanks Even > > I tried both ways and in both I

Re: [gdal-dev] Tiled GeoTiff that reduce the amount of reads in XYZ maps

2018-06-17 Thread Guy Doulberg
17, 2018 at 12:00 PM, Even Rouault wrote: > On dimanche 17 juin 2018 10:19:34 CEST Guy Doulberg wrote: > > Hi all, > > > > I am trying to use cloud optimized geotiff(cog) to reduce the block > fetched > > when accessing a raster. > > > > The use case

[gdal-dev] Tiled GeoTiff that reduce the amount of reads in XYZ maps

2018-06-17 Thread Guy Doulberg
Hi all, I am trying to use cloud optimized geotiff(cog) to reduce the block fetched when accessing a raster. The use case I am trying to build, is a TileServer that serves tile in openlayer map. The rasters are to be stored on a remote location, in my case azure blob storage. We were able to do

Re: [gdal-dev] GDAL_CACHMAX on a docker container

2018-05-23 Thread Guy Doulberg
I opened and issue:https://github.com/OSGeo/gdal/issues/640 Can you check in your docker container that > cat /sys/fs/cgroup/memory/memory.limit_in_bytes > returns the maximum memory amount you specified ? > yes it returns the memory I specified On Wed, May 23, 2018 at 1:53 PM, Robert Coup wrot

[gdal-dev] GDAL_CACHMAX on a docker container

2018-05-23 Thread Guy Doulberg
Hi guys I wanted to share with you a GOTCHA I struggled with in the passed few days, maybe it will be helpful for more people I am using GDAL on a docker cluster, since there are more services running on the host I limit the container to use only 1GB of ram The default behavior of GDAL_CACHMAX i

[gdal-dev] '/vsicurl/https://` does not exist in the file system, and is not recognized as a supported dataset name.

2018-05-10 Thread Guy Doulberg
Hi, We are encountering some issue with vsicurl, we are trying to use VSICURL to do range queries on rasters that are in azure blob storage, We convert the azure blob to https, and in most cases it works well for us. In our execution log we see the following message: '/vsicurl/https://` does n