Re: [gdal-dev] does gdal support multiple simultaneous writers to raster

2013-01-11 Thread Joaquim Luis
On 12-01-2013 01:38, Kennedy, Paul wrote: Hi, Yes, we are pretty sure we will see a significant benefit. The processing algorithms are CPU bound not io bound. Our digital terrain model interpolations often run for many hours ( we do them overnight) but the underlying file is only a few gigaby

Re: [gdal-dev] does gdal support multiple simultaneous writers to raster

2013-01-11 Thread Kennedy, Paul
Hi, Yes, we are pretty sure we will see a significant benefit. The processing algorithms are CPU bound not io bound. Our digital terrain model interpolations often run for many hours ( we do them overnight) but the underlying file is only a few gigabytes. If we split them into multiple files of

Re: [gdal-dev] New OGR driver to read OpenStreetMap .osm / .pbf files

2013-01-11 Thread Jeff McKenna
> > There are different schools on the topic. I know Frank is not too keen on > mentionning versionning, although personnaly, I try to mention version > differences in the format page itself (http://www.gdal.org/ogr/drv_osm.html > mentions GDAL/OGR >= 1.10.0). But at the end, in drivers with a lo

Re: [gdal-dev] which formats support subdatasets?

2013-01-11 Thread Ivan Lucena
Hi Etienne, It sounds like a good idea to add that information to the GDALDriver metata. I can see how one could take advantage of that feature when writing a generic solution to deal with all SUBDATASETS drivers at once. But I am wondering if I should add that to the GeoRaster driver. This dri

Re: [gdal-dev] New OGR driver to read OpenStreetMap .osm / .pbf files

2013-01-11 Thread Even Rouault
Selon Jeff McKenna : > On 13-01-08 9:26 PM, Even Rouault wrote: > > Ah ok, so I must mention that the online documentation is always up-to-date > > with the latest trunk version (it is refreshed each night). So the fact > that > > something is documented is not a sign of stability by itself. It ca

Re: [gdal-dev] New OGR driver to read OpenStreetMap .osm / .pbf files

2013-01-11 Thread Jeff McKenna
On 13-01-08 9:26 PM, Even Rouault wrote: > Ah ok, so I must mention that the online documentation is always up-to-date > with the latest trunk version (it is refreshed each night). So the fact that > something is documented is not a sign of stability by itself. It can be a new > development comm

[gdal-dev] does gdal support multiple simultaneous writers to raster

2013-01-11 Thread N. Farah
Simultaneous writers to different dataset or the same dataset ?In related topic, can GDAL writte to different dataset in a parallel way ?ex. convert multiple datasets to different output datasets in a parallel way.Would those parallel operations not be affected by GDAL caching for bot read and

Re: [gdal-dev] which formats support subdatasets?

2013-01-11 Thread Etienne Tourigny
On Fri, Jan 11, 2013 at 11:03 AM, Even Rouault wrote: > Selon Etienne Tourigny : > >> Hi, >> >> I'd just like to point out a patch I have submitted to report which >> raster drivers support subdatasets, using the DMD_SUBDATASETS metadata >> item. >> I have also modified gdalinfo and format docs. >

Re: [gdal-dev] which formats support subdatasets?

2013-01-11 Thread Even Rouault
Selon Etienne Tourigny : > Hi, > > I'd just like to point out a patch I have submitted to report which > raster drivers support subdatasets, using the DMD_SUBDATASETS metadata > item. > I have also modified gdalinfo and format docs. > > http://trac.osgeo.org/gdal/ticket/4902 > > For example: > > $

Re: [gdal-dev] which formats support subdatasets?

2013-01-11 Thread Etienne Tourigny
Hi, I'd just like to point out a patch I have submitted to report which raster drivers support subdatasets, using the DMD_SUBDATASETS metadata item. I have also modified gdalinfo and format docs. http://trac.osgeo.org/gdal/ticket/4902 For example: $ gdalinfo --format hdf4 Format Details: Shor

Re: [gdal-dev] does gdal support multiple simultaneous writers to raster

2013-01-11 Thread Jan Hartmann
I would like to make a further suggestion: what about an option for gdalwarp to create *external* tiles, instead of one big output file? That's what I am doing now: just create one big georeferenced raster, and split it up in tiles, mostly 2000*2000. Accessing those tiles with a tileindex is re

Re: [gdal-dev] does gdal support multiple simultaneous writers to raster

2013-01-11 Thread Even Rouault
Hi, This is an intersting topic, with many "intersecting" issues to deal with at different levels. First, are you confident that in the use cases you imagine that I/O access won't be the limiting factor, in which case serialization of I/O could be acceptable and this would just require an API wit

Re: [gdal-dev] does gdal support multiple simultaneous writers to raster

2013-01-11 Thread Kennedy, Paul
hi, I would be prepared to contribute to such a facility in GDAL if it permitted multiple simultaneous writes (to different bands / tiles) pk From: Jan Hartmann [mailto:j.l.h.hartm...@uva.nl] Sent: Friday, 11 January 2013 5:43 PM To: Frank Warmerdam Cc: Kennedy, Paul; gdal dev

Re: [gdal-dev] does gdal support multiple simultaneous writers to raster

2013-01-11 Thread Jan Hartmann
I'v tried this in a Cloud environment with multiple VMs writing to the same shared file location. I didn't use tiles, so the results where negative. It would be a great asset for Cloud environments, however. Is it in principle possible to build such a facility into GDAL, and if yes, what kind o

Re: [gdal-dev] OGR2OGR: DBF and where-clause

2013-01-11 Thread Even Rouault
Selon Uffe Kousgaard : > I run a select on a SHP file with this command: > ogr2ogr -where "ONEWAY<>'N'" -f "ESRI Shapefile" nw2.shp nw.shp Try -where "ONEWAY <> 'N' OR ONEWAY IS NULL" ___ gdal-dev mailing list gdal-dev@lists.osgeo.org http://lists.o

[gdal-dev] OGR2OGR: DBF and where-clause

2013-01-11 Thread Uffe Kousgaard
I run a select on a SHP file with this command: ogr2ogr -where "ONEWAY<>'N'" -f "ESRI Shapefile" nw2.shp nw.shp The ONEWAY field has 4 possible values: , FT, TF and N. Fieldtype is char(2). The problem is only records with FT and TF are selected. All the records are skipped. This is with the