Re: [gdal-dev] Reading the same OSM data in multiple threads

2016-06-02 Thread Damian Dixon
Thanks for the reply's. We are doing a lot of processing of the data and need to retain that data in a vector format. For now we are disabling the multi-threading for OSM data and bumping up the memory allowed to be allocated by a significant amount. We will probably go with converting OSM to Sp

Re: [gdal-dev] Reading the same OSM data in multiple threads

2016-06-01 Thread Even Rouault
Damian, > > I'm trying to speed up processing of OSM data by opening an OSM file into > multiple datasets in multiple threads. One dataset per thread. Each thread > is processing a separate section of data, basically tiling the data. > > I've however run into a scaling issue with the amount of m

Re: [gdal-dev] Reading the same OSM data in multiple threads

2016-06-01 Thread Andrew C Aitchison
On Wed, 1 Jun 2016, Damian Dixon wrote: Hi, I'm trying to speed up processing of OSM data by opening an OSM file into multiple datasets in multiple threads. One dataset per thread. Each thread is processing a separate section of data, basically tiling the data. I've however run into a scaling

[gdal-dev] Reading the same OSM data in multiple threads

2016-06-01 Thread Damian Dixon
Hi, I'm trying to speed up processing of OSM data by opening an OSM file into multiple datasets in multiple threads. One dataset per thread. Each thread is processing a separate section of data, basically tiling the data. I've however run into a scaling issue with the amount of memory allocated p