Re: [gdal-dev] Slow GDALComputeRasterMinMax on nc grids

2020-01-08 Thread Joaquim Manuel Freire Luís
Perfect. 6 sec now to read that file 1st thanks of 2020 Joaquim -Original Message- From: Even Rouault Sent: Tuesday, January 7, 2020 7:09 PM To: gdal-dev@lists.osgeo.org Cc: Joaquim Manuel Freire Luís ; Paul Wessel Subject: Re: [gdal-dev] Slow GDALComputeRasterMinMax on nc grids On

Re: [gdal-dev] Slow GDALComputeRasterMinMax on nc grids

2020-01-07 Thread Even Rouault
On vendredi 3 janvier 2020 17:27:19 CET Joaquim Manuel Freire Luís wrote: > Hi Even, > > New Year, new mysteries. I'm having quite strange slow times in computing > the min/max of netCDF files. https://github.com/OSGeo/gdal/pull/2155 will fix such performance issues (independently of whether lib

Re: [gdal-dev] Slow GDALComputeRasterMinMax on nc grids

2020-01-03 Thread Even Rouault
On vendredi 3 janvier 2020 16:03:47 CET Jeff McKenna wrote: > On 2020-01-03 3:52 PM, Even Rouault wrote: > > Do you build netCDF with a custom value of the CHUNK_CACHE_SIZE / > > chunk-cache- size setting ? > > > > With the default (4 MB), runtime on my machine is about 7 minutes. But if > > I > >

Re: [gdal-dev] Slow GDALComputeRasterMinMax on nc grids

2020-01-03 Thread Joaquim Manuel Freire Luís
Sent: Friday, January 3, 2020 8:04 PM To: gdal-dev@lists.osgeo.org Subject: Re: [gdal-dev] Slow GDALComputeRasterMinMax on nc grids On 2020-01-03 3:52 PM, Even Rouault wrote: > > Do you build netCDF with a custom value of the CHUNK_CACHE_SIZE / > chunk-cache- size setting ? > > W

Re: [gdal-dev] Slow GDALComputeRasterMinMax on nc grids

2020-01-03 Thread Jeff McKenna
On 2020-01-03 3:52 PM, Even Rouault wrote: Do you build netCDF with a custom value of the CHUNK_CACHE_SIZE / chunk-cache- size setting ? With the default (4 MB), runtime on my machine is about 7 minutes. But if I use --with-chunk-cache-size=67108864 as in https://trac.osgeo.org/gdal/ticket/5291

Re: [gdal-dev] Slow GDALComputeRasterMinMax on nc grids

2020-01-03 Thread Even Rouault
On vendredi 3 janvier 2020 14:02:18 CET Jeff McKenna wrote: > Hi Joaquim, > > I have tested your file on Windows 10 here, with the command: > > gdalinfo grav_29_img.nc -mm > > which takes about 5 seconds to execute fully. I am using MS4W 4.0.2 > (GDAL 2.4.3 , NetCDF 4.7.3 ) Jeff, Do you b

Re: [gdal-dev] Slow GDALComputeRasterMinMax on nc grids

2020-01-03 Thread Joaquim Manuel Freire Luís
Nope, rebuilt netCDF but same timings. -Original Message- From: gdal-dev On Behalf Of Joaquim Manuel Freire Luís Sent: Friday, January 3, 2020 6:26 PM To: Jeff McKenna ; gdal-dev@lists.osgeo.org Subject: Re: [gdal-dev] Slow GDALComputeRasterMinMax on nc grids Hi Jeff, Thanks for

Re: [gdal-dev] Slow GDALComputeRasterMinMax on nc grids

2020-01-03 Thread Joaquim Manuel Freire Luís
Hi Jeff, Thanks for testing this. Sure it's useful. It also reminded me that I have a OSGeo4W with GDAL 2.4.1 but don't know which netCDF version, and using it took ... over 6 minutes. My Windows netCDF lib is a bit old by now (I build it from source). It might be it. Hi Joaquim, I have test

Re: [gdal-dev] Slow GDALComputeRasterMinMax on nc grids

2020-01-03 Thread Jeff McKenna
Hi Joaquim, I have tested your file on Windows 10 here, with the command: gdalinfo grav_29_img.nc -mm which takes about 5 seconds to execute fully. I am using MS4W 4.0.2 (GDAL 2.4.3 , NetCDF 4.7.3 ) I haven't tested using your wrappers though, so imagine that my feedback is not very use

[gdal-dev] Slow GDALComputeRasterMinMax on nc grids

2020-01-03 Thread Joaquim Manuel Freire Luís
Hi Even, New Year, new mysteries. I'm having quite strange slow times in computing the min/max of netCDF files. In GMT we can read files via GDAL by appending =gd to the file name. So both of these do a similar job grdinfo grav_29_img.nc=gd and gdalinfo grav_29_img.nc -mm and it takes around 2