Re: [gdal-dev] IO Overhead when reading small subsets from Global Files

2014-12-08 Thread Julian Zeidler
Am 08.12.2014 11:26, schrieb Even Rouault: Le lundi 08 décembre 2014 11:14:04, Julian Zeidler a écrit : Hi Even, Thanks for the quick reply. I should have mentioned, that I also tried converting it to a compressed tiled Tiff. There i can see the same kind of overhead. I extract a 1MB Subset fr

Re: [gdal-dev] IO Overhead when reading small subsets from Global Files

2014-12-08 Thread Even Rouault
Le lundi 08 décembre 2014 11:14:04, Julian Zeidler a écrit : > Hi Even, > > Thanks for the quick reply. > > I should have mentioned, that I also tried converting it to a compressed > tiled Tiff. > There i can see the same kind of overhead. I extract a 1MB Subset from > the File and depending on t

Re: [gdal-dev] IO Overhead when reading small subsets from Global Files

2014-12-08 Thread Julian Zeidler
Hi Even, Thanks for the quick reply. I should have mentioned, that I also tried converting it to a compressed tiled Tiff. There i can see the same kind of overhead. I extract a 1MB Subset from the File and depending on the Tiles 1 read between 9-12 MB via the Network. The Process only reads o

Re: [gdal-dev] IO Overhead when reading small subsets from Global Files

2014-12-08 Thread Even Rouault
Le lundi 08 décembre 2014 10:44:41, Julian Zeidler a écrit : > Dear Gdal-mailinglist, > > I am currently trying to optimize a Global Modell. > The Modell reads small chunks (500x500) from lots (One for each day) of > Global Datasets (4x2) > These Dataset are compressed NetCDFs with a tilli

[gdal-dev] IO Overhead when reading small subsets from Global Files

2014-12-08 Thread Julian Zeidler
Dear Gdal-mailinglist, I am currently trying to optimize a Global Modell. The Modell reads small chunks (500x500) from lots (One for each day) of Global Datasets (4x2) These Dataset are compressed NetCDFs with a tilling activated (100x100). (See output oif gdalinfo attached) However whe