[gdal-dev] Best way to GTiff options for hyperspectral data

Hello, I have quite a lot of very large hyperspectral data (>600 bands). The data is in ENVI BIL format, but I would like to use GTiff for it, and possibly access the data via HTTPS for processing and visualisation. I notice that in the STAC world, it's one file per band, which gets a bit tiring q

Re: [gdal-dev] "New" style import

Hi Daniel, On Wed, 7 Apr 2021 at 13:20, Daniel Evans wrote: > In 3.1 and earlier, GDAL had short helper scripts to allow the deprecated > imports, named “gdal.py”, “osr.py”, and “ogr.py” > Thanks, this is a good idea. I have packages installed all over the place (different environments, in deve

[gdal-dev] "New" style import

Hi, I've recently updated GDAL to 3.2.1. I mostly use it from Python, and have oodles of scripts from the past that use "import gdal" somewhere. With the newer versions of GDAL, this is deprecated and is now "from osgeo import gdal". Is there some hacky workaround/sacrifice to the technical debt g

Re: [gdal-dev] Limit on the number of files for gdalbuildvrt

solved, it would seem. Thanks! On Fri, 1 Nov 2019 at 17:21, Jose Gomez-Dans wrote: > Dear Even, > > Thanks for your help. After a bit more dredging, I am only able to repeat > my problem on a particularly mounted filesystem in an HPC facility I use. > On other systems (and even other

Re: [gdal-dev] Limit on the number of files for gdalbuildvrt

ators, but just as a warning to others that it can happen and I didn't dream it! Thanks for your very prompt reply Jose On Wed, 30 Oct 2019 at 16:16, Even Rouault wrote: > On mercredi 30 octobre 2019 15:52:54 CET Jose Gomez-Dans wrote: > > Hi, > > > > I'm mosaicking

[gdal-dev] Limit on the number of files for gdalbuildvrt

Hi, I'm mosaicking a large number of small tiles using the GDAL python bindings (python 3.7, gdal 3.0.1, but also tested on 2.4.2). Code is something like ``` *output_fname = "/something/or/other.vrt"* *fnames = ["file1.tif", ..., "fileN.tif"]* *dst_ds = gdal.BuildVRT(output_fnam

[gdal-dev] GDAL 2 Python bindings changes

Hello, I have just installed GDAL 2.1.0 on some test systems. I mostly use the Python bindings and the shell tools in Unix (e.g. gdalinfo and so on, with a slant on GDAL, but also use OGR from time to time). Are the changes in the Python bindings and/or tools going from 1.11.x to 2.1 documented so

Re: [gdal-dev] GDAL and Sentinel2

Hi Even, As usual, may thanks for your help, it's really useful On 13 January 2016 at 16:16, Even Rouault wrote: > You can also compile the driver code as a plugin against older GDAL > releases > (works at least with 1.10 or later) > Are there some documents on how to achieve this? Jose _

[gdal-dev] GDAL and Sentinel2

Hi, I'm interested in using GDAL with Sentinel2/MSI data. I understand that GDAL 2.1 will have a driver for this kind of data, but 2.1 hasn't yet been released. But given the actual image data are GMLJP2, is there some possibility of using an current GDAL build to access the images? If not, when c

[gdal-dev] Limits on use of VRTs?

Hello, I'm trying to do some python processing, and I thought that using VRTs would be a great way forward. My process is basically: 1.- Putting several bands together into a single dataset. A couple of bands have a different dataset (Byte vs Int16), so I'd like to upgrade these Byte bands to Int

[gdal-dev] HDF5: best practice

Hello, We're using the Python GDAL bindings to ingest many different datasets into our processing system, which currently outputs data as GeoTIFF files. However, in order to optimise processing, parts of the code use HDF5. As such, we would like to drop the GeoTIFF output and use the HDF5 format d

Re: [gdal-dev] GDAL/OGR 1.11.2 released

Hi, On 17 February 2015 at 09:14, Even Rouault wrote: > Hi, > > On behalf of the GDAL/OGR development team, I am pleased to > announce the release of the GDAL/OGR 1.11.2 bug fix release. > I have compiled some binaries for Linux using the Anaconda Python distribution. Some people might find th

Re: [gdal-dev] Build GDAL from scratch on CentOS 6.5 (Jake Brinkmann)

Hello, I have produced a GDAL (1.11.0) binary for Anaconda with HDF4, HDF5 and NetCDF for X86_64. It should just work by installing standard anaconda and issuing the following command: conda install -c https://conda.binstar.org/jgomezdans gdal=1.11.0 The list of supported raster formats is avail

Re: [gdal-dev] /vsicurl/ and gz files

On 11 October 2013 15:57, Kyle Shannon wrote: > > As Even mentioned, the NetCDF driver doesn't use the VSI*L mechanism, > so you can't use /vsi*/ stuff with it unless you use > LD_PRELOAD=vsipreload.so, see above. > OK, sorry, I thought that only applied to the /vsicurl/ method. Thanks for the e

Re: [gdal-dev] /vsicurl/ and gz files

Hello everyone, On 10 October 2013 19:58, Even Rouault wrote: > Le jeudi 10 octobre 2013 20:33:49, Jose Gomez-Dans a écrit : > > Hi, > > > > I was wondering if it's possible to use /vsitar/ to have a peek in .gz > > files, such as this one: > > > htt

[gdal-dev] /vsicurl/ and gz files

Hi, I was wondering if it's possible to use /vsitar/ to have a peek in .gz files, such as this one: http://www.globalbedo.org/GlobAlbedo29/tiles/2004/h17v04/GlobAlbedo.2004001.h17v04.nc.gz The file is a NetCDF, with 20 different layers. I was hoping to be able to read the file in using /vsitar/ (

[gdal-dev] Aggregate to a grid in a different projection with masks

Hi, I'd like to perform a spatial aggregation of a large data set at some high resolution in some projection, to a grid in a lower resolution in another projection. One thing I have used in the past is to have a raster at the higher resolution, and use that to select pixels in the original dataset

Re: [gdal-dev] MOD13C2 assign coord. sist.

On 6 September 2013 11:33, Eloi wrote: > Assigning EPSG:4326 nothing comes up when loading the image with > others data in EPSG:4326. > You are right, the data is missing georeference information: $ gdalinfo 'HDF4_EOS:EOS_GRID:"MOD13C2.A232.005.2006272104028.hdf":MOD_Grid_monthly_CMG_VI:CMG

Re: [gdal-dev] MOD13C2 assign coord. sist.

Hi Eloi, I think that the projection for the global CMG MOD13 products is lat/long, and is stored in the dataset itself (I deleted the MOD13's last weeek, so can't check ;-D). You shouldn't need to specify it, GDAL will pick it up. In case it doesn't pick it up, you want "EPSG:4326", but I'm sure

Re: [gdal-dev] multiple access to a file

Hi Frank, On 21 May 2013 00:02, Frank Warmerdam wrote: > If you write a small part of an image, GDAL is likely to read a larger > area, update that and write it back. If other programs happen to try and > update the same larger area at the same time some data is likely to be > lost. > Thanks

[gdal-dev] multiple access to a file

Hi, I have a rather demanding processing scheme (read data from files, and process pixel per pixel). It's trivial to parallelise (just do pixels in different machines/cores), and I intend to run this on several machines on our cluster. I'm unsure whether I can use GDAL (python bindings) like this.

[gdal-dev] HDF4 and 1.10

Hi, I read with interest that gdal 1.10 has the following new addition: * Add ability to increase the maximum number of opened HDF4 files (from ). Does that mean that I can compile GDAL against a version of the HDF library that has MAX_FILE set

[gdal-dev] Efficient access to large multiband files

Hi, I usually process large multiband datasets (typically 2000*2000*1000 in x,y and no. Bands ). I've been using VRT for this but sometimes that is too much for our NFS disk setup and timeouts looking up the individual files that make up the VRT break my programs. So I'm thinking of converting to

[gdal-dev] Problems linking without curl

Hi, Trying to compile GDAL on RHEL6 x864_64. It's failing looking for libcurl when linking. I don't need curl in this machine, and it's not installed. My configure line is as follows: ./configure --prefix=/home/User/bin/ --with-libtiff=internal --with-hdf4=/usr/lib64/hdf --without-curl --without-

[gdal-dev] gdalbuildvrt different bands

Hi, I want to produce a set of VRTs that comprise a re-arrangement of bands of a number of individual GeoTIFF files. Say I have file_01: band_01...band_04 file_02: band_01...band_04 file_03: band_01...band_04 file_04: band_01...band_04 And what I want to have is vrt_01: file_01:band_01 file_02:ban

Re: [gdal-dev] Convert to temperature in degrees C in MODIS Ocean Color?

On 19 July 2012 15:25, Jose Gomez-Dans wrote: > Hi, > > > On 19 July 2012 04:46, sigologo wrote: > >> I'm trying import A20030012003008.L3m_8D_NSST_4, with gdal with this >> script: >> >> for file in A*L3m_8D_NSST_4 ; do >> echo "map

Re: [gdal-dev] Convert to temperature in degrees C in MODIS Ocean Color?

Hi, On 19 July 2012 04:46, sigologo wrote: > I'm trying import A20030012003008.L3m_8D_NSST_4, with gdal with this > script: > > for file in A*L3m_8D_NSST_4 ; do > echo "map: $file" > > gdal_translate -a_srs "+init=epsg:4326" -a_nodata 65535 \ > -a_ullr -180 90 180 -90 -co "COMPRESS=PACK

Re: [gdal-dev] zonal statistics with gdal

Hi, On 19 June 2012 17:37, jdmorgan wrote: > Is there a way to do something along the lines of zonal statistics with > gdal.  Basically, I have a county shape file and a classified raster > dataset.  I would like to count the number of raster pixels/county (FIPS). > Is this possible with GDAL/O

Re: [gdal-dev] [gdal_translate] Spatial subset HDF4Image with multiple subdatasets?

Hi, On 20 June 2012 14:13, Vincent Schut wrote: > On 06/20/2012 02:55 PM, Etienne Tourigny wrote: >> >> You could combine them as a multi-band gtiff file for example > > No, in this case (MOD09GA data) you cannot, because the subdatasets have > different resolutions / raster sizes, and datatype

Re: [gdal-dev] plate caree and EPSG:4326

Hi On 30 January 2012 13:28, Alfredo Alessandrini wrote: > Hi, > > I'm trying to reproject the VGT-P product with the gdal libraries. > It's right to assume the EPSG 4326 code as source spatial reference set? I don't think they are the same. Plate Carree is an equidistance cylindrical projec

Re: [gdal-dev] gdalbuilvrt and multiband files

Hi On 6 December 2011 20:08, Martin Lambers wrote: > Hi Jose! > This might be slightly offtopic, but if you are using the latest GDAL > from svn, you could try the brand new GTA driver to store your files > in GTA format. Then you can use the gta tool, which was made for > exactly this kind of g

[gdal-dev] gdalbuilvrt and multiband files

Hi, I'm trying to build a VRT file out of a number of multiband files using gdalbuildvrt. Let's say I have N 7-band files, and I want build 7 N-band files (i.e., I want to stack all the bands in the same dataset). I have accomplished this thus far by having a prior step that creates a VRT for each

Re: [gdal-dev] subdatasets not read in a HDF file

Hi Joaquim, On 24 October 2011 13:56, Joaquim Luis wrote: > Anton, > > I don't remember the details because I programmed that some time ago, but > from what I recall that's the most accurate way of interpolating the data > into a regular grid. The whole procedure is implemented in Mirone were th

[gdal-dev] ReadRaster python bindings and argumen types

Hi, I have installed GDAL 1.8.1 to use the python bindings. I note that if I pass a slice of an array to ReadRaster for the (x,y) pixel location, I get a TypeError: TypeError: in method 'Dataset_ReadRaster1', argument 2 of type 'int' If I surround the offending slice by int( x ) and int(y), it wor

Re: [gdal-dev] gdalbuildvrt, gdal_translate, and MODIS HDF files

Hi, > > > I have recently come across the mosaicking magic that is 1) build a vrt > > > usin gdalbuildvrt and then 2) gdal_translate the vrt to whatever format > > > I want -- I'm noticing this is a crazy-fast way to do mosaicking > > > compared I had a similar question on this a while ago, and o

Re: [gdal-dev] Gap-filling rasters

a.html > You will need GDAL's python bindings to run this. > > On Tue, Apr 5, 2011 at 5:21 PM, Jose Gomez-Dans wrote: > >> Hi, >> >> I was wondering whether GDAL has the ability to interpolate multiband >> rasters. I have a NxMxL cube (ie, a raster with L ban

[gdal-dev] Gap-filling rasters

Hi, I was wondering whether GDAL has the ability to interpolate multiband rasters. I have a NxMxL cube (ie, a raster with L bands :D), and a mask of the same size. The locations of my data cube where the associated mask is zero (say) need to be interpolated from the surrounding pixels in the cube,

Re: [gdal-dev] ogr + python: find polygons in x,y

Hi, On 8 December 2010 09:38, Sebastian E. Ovide wrote: > Using Python + Gdal/OGR is there any efficient way of finding all the > polygons that contains the point X,Y ? This is my try. Not the most efficient, but you could always use a spatial index and a spatial filter:

Re: [gdal-dev] how to create a grid shape file with in the extent of the image

Hi, On 4 August 2010 07:52, mail2vajram wrote: > i have a land use land cover image, i need to create a 1000 * 1000 m > grid(shape file format) over the image and i have to calculate the area of > the each class in each grid how to do this.. Maybe this is of use to you, using python and G

Re: [gdal-dev] GDAL/OGR 1.7.2RC2 Release Candidate

> > On Apr 22, 2010, at 11:51 AM, Frank Warmerdam wrote: >> >> > Folks, >> > >> > I have prepared a new 1.7.2 release candidate. In this one I have >> > run libtoolize --force --copy and then autogen.sh in the hopes of >> producing >> > a consistent up-to-date set of configure and libtool stuff.

Re: [gdal-dev] seeking suggestions for pixel arithemtic programs

On 20 April 2010 17:34, Christopher Barker wrote: > It would be pretty easy to write a python program that used a pixel > function defined in its own file, so your colleagues would only have to make > a new one of those and run it again -- and python is about as easy a way to > express a function

Re: [gdal-dev] Bulding VRT files from HDF sds

Frank, On 16 April 2010 19:25, Frank Warmerdam wrote: > Jose Gomez-Dans wrote: > >> Running gdalinfo -stats on the new filename proceeds reporting the >> expected information, band by band... slowly but surely, until it reaches >> band 33 (it's band 33 everytime,

[gdal-dev] Re: Bulding VRT files from HDF sds

More on this On 16 April 2010 19:04, Jose Gomez-Dans wrote: > I want to put together a time series of MODIS datasets in VRT, the > originals being in HDF EOS format. > It appears that if I convert my HDF sds into standard GeoTIFFs (gdal_translate -of GTiff .), and then generate by

[gdal-dev] Bulding VRT files from HDF sds

Hi, I want to put together a time series of MODIS datasets in VRT, the originals being in HDF EOS format. I do that by defining the SDS for each date and sticking it into a file: HDF4_EOS:EOS_GRID:"../blablah.hdf":blah:blah HDF4_EOS:EOS_GRID:"../blablah.hdf":blah:blah HDF4_EOS:EOS_GRID:"../blablah.

Re: [gdal-dev] FillNodata and source NoDatas

Frank, On 15 April 2010 17:24, Frank Warmerdam wrote: > Jose Gomez-Dans wrote: > >> Basically, my raster looks like a black square with some "island blobs" >> where I have data. Some pixels in those blobs are flagged as unsuitable >> (using a mask band), and

[gdal-dev] FillNodata and source NoDatas

Hi, I want to use FillNodata to fill some missing data in a raster file (obviously!). However, in my source data file some of the NoData mean just "NoData", and I want the algorithm to ignore those values. Does this method ignore the missing values when it bags the values to interpolate the output?

Re: [gdal-dev] Problem with libtool on RHEL5/x86_64

Chaitanya, On 8 April 2010 17:09, Chaitanya kumar CH wrote: > Try to configure with libtool disabled with the option "--without-libtool". > This seems to have solved it. thanks! Jose ___ gdal-dev mailing list gdal-dev@lists.osgeo.org http://lists.osge

[gdal-dev] Problem with libtool on RHEL5/x86_64

Hi, I'm trying to compile GDAL 1.7.1 on a RHEL5/x86_64 system. My configure call is ./configure --with-python --with-geos=/usr/bin/geos-config --with-curl=/usr/bin/curl-config --with-hdf4=/usr/lib64/hdf --with-sqlite3=yes --with-netcdf=no --with-static-proj4=/usr/lib64/ --with-hdf5=/usr/include/hd

Re: [gdal-dev] Real and "raster" coordinates

Hi On 24 March 2010 06:27, Alexander Bruy wrote: > I have a georeferenced raster and coordinates of some point (lat, lon) > inside raster. Is it possible > to convert this lat/lon coordinates to raster coordinates (column and row)? > Use the geotransform (you may need to reproject your lat/lon

Re: [gdal-dev] elevation profile

Hi, On 16 February 2010 18:37, Michele Sanges wrote: > you have pointed me to a very interesting article, I think that bilinear > interpolation can be enough simple to implement. > I don't know what your setup is, but if you can use python and scipy in addition to gdal, you can: 1.- read the po

Re: [gdal-dev] Re: advice on using the moving average command

Hi, On 4 February 2010 08:16, Andrew Wood wrote: > For a third time, I am requesting assistance on the issue below. Does > anyone in this community know how to use the moving average command to > produce a grid from a CSV? > Have you read the section entitled "READING COMMA SEPARATED VALUES" o

Re: [gdal-dev] trying create a new SHP with Ogr2ogr from ODBC: SQL SERVER

Hi On 2 February 2010 17:11, Antonio Castillo wrote: > ogr2ogr -f "ESRI Shapefile" -a_srs "EPSG:4326" "puentes.shp" > "ODBC:INACMASQL" -nlt POINT -sql "SELECT > p.nombre,t.latitud,t.longitud,t.altura FROM puente p,trayectoria t WHERE > p.id_trajectory = t.id_trayectoria" I think your problem s

[gdal-dev] Convert raster from [0,360] to [-180,180]

Hi, I have some raster files spanning the globe from 0 to 360 degrees longitude. However, I would rather they be in the -180 to 180 degree range. While I can do this converting into VRTs and playing around with the SimpleSource element, I also saw a posting on this list that suggests that one can e

Re: [gdal-dev] Using RasterIO in Python to crop images

Hi, 2010/1/19 Roger André > Assuming that I have an 8bit, paletted image named "foo.png", if I wanted > to extract a 50 x 50 pixel tile that had it's origin at pixel coords (0,0), > I would do something like this: > > in_ds = gdal.Open('foo.png') > band = dataset.GetRasterBand(1) > tile_data = b

Re: [gdal-dev] GeoTiff Class Cell Counts

Hi, 2009/10/14 Seth Girvin > I can get statistics on my GeoTIFF which is great, but I need to get the > count of pixels in each class in the raster. > Ideally I want to get the count by a range e.g. 123787 cells between 0 - > 0.25, 3242353 cells between 0.25-0.5. Would I need to read through all

Re: [gdal-dev] Doing segment-wise statistics

Hiya, 2009/10/9 Peder Axensten > I'd like to do some segment-wise statistics (mean, standard deviation, > etc.) on rasters. > The segments will be defined by polygons in a shapefile. > I need to do this in a Python script, so anything without a GUI is fine. > > Is there a solution I can use? >

Re: [gdal-dev] calculate raster values within a vector

Hi, 2009/8/26 Dylan Beaudette > ndeed. The current (C++) version of Starspan is more or less unsupported. I > tend to use an older, stabler, version-- but have become frustrated with it > in recent studies. I think that the current maintainer Jon Greenberg is > working on an R implementation-- h

Re: [gdal-dev] calculate raster values within a vector

Hi, 2009/8/20 questions anon > Can anyone get me started on a script that can - > > -Open a shapefile > > -Open many rasters > > -Calculate the mean and standard deviation of those rasters within the > shapefile region, but is able to ignore areas of zeros or NoData > > -Output the mean and

Re: [gdal-dev] help with resampling via python

Hi Klokan, 2009/4/1 Klokan Petr Přidal > gdal.RegenerateOverview() with 'average' and 'mode' algorithms. > and > gdal.ReprojectImage() with 'bilinear','cubic','cubicspline' and > 'lanczos' algorithms. That's quite cool, but does RegenerateOverview() take into account NODATA values when doing t

Re: [gdal-dev] weeding out x,y,z points

Hi, 2009/2/26 Ari Jolma > nicholas.g.lawre...@mainroads.qld.gov.au wrote: > >> >>> Can GDAL or OGR weed out 3D points based on proximity to each other? >>> I would use plain Perl (or Python or high level language X) to read in > the points sequentially and discard new ones

[gdal-dev] Speeding up OGR in python

Hi, I am using the Python OGR bindings to create a shapefile with a regularly spaced grid over some multipolygons. I only want to have grid cells when the centroid of the cell falls within one of my multipolygons. My code is simple and rustic, but seems to be working. However, it is taking a long t

[gdal-dev] Re: EASE-grid projection

Hi, I know it's unpolite to reply to self, but I think I might have cracked this one. Comments welcomed... 2008/10/10 Jose Gomez-Dans <[EMAIL PROTECTED]> > > $ gdalwarp --debug on -of GTiff -s_srs "+proj=cea +lat_0=0 +lon_0=0 > +lat_ts=30 +a=6371228.0 +units=m&

[gdal-dev] EASE-grid projection

Hi, I am trying to wrap some EASE-grid data from NSIDC for global datasets. NSIDC says it is based on the Cylindrical Equal Area, and they do provide both an EPSG code for it (3410), as well as a Proj string: "+proj=cea +lat_0=0 +lon_0=0 +lat_ts=30 +a=6371228.0 +units=m" (see < http://nsidc.org/da

Re: [gdal-dev] Re: Trouble connecting to PostGIS db

Hi, 2008/10/3 Jukka Rahkonen <[EMAIL PROTECTED]> > > $ ogrinfo --debug on -ro 'PG:host=HOST user=USER password=PASSWORD > port=5432 > dbname=DBNAME' > > Try using " " around the connection string, instead of ' '. Nope, that doesn't change a thing. I am realising that my geometry_columns table i

[gdal-dev] Trouble connecting to PostGIS db

Hi, I have a remote PostGIS database on, say host. I can connect to it using QGIS and display data (it actually comes up with "Database connection was successful but no accessible tables were found. Please verify that you have SELECT privilege on a table carrying POSTGIS geometry", but it displays

Re: [gdal-dev] query raster values by xy-location

Hi, 2008/9/26 <[EMAIL PROTECTED]> > > I have an ESRI ascii raster and would like to get the raster values at > defined x y locations. > At the moment I am capable to load the Raster Dataset and can perform > several operations like querying the Min/Max values, the origin, the > pixelsize and so

Re: [gdal-dev] Best way to test wheter point is contained in Polygon

Chris, thanks for your comments 2008/9/25 Christopher Barker <[EMAIL PROTECTED]> > Perhaps cumbersome, but in fact, at some level, you are indeed doing a > rasterization with the P-in-P testing, as you are working with ALL the > pixels in your raster. I bet it would be a lot faster to rasterize t

[gdal-dev] Re: Best way to test wheter point is contained in Polygon

I reply to myself, to see if someone has any insights. 2008/9/22 Jose Gomez-Dans <[EMAIL PROTECTED]> > Hi, > I have a raster file and a vector file. I want to assign to each pixel in > my raster size a value derived from the vector file (which are polygons). To > do this, I wan

[gdal-dev] Best way to test wheter point is contained in Polygon

Hi, I have a raster file and a vector file. I want to assign to each pixel in my raster size a value derived from the vector file (which are polygons). To do this, I want to test that the centroid of my pixel lies within a given polygon. In the past, I have done this gdal_rasterize-ing the polygon