Re: [gdal-dev] gdal_merge tries create 377 GB raster

2022-12-12 Thread Rahkonen Jukka
Hi, It looks like the Python script gdal_merge.py wants to read all the data into a single array, and that is a big array because the image that covers the whole world with Pixel Size = (0.0008000,-0.0008000) is big, 45 by 225000 pixels. Probably gdal_merge is not the right

[gdal-dev] gdal_merge tries create 377 GB raster

2022-12-12 Thread Clive Swan
/data/coastal.tif should be 6.9GB I get weird output from gdal_merge?? gdal_merge.py -o /data/coastal.tif -n - -co BIGTIFF=YES -co COMPRESS=LZW -co BLOCKXSIZE=128 -co BLOCKYSIZE=128 -co NUM_THREADS=ALL_CPUS --config CPL_VSIL_USE_TEMP_FILE_FOR_RANDOM_WRITE YES --config GDAL_SWATH_SIZE 1

Re: [gdal-dev] File Size Output is wrong --

2022-12-12 Thread Clive Swan
Files: /data/coastal-undefended-rcp26-2020.vrt /vsis3/summer-outputs/3_data_ready_for_spectra/coastal-undefended-rcp26-2020.tif /vsis3/summer-outputs/5_UK_prod_rasters/coastal-undefended-rcp26-2020.tif Size is 45, 225000 Coordinate System is: GEOGCRS["WGS 84", DATUM["World Geodetic Sys

Re: [gdal-dev] Ogr2ogr: when both -update and -append is needed?

2022-12-12 Thread Even Rouault
Lng time ago you need to add both, but nowadays -append automatically enables -update. Just clarified it in https://github.com/OSGeo/gdal/commit/480456769abc11daae065bd112cb7361aa618636 Le 12/12/2022 à 21:25, Rahkonen Jukka a écrit : Hi, I saw this question https://gis.stackexchange.com

[gdal-dev] Ogr2ogr: when both -update and -append is needed?

2022-12-12 Thread Rahkonen Jukka
Hi, I saw this question https://gis.stackexchange.com/questions/447359/what-is-the-effect-of-using-update-when-merging-geojsons-with-ogr2ogr and started to think when the ogr2ogr option -update is needed even when the -append option is used. At least for some drivers -append alone seems to be

Re: [gdal-dev] File Size Output is wrong --

2022-12-12 Thread Javier Jimenez Shaw
gdalinfo of the three files (two inputs and one output) may help to understand better the conditions. One option is that file A is not compressed, while the output is LZW. .___ ._ ..._ .. . ._. .___ .. __ . _. . __.. ... ._ .__ Entre dos pensamientos racionales hay infinitos pensamientos irr

[gdal-dev] File Size Output is wrong --

2022-12-12 Thread Clive Swan
Greetings, I am writing the output on the local AWS Instance to avoid write permissions error, then copying to a Bucket. I get an error message if I leave out --config GDAL_SWATH_SIZE 100 I want to merge File A into File B, updating the 6GB file. The output is 622MB NOT 6GB?? (A) /vsis3/summe

Re: [gdal-dev] [EXTERNAL] Re: SQL query to set column to GPKG raster pixel value of point intersection result

2022-12-12 Thread Even Rouault
You don't necessarily need to pass a literal value. That can be combined with any other SQLite function that return the appropriate data type, like Spatialite functions: https://www.gaia-gis.it/gaia-sins/spatialite-sql-5.0.1.html Le 12/12/2022 à 15:47, Meyer, Jesse R. (GSFC-618.0)[SCIENCE SYST

Re: [gdal-dev] [EXTERNAL] Re: SQL query to set column to GPKG raster pixel value of point intersection result

2022-12-12 Thread Meyer, Jesse R. (GSFC-618.0)[SCIENCE SYSTEMS AND APPLICATIONS INC] via gdal-dev
Sorry for the spam – I meant the last message to be a question. The tests so far only account for explicitly provided values in the query string. From: gdal-dev on behalf of "Meyer, Jesse R. (GSFC-618.0)[SCIENCE SYSTEMS AND APPLICATIONS INC] via gdal-dev" Reply-To: "Meyer, Jesse R. (GSFC-618

Re: [gdal-dev] [EXTERNAL] Re: SQL query to set column to GPKG raster pixel value of point intersection result

2022-12-12 Thread Meyer, Jesse R. (GSFC-618.0)[SCIENCE SYSTEMS AND APPLICATIONS INC] via gdal-dev
Thanks Even, this looks good! In my case, then the SQL query should resemble something like `select gdal_get_layer_pixel_value('byte', 1, 'georef', ST_X(geom), ST_Y(geom))` Where `geom` is a centroid. From: Even Rouault Date: Thursday, December 8, 2022 at 5:04 PM To: "Meyer, Jesse R. (GSFC-618

Re: [gdal-dev] ERROR 13: The specified key does not exist

2022-12-12 Thread Michael Smith
Clive, A solution to this is to use a GDAL configuration file that will allow you to set per path options for your authentication, allowing you to use one set of credentials for read and one for write. See https://gdal.org/user/configoptions.html#gdal-configuration-file Starting with GDA

Re: [gdal-dev] ERROR 13: The specified key does not exist

2022-12-12 Thread Clive Swan
Greetings, The problem was writing directly from one AWS instance to another. I have to write to the local instance, than copy to the other instance. Thanks Clive On Mon, 12 Dec 2022 at 09:57, Andrew C Aitchison wrote: > On Mon, 12 Dec 2022, Clive Swan wrote: > > > Greetings, > > > > I have be

[gdal-dev] Motion: adopt RFC89: SQL query logging callback

2022-12-12 Thread ElPaso
Hi, Motion: Adopt  RFC89: SQL query logging callback [1] A draft implementation is available at [2]. An example of how client code could make use of this new functionality is avaiable for QGIS at [3]. Kind regards. [1] https://github.com/OSGeo/gdal/pull/6837 [2] https://github.com/elpas

Re: [gdal-dev] ERROR 13: The specified key does not exist

2022-12-12 Thread Rahkonen Jukka
Hi, Please show the whole command that you used. That way it is much easier to find out the error in your syntax. -Jukka Rahkonen- Lähettäjä: gdal-dev Puolesta Clive Swan Lähetetty: maanantai 12. joulukuuta 2022 13.06 Vastaanottaja: gdal-dev@lists.osgeo.org Aihe: [gdal-dev] ERROR 13: The speci

[gdal-dev] ERROR 13: The specified key does not exist

2022-12-12 Thread Clive Swan
I reran the gdal_translate command using tif, not the .vrt. Now I get* ERROR: *too many commands I need to specify -co BIGTIFF=YES -co COMPRESS=LZW -co BLOCKXSIZE=128 -co BLOCKYSIZE=128 -co NUM_THREADS=ALL_CPUS --config GDAL_CACHEMAX 10 --config CPL_TMPDIR /data/tmp --config CPL_VSIL_USE_TEMP

[gdal-dev] ERROR 13: The specified key does not exist

2022-12-12 Thread Clive Swan
I deleted all the vrt files, in case the error was related to the bucket/key relationship. The AWS key has not been updated. I reran the script again, I am still getting a permissions error?? *ERROR 4:* Attempt to create new tiff file `/vsis3/summer-outputs/5/coastal.tif' failed: Permission deni

[gdal-dev] ERROR 13: The specified key does not exist

2022-12-12 Thread Clive Swan
Greetings, I have been using the security details for weeks, now getting an odd error. AWS_ACCESS_KEY_ID AWS_SECRET_ACCESS_KEY *ERROR 4:* Attempt to create new tiff file `/vsis3/summer-outputs/3/coastal- -2020.tif' failed: Permission denied Input file size is 45, 225000*ERROR 13*: The specifie