Re: [gdal-dev] Attribute filter on remote Parquet file is slow

Hi Even, Thanks for the suggestions. I've played around with it a bit more without much success. > No you didn't do anything obviously wrong. I'm not sure that in the > ArrowDataset mode libarrow actually uses group statistics to filter out > row groups, which might cause it to actually ingest th

Re: [gdal-dev] WRITE_BBOX not available in GeoJSONSeq lco options?

Hi Thomas, I can't think of a particular reason for not providing it. Option added in https://github.com/OSGeo/gdal/pull/10675 Even Le 29/08/2024 à 00:02, Thomas Gratier via gdal-dev a écrit : Hi, I needed to generate bbox at feature level in GeoJSONSeq when creating the output. I was surp

[gdal-dev] WRITE_BBOX not available in GeoJSONSeq lco options?

Hi, I needed to generate bbox at feature level in GeoJSONSeq when creating the output. I was surprised to not found the option in the driver https://gdal.org/en/latest/drivers/vector/geojsonseq.html#layer-creation-options whereas it's available for GeoJSON https://gdal.org/en/latest/drivers/vector

Re: [gdal-dev] Attribute filter on remote Parquet file is slow

I could be completely wrong here. My understanding is duckdb uses httpfs or possibly some variant of fsspec. I believe /vsis3 uses only libcurl, which doesn't *appear* to have support for httpfs. Again, I could be wildly wrong. On 8/28/24 09:45, Daniel Baston via gdal-dev wrote: Hello, I'm

Re: [gdal-dev] Attribute filter on remote Parquet file is slow

Dan, No you didn't do anything obviously wrong. I'm not sure that in the ArrowDataset mode libarrow actually uses group statistics to filter out row groups, which might cause it to actually ingest the whole files You may also try to tune the config options at https://github.com/OSGeo/gdal/bl

[gdal-dev] Attribute filter on remote Parquet file is slow

Hello, I'm trying to use ogr2ogr with an attribute filter to pull 14 polygons from Overture maps. Running the following command with CPL_DEBUG=ON tells me that "PARQUET: Attribute filter fully translated to Arrow" yet it takes about 7 minutes to complete, and appears to download quite a bit of dat

Re: [gdal-dev] GDAL WMTS detecting errors

In other words, is there a way to remove http content from CPL error message? śr., 28 sie 2024 o 18:04 Michał Kowalczuk napisał(a): > Sorry, my bad! > I missed to check output CPL Error from GdalRasterIO 🤦 > > You mentioned about *ZeroBlockHttpCodes *property. Can I set it > programmatically, as

Re: [gdal-dev] GDAL WMTS detecting errors

Sorry, my bad! I missed to check output CPL Error from GdalRasterIO 🤦 You mentioned about *ZeroBlockHttpCodes *property. Can I set it programmatically, as a configuration option? As always great thank you! śr., 28 sie 2024 o 17:51 Even Rouault napisał(a): > > Le 28/08/2024 à 17:41, Michał Kowa

Re: [gdal-dev] GDAL WMTS detecting errors

Le 28/08/2024 à 17:41, Michał Kowalczuk a écrit : Yes, but if you use C API function GdalRasterDatasetIO you don’t get error. I noticed this error only in gdal logger. How I can catch this error at runtime in code? Really? That looks doubtful to me, because I don't see how gdal_translate would

Re: [gdal-dev] GDAL WMTS detecting errors

Yes, but if you use C API function GdalRasterDatasetIO you don’t get error. I noticed this error only in gdal logger. How I can catch this error at runtime in code? W dniu śr., 28.08.2024 o 17:38 Even Rouault napisał(a): > > Le 28/08/2024 à 17:26, Michał Kowalczuk a écrit : > > First produces c

Re: [gdal-dev] GDAL WMTS detecting errors

Le 28/08/2024 à 17:26, Michał Kowalczuk a écrit : First produces correct output /gdal_translate -srcwin 33492026 20550638 8019970 4412002 -outsize 1576 867 "WMTS:https://basemap.nationalmap.gov/arcgis/rest/services/USGSImageryOnly/MapServer/WMTS/1.0.0/WMTSCapabilities.xml,layer=USGSImageryOnly

Re: [gdal-dev] GDAL WMTS detecting errors

First produces correct output *gdal_translate -srcwin 33492026 20550638 8019970 4412002 -outsize 1576 867 "WMTS:https://basemap.nationalmap.gov/arcgis/rest/services/USGSImageryOnly/MapServer/WMTS/1.0.0/WMTSCapabilities.xml,layer=USGSImageryOnly,tilematrixset=GoogleMapsCompatible

Re: [gdal-dev] GDAL WMTS detecting errors

If you could provide a gdal_translate command line reproducing the issue (likely using -srcwin + -outsize or -srcwin + -ovr to select the appropriate tile), that would make investigation easier Le 28/08/2024 à 16:52, Michał Kowalczuk via gdal-dev a écrit : Dear GDAL friends, any thoughts on th

Re: [gdal-dev] GDAL WMTS detecting errors

Dear GDAL friends, any thoughts on this issue? Regards, Michał wt., 27 sie 2024 o 17:40 Michał Kowalczuk napisał(a): > Hi! > I'm wondering if the last issue 10348 was fully solved. > Try use the following WMTS server and to zoom to level 9-10, e.g. small > island in the Mediterranean > > > http