Re: [gdal-dev] Ogr2ogr taking too much time to process a MapInfo TAB file

2022-07-28 Thread Daniel Morissette
I confirm that the structure of the TAB dataset uses 512 bytes data blocks organized in a tree structure, so reading from the file implies lots of random access over the whole file even if you read the features sequentially since a single feature is stored in multiple data blocks of various typ

Re: [gdal-dev] Ogr2ogr taking too much time to process a MapInfo TAB file

2022-07-27 Thread Even Rouault
Moises, I've not reviewed in depth the MITAB driver, but reading from a .tab file may require random access, and it is thus not surprising that reading from a compressed file may exhibit poor performance. You might try to set the VSI_CACHE config option / env variable to YES, but no guarantee

[gdal-dev] Ogr2ogr taking too much time to process a MapInfo TAB file

2022-07-27 Thread Moises Calzado via gdal-dev
Hi everyone! We're using ogr2ogr to convert MapInfo TAB files into CSV format using the following command: ogr2ogr -f CSV -skipfailures -makevalid /vsistdout/ /vsizip/onLDU.zip -oo > AUTODETECT_TYPE=YES -lco CREATE_CSVT=YES > test_2.csv The file weights ≈200 MB and the process is taking too mu