Re: [gdal-dev] mssql import speed

2018-05-13 Thread Tamas Szekeres
Hi Martin, Thanks for the data. Fixed this one in this PR: https://github.com/OSGeo/gdal/pull/621 Best regards, Tamas 2018-05-12 21:59 GMT+02:00 Martin Landa : > Hi, > > 2018-05-12 16:17 GMT+02:00 Tamas Szekeres : > > Can I get the sample data for this? > > sure [1]. > > > Looks like more tha

Re: [gdal-dev] mssql import speed

2018-05-12 Thread Martin Landa
Hi, 2018-05-12 16:17 GMT+02:00 Tamas Szekeres : > Can I get the sample data for this? sure [1]. > Looks like more than one table is set "IDENTITY_INSERT ON" at the same time. Steps to reproduce (tested with SQL Server 2014): 1) create new mssql db 2) C:\OSGeo4W64/apps/gdal-dev/bin/ogr2ogr -f M

Re: [gdal-dev] mssql import speed

2018-05-12 Thread Tamas Szekeres
Hi Martin, Can I get the sample data for this? Looks like more than one table is set "IDENTITY_INSERT ON" at the same time. Best regards, Tamas 2018-05-12 16:10 GMT+02:00 Martin Landa : > Hi, > > 2018-05-12 15:51 GMT+02:00 Martin Landa : > > > ERROR 1: Failed to set identity insert on layer,

Re: [gdal-dev] mssql import speed

2018-05-12 Thread Martin Landa
Hi, 2018-05-12 15:51 GMT+02:00 Martin Landa : > ERROR 1: Failed to set identity insert on layer, [Microsoft][SQL Server > Native C > lient 11.0][SQL Server]IDENTITY_INSERT is already ON for table 'kn2.dbo.par'. > Ca > nnot perform SET operation for table 'dbo.bud'.. > ERROR 1: Unable to write f

Re: [gdal-dev] mssql import speed

2018-05-12 Thread Martin Landa
Hi, 2018-05-11 23:51 GMT+02:00 Martin Landa : >> --config GDAL_DRIVER_PATH C:\OSGeo4W64\apps\gdal-dev\bin\gdalplugins >> >> In progress, Ma > > works like a charm, from 3 hours to 3 minutes! Thanks for packaging > gdal-mss :-) Ma well, after solving BCP issue, I have another, on empty DB the com

Re: [gdal-dev] mssql import speed

2018-05-11 Thread Martin Landa
2018-05-11 23:36 GMT+02:00 Martin Landa : > --config GDAL_DRIVER_PATH C:\OSGeo4W64\apps\gdal-dev\bin\gdalplugins > > In progress, Ma works like a charm, from 3 hours to 3 minutes! Thanks for packaging gdal-mss :-) Ma -- Martin Landa http://geo.fsv.cvut.cz/gwiki/Landa http://gismentors.cz/mentor

Re: [gdal-dev] mssql import speed

2018-05-11 Thread Martin Landa
Hi, 2018-05-11 23:15 GMT+02:00 Martin Landa : > I missed on testing Windows server to install gdal-dev-mss package. > But unfortunately, no improvement. BCP is still not working in my oh, sorry for noise, I forgot to define --config GDAL_DRIVER_PATH C:\OSGeo4W64\apps\gdal-dev\bin\gdalplugins I

Re: [gdal-dev] mssql import speed

2018-05-11 Thread Martin Landa
Hi, 2018-05-11 9:10 GMT+02:00 Martin Landa : I missed on testing Windows server to install gdal-dev-mss package. But unfortunately, no improvement. BCP is still not working in my case. I tried all available drivers, same behaviour, I am getting to be lost. Martin -- Martin Landa http://geo.fsv.

Re: [gdal-dev] mssql import speed

2018-05-11 Thread Martin Landa
Hi, 2018-05-10 19:18 GMT+02:00 Martin Landa : > It took more than 3hours! Tested on Windows computer with SQL Server > 2012. I used SQL Server Native Client 11.0. sorry, typo, I have SQL Server 2014. Ma -- Martin Landa http://geo.fsv.cvut.cz/gwiki/Landa http://gismentors.cz/mentors/landa __

Re: [gdal-dev] mssql import speed

2018-05-10 Thread Tamas Szekeres
Hi Martin, Try to check in the SQL profiler that the BCP was successfully enabled and not plain insert statements are executed. (ie. the BCP enabled plugin was loaded) If BCP was enabled you might also try to load data on the server machine, so the network doesn't limit the bandwidth. Otherwise w

[gdal-dev] mssql import speed

2018-05-10 Thread Martin Landa
Hi, I wonder how to speed up import to MSSQL. I have testing SQLite DB (~1GB) with 48 tables (overall number of records 11e6). I started with $ ogr2ogr -f MSSQLSpatial MSSQL:... test.db It took more than 3hours! Tested on Windows computer with SQL Server 2012. I used SQL Server Native Client 11.