Not sure where I copied them from. Removed them and got this: org.apache.solr.common.SolrException: ERROR: [doc=2] Error adding field 'wtarea'='POLYGON ((-8305909.7574040433 4941767.8208926441, -8307132.7498566061 5038384.224645081, -8154258.6932862941 4965004.6774913315, -8305909.7574040433 4941767.8208926441))' msg=Y values [-1.7976931348623157E308 to Infinity] not in boundary Rect(minX=-1.7976931348623157E308,maxX=1.7976931348623157E308,minY=-1.7976931348623157E308,maxY=1.7976931348623157E308) at org.apache.solr.update.DocumentBuilder.toDocument(DocumentBuilder.java:167) at org.apache.solr.update.AddUpdateCommand.getLuceneDocument(AddUpdateCommand.java:77) at org.apache.solr.update.DirectUpdateHandler2.addDoc0(DirectUpdateHandler2.java:238) at org.apache.solr.update.DirectUpdateHandler2.addDoc(DirectUpdateHandler2.java:164) at org.apache.solr.update.processor.RunUpdateProcessor.processAdd(RunUpdateProcessorFactory.java:69) at org.apache.solr.update.processor.UpdateRequestProcessor.processAdd(UpdateRequestProcessor.java:51) at org.apache.solr.update.processor.DistributedUpdateProcessor.doLocalAdd(DistributedUpdateProcessor.java:870) at org.apache.solr.update.processor.DistributedUpdateProcessor.versionAdd(DistributedUpdateProcessor.java:1024) at org.apache.solr.update.processor.DistributedUpdateProcessor.processAdd(DistributedUpdateProcessor.java:693) at org.apache.solr.update.processor.LogUpdateProcessor.processAdd(LogUpdateProcessorFactory.java:100) at org.apache.solr.handler.dataimport.SolrWriter.upload(SolrWriter.java:71) at org.apache.solr.handler.dataimport.DataImportHandler$1.upload(DataImportHandler.java:261) at org.apache.solr.handler.dataimport.DocBuilder.buildDocument(DocBuilder.java:496) at org.apache.solr.handler.dataimport.DocBuilder.buildDocument(DocBuilder.java:400) at org.apache.solr.handler.dataimport.DocBuilder.doFullDump(DocBuilder.java:315) at org.apache.solr.handler.dataimport.DocBuilder.execute(DocBuilder.java:223) at org.apache.solr.handler.dataimport.DataImporter.doFullImport(DataImporter.java:411) at org.apache.solr.handler.dataimport.DataImporter.runCmd(DataImporter.java:483) at org.apache.solr.handler.dataimport.DataImporter$1.run(DataImporter.java:464) Caused by: com.spatial4j.core.exception.InvalidShapeException: Y values [-1.7976931348623157E308 to Infinity] not in boundary Rect(minX=-1.7976931348623157E308,maxX=1.7976931348623157E308,minY=-1.7976931348623157E308,maxY=1.7976931348623157E308) at com.spatial4j.core.context.SpatialContext.makeRectangle(SpatialContext.java:218) at org.apache.lucene.spatial.prefix.tree.QuadPrefixTree$QuadCell.makeShape(QuadPrefixTree.java:300) at org.apache.lucene.spatial.prefix.tree.QuadPrefixTree$QuadCell.getShape(QuadPrefixTree.java:266) at org.apache.lucene.spatial.prefix.tree.Cell.<init>(Cell.java:69) at org.apache.lucene.spatial.prefix.tree.QuadPrefixTree$QuadCell.<init>(QuadPrefixTree.java:223) at org.apache.lucene.spatial.prefix.tree.QuadPrefixTree.getCell(QuadPrefixTree.java:151) at org.apache.lucene.spatial.prefix.tree.SpatialPrefixTree.getWorldCell(SpatialPrefixTree.java:113) at org.apache.lucene.spatial.prefix.tree.SpatialPrefixTree.getCells(SpatialPrefixTree.java:169) at org.apache.lucene.spatial.prefix.PrefixTreeStrategy.createIndexableFields(PrefixTreeStrategy.java:129) at org.apache.lucene.spatial.prefix.PrefixTreeStrategy.createIndexableFields(PrefixTreeStrategy.java:124) at org.apache.solr.schema.AbstractSpatialFieldType.createFields(AbstractSpatialFieldType.java:149) at org.apache.solr.update.DocumentBuilder.addField(DocumentBuilder.java:47) at org.apache.solr.update.DocumentBuilder.toDocument(DocumentBuilder.java:118)
So now I think I have to update the parameters in my fieldType definition right? <fieldType name="location_rpt" class="solr.SpatialRecursivePrefixTreeFieldType" spatialContextFactory="com.spatial4j.core.context.jts.JtsSpatialContextFactory" geo="false" distErrPct="0.025" maxDistErr="0.000009" units="degrees" /> Alex Bostic GIS Developer URS Corporation 12420 Milestone Center Drive, Suite 150 Germantown, MD 20876 direct line: 301-820-3287 cell line: 301-213-2639 -----Original Message----- From: david.w.smi...@gmail.com [mailto:david.w.smi...@gmail.com] Sent: Saturday, August 23, 2014 11:22 PM To: solr-user@lucene.apache.org Subject: Re: Indexing and Querying MS SQL Server 2012 Spatial What’s with the double square brackets around your WKT? Remove them. ~ David Smiley Freelance Apache Lucene/Solr Search Consultant/Developer http://www.linkedin.com/in/davidwsmiley On Sat, Aug 23, 2014 at 10:37 PM, Bostic, Alex <alex.bos...@urs.com> wrote: > Hello, now that I have the WKT in a sting field, I get this during the > dataimport process > > org.apache.solr.common.SolrException: Couldn't parse shape '[[POLYGON > ((-8134690.8140452942 4866553.78506005, -7836280.655620046 4884898.671848488, > -8009945.58388392 4732024.615278176, -8134690.8140452942 > 4866553.78506005))]]]' because: For input string: "[[POLYGON > ((-8134690.8140452942 4866553.78506005" > at > org.apache.solr.schema.AbstractSpatialFieldType.parseShape(AbstractSpatialFieldType.java:175) > at > org.apache.solr.schema.AbstractSpatialFieldType.createFields(AbstractSpatialFieldType.java:139) > at > org.apache.solr.update.DocumentBuilder.addField(DocumentBuilder.java:47) > at > org.apache.solr.update.DocumentBuilder.toDocument(DocumentBuilder.java:118) > at > org.apache.solr.update.AddUpdateCommand.getLuceneDocument(AddUpdateCommand.java:77) > at > org.apache.solr.update.DirectUpdateHandler2.addDoc0(DirectUpdateHandler2.java:238) > at > org.apache.solr.update.DirectUpdateHandler2.addDoc(DirectUpdateHandler2.java:164) > at > org.apache.solr.update.processor.RunUpdateProcessor.processAdd(RunUpdateProcessorFactory.java:69) > at > org.apache.solr.update.processor.UpdateRequestProcessor.processAdd(UpdateRequestProcessor.java:51) > at > org.apache.solr.update.processor.DistributedUpdateProcessor.doLocalAdd(DistributedUpdateProcessor.java:870) > at > org.apache.solr.update.processor.DistributedUpdateProcessor.versionAdd(DistributedUpdateProcessor.java:1024) > at > org.apache.solr.update.processor.DistributedUpdateProcessor.processAdd(DistributedUpdateProcessor.java:693) > at > org.apache.solr.update.processor.LogUpdateProcessor.processAdd(LogUpdateProcessorFactory.java:100) > at > org.apache.solr.handler.dataimport.SolrWriter.upload(SolrWriter.java:71) > at > org.apache.solr.handler.dataimport.DataImportHandler$1.upload(DataImportHandler.java:261) > at > org.apache.solr.handler.dataimport.DocBuilder.buildDocument(DocBuilder.java:496) > at > org.apache.solr.handler.dataimport.DocBuilder.buildDocument(DocBuilder.java:400) > at > org.apache.solr.handler.dataimport.DocBuilder.doFullDump(DocBuilder.java:315) > at > org.apache.solr.handler.dataimport.DocBuilder.execute(DocBuilder.java:223) > at > org.apache.solr.handler.dataimport.DataImporter.doFullImport(DataImporter.java:411) > at > org.apache.solr.handler.dataimport.DataImporter.runCmd(DataImporter.java:483) > at > org.apache.solr.handler.dataimport.DataImporter$1.run(DataImporter.jav > a:464) Caused by: java.lang.NumberFormatException: For input string: > "[[POLYGON ((-8134690.8140452942 4866553.78506005" > at sun.misc.FloatingDecimal.readJavaFormatString(Unknown Source) > at java.lang.Double.parseDouble(Unknown Source) > at > com.spatial4j.core.io.ParseUtils.parsePointDouble(ParseUtils.java:108) > at > com.spatial4j.core.io.ParseUtils.parseLatitudeLongitude(ParseUtils.java:145) > at > com.spatial4j.core.io.ParseUtils.parseLatitudeLongitude(ParseUtils.java:137) > at > com.spatial4j.core.io.LegacyShapeReadWriterFormat.readLatCommaLonPoint(LegacyShapeReadWriterFormat.java:169) > at > com.spatial4j.core.io.LegacyShapeReadWriterFormat.readShapeOrNull(LegacyShapeReadWriterFormat.java:153) > at > org.apache.solr.schema.AbstractSpatialFieldType.parseShape(AbstractSpa > tialFieldType.java:167) > > my field type is defined as follows > <fieldType name="location_rpt" > class="solr.SpatialRecursivePrefixTreeFieldType" > spatialContextFactory="com.spatial4j.core.context.jts.JtsSpatialContextFactory" > geo="false" distErrPct="0.025" maxDistErr="0.000009" > units="degrees" /> > > Alex Bostic > GIS Developer > URS Corporation > 12420 Milestone Center Drive, Suite 150 Germantown, MD 20876 direct > line: 301-820-3287 cell line: 301-213-2639 > > > -----Original Message----- > From: Bostic, Alex [mailto:alex.bos...@urs.com] > Sent: Saturday, August 23, 2014 2:27 PM > To: solr-user@lucene.apache.org > Subject: RE: Indexing and Querying MS SQL Server 2012 Spatial > > Thanks I will try for a correct install. I have many other fields that are > indexing fine, I will inspect for further errors and use DIH debug mode. I > will also create a string field for geometries. > > One item to note is that the spatial data is stored in sql servers geometry > type field. Only through the DIH query do I return WKT, maybe that's the > issue. > ________________________________________ > From: david.w.smi...@gmail.com [david.w.smi...@gmail.com] > Sent: Saturday, August 23, 2014 2:03 PM > To: solr-user@lucene.apache.org > Subject: Re: Indexing and Querying MS SQL Server 2012 Spatial > > Putting JTS where you put it is fine temporarily but I strongly recommend > against any jar being placed there at all; ideally it should be associated > with the Solr installation; not with java itself. > > Some kinda of errors must be happening but you're not seeing them. I presume > you've configured the DIH since you're telling me your hitting its button in > the UI. The DIH has a debug mode; it's been a while since I used the DIH > last but I remember that feature being really useful. > > For the sake of troubleshooting, try putting the geometries (WKT) into a > "string" field, then you should see them. If not then you're current problem > is squarely with the import process/config, not with Solr spatial. > ~ David Smiley > Freelance Apache Lucene/Solr Search Consultant/Developer > http://www.linkedin.com/in/davidwsmiley > > > On Sat, Aug 23, 2014 at 10:53 AM, Bostic, Alex <alex.bos...@urs.com> wrote: >> Ok thanks, I am even closer >> >> I put jts-1.13.jar here C:\Program Files (x86)\Java\jre7\lib\ext >> >> And removed it from the cmd line when starting solr >> >> I no longer get the class not found issues. I removed the jar from the >> above location and got the error again, so I put it back to confirm I'm past >> the Not Found issue. >> >> My core appears to startup fine, >> >> I select my core in the browser manager and Execute a full-import >> with Clean and Commit checked. That appears to go well. However, I >> still don't see my geom field as part of my index >> >> I do ALSO have the jar in >> C:\AddSoftware\solr-4.9.0\ocsirasspatial\solr-webapp\webapp\WEB-INF\l >> i >> b >> >> Any other hints are certainly welcome. I think I'm close >> >> Alex Bostic >> GIS Developer >> URS Corporation >> 12420 Milestone Center Drive, Suite 150 Germantown, MD 20876 direct >> line: 301-820-3287 cell line: 301-213-2639 >> >> >> -----Original Message----- >> From: david.w.smi...@gmail.com [mailto:david.w.smi...@gmail.com] >> Sent: Saturday, August 23, 2014 9:15 AM >> To: solr-user@lucene.apache.org >> Subject: Re: Indexing and Querying MS SQL Server 2012 Spatial >> >> The jts-1.13.jar file (other JTS jars that come with it aren't used) needs >> to go on the java classpath. I haven't tried to do it using the way you're >> doing it. Note that the "lib" directories Solr manages won't work for some >> jar's like this one. I forget but I think putting it in examples/lib works. >> Unpacking the WAR and putting it in WEB-INF/lib definitely works. >> ~ David Smiley >> Freelance Apache Lucene/Solr Search Consultant/Developer >> http://www.linkedin.com/in/davidwsmiley >> >> >> On Sat, Aug 23, 2014 at 4:36 AM, Bostic, Alex <alex.bos...@urs.com> wrote: >>> Ok, I was missing >>> spatialContextFactory="com.spatial4j.core.context.jts.JtsSpatialContextFactory" >>> >>> >>> Now I am getting >>> >>> Error loading core:java.util.concurrent.ExecutionException: >>> java.lang.NoClassDefFoundError: >>> com/vividsolutions/jts/geom/CoordinateSequenceFactory >>> >>> Any help resolving my path issues would be great >>> >>> Alex Bostic >>> GIS Developer >>> URS Corporation >>> 12420 Milestone Center Drive, Suite 150 Germantown, MD 20876 direct >>> line: 301-820-3287 cell line: 301-213-2639 >>> >>> >>> -----Original Message----- >>> From: Bostic, Alex [mailto:alex.bos...@urs.com] >>> Sent: Saturday, August 23, 2014 3:53 AM >>> To: solr-user@lucene.apache.org >>> Subject: RE: Indexing and Querying MS SQL Server 2012 Spatial >>> >>> Hello, I guess I'm closer. But my geom field does not show up in the index. >>> >>> I have a table full of polys, stored as SQL Server Geometry Type. >>> >>> Taken from the example schema I have: >>> .. >>> <field name="geom" type="location_rpt" indexed="true" stored="true"/> .. >>> >>> In my data-config.xml I have: >>> <entity name="data" dataSource="ds1" pk="key" >>> query="SELECT wt.Id, wt.Name, >>> wt.WorkTypeTypeId,wt.ChildId,wt.CreatedDate,wt.ModifiedDate,wt.Year, >>> wta.GEOM.STAsText(), wta.OBJECTID >>> FROM dbo.WorkTypes wt Inner Join dbo.WorkTypeAreas wta ON wt.Id = >>> wta.WorkTypeId"> >>> <field column="Id" name="id" /> >>> <field column="ChildId" name="childid" /> >>> <field column="WorkTypeTypeId" name="worktypetypeid" /> >>> <field column="Name" name="name" /> >>> <field column="CreatedDate" name="createddate" /> >>> <field column="ModifiedDate" name="modifieddate" /> >>> <field column="UserId" name="userid" /> >>> <field column="Year" name="year" /> >>> <field column="GEOM" name="geom" /> >>> <field column="OBJECTID" name="objectid" /> >>> </entity> >>> >>> OBJECTID shows up fine in my updated index, gut GEOM does not. The >>> index was successful and I don't see any errors in the console or >>> the log (from the web) >>> >>> I am starting solr like so: >>> java -Dsolr.solr.home=c:\AddedSoftware\solr-4.90\ocsirasspatial\solr >>> -Djetty.class.path=c:\AddedSoftware\solr-4.9.0\jts-1.13\lib -jar >>> start.jar >>> >>> Based on the above, what am I missing to get this to work. Maybe I am >>> overlooking an issue in the console? >>> >>> Thanks >>> >>> >>> Alex Bostic >>> GIS Developer >>> URS Corporation >>> 12420 Milestone Center Drive, Suite 150 Germantown, MD 20876 direct >>> line: 301-820-3287 cell line: 301-213-2639 >>> >>> >>> -----Original Message----- >>> From: Bostic, Alex [mailto:alex.bos...@urs.com] >>> Sent: Wednesday, August 20, 2014 4:41 PM >>> To: solr-user@lucene.apache.org >>> Subject: RE: Indexing and Querying MS SQL Server 2012 Spatial >>> >>> Ok Great, I'm just going to dive in and see if I can index my data. Does >>> spatial reference matter? >>> >>> Alex Bostic >>> GIS Developer >>> URS Corporation >>> 12420 Milestone Center Drive, Suite 150 Germantown, MD 20876 direct >>> line: 301-820-3287 cell line: 301-213-2639 >>> >>> >>> -----Original Message----- >>> From: Pires, Guilherme [mailto:guilherme.pi...@cgi.com] >>> Sent: Wednesday, August 20, 2014 4:30 PM >>> To: solr-user@lucene.apache.org >>> Subject: RE: Indexing and Querying MS SQL Server 2012 Spatial >>> >>> Hello, >>> >>> I've been working with Solr together with JTS and use location_rpt >>> class for the geometry field for a while now. (However, I must say >>> that the index grew a lot when used this class instead of the >>> geohash for simple points ..so use it only if you really need to >>> index polylines and/or polygons) >>> >>> I actually already successfully connected solr to postGis and oracle >>> spatial via DIH but in this live website ( http://cascaismap.com ) we had a >>> GE Smallworld as the GIS system so it was easier just to build a sync >>> engine that periodically queries differences from the GIS and push them >>> into solr via xml document. This project has already couple of years now so >>> a lot would be different now. >>> >>> In that website, solr provides, obviously, all the text search on the top >>> and also 70% of the themes available on the treeview on the left (expand in >>> the red button) that are result of a bounding box query to geometry index >>> in solr. >>> Something like this : (...)q=bounds:Intersects(-9.463118366688718 >>> 38.67913579372146 -9.370549969166746 38.7109390712568)(...) >>> >>> After this, we actually provided for a different project, a similar sync >>> mechanism but between in-house solr instances and google maps engine >>> datastore in the cloud and it works like a charm. >>> >>> Guilherme Pires >>> Geospatial Intelligence @ CGI >>> guilherme.pi...@cgi.com >>> >>> ________________________________________ >>> De: david.w.smi...@gmail.com [david.w.smi...@gmail.com] >>> Enviado: quarta-feira, 20 de Agosto de 2014 18:49 >>> Para: solr-user@lucene.apache.org >>> Assunto: Re: Indexing and Querying MS SQL Server 2012 Spatial >>> >>> Hi Alex, >>> >>> I guess a spatial tutorial might be helpful, but there isn't one. There is >>> a sample at the Lucene-spatial layer but not up at Solr. You need to use >>> WKT syntax for line's and polys, and you may do so as well for other >>> shapes. And in the schema use location_rpt copied from Solr's example >>> schema for starters, but modified as the ref guide & wiki show to use JTS. >>> The ref guide, wiki, and I would guess that book should show how to to a >>> bounding box query using {!bbox} - it's pretty simple. >>> >>> ~ David Smiley >>> Freelance Apache Lucene/Solr Search Consultant/Developer >>> http://www.linkedin.com/in/davidwsmiley >>> >>> >>> On Tue, Aug 19, 2014 at 11:25 AM, Bostic, Alex <alex.bos...@urs.com> wrote: >>> >>>> Hello I'm new to Solr: >>>> I have a SQL Server 2012 database with spatial columns >>>> (points/lines/polys) Do you have any resources to point to for the >>>> following Creating a Solr index of a sql server spatial table >>>> Bounding Box query (intersect) example, possibly with front-end >>>> from GMaps or OpenLayers I'm currently reading Apache Solr >>>> Beginner's Guide and have reviewed >>>> https://wiki.apache.org/solr/SolrAdaptersForLuceneSpatial4 >>>> I am able to index and query my non spatial data, I am just looking >>>> for some resource that may have some more detail about how to set >>>> everything up. >>>> I can provide more detail if needed. >>>> Thanks >>>> >>>> Alex Bostic >>>> GIS Developer >>>> URS Corporation >>>> 12420 Milestone Center Drive, Suite 150 Germantown, MD 20876 direct >>>> line: 301-820-3287 cell line: 301-213-2639 >>>> >>>> >>>> >>>> This e-mail and any attachments contain URS Corporation >>>> confidential information that may be proprietary or privileged. If >>>> you receive this message in error or are not the intended >>>> recipient, you should not retain, distribute, disclose or use any >>>> of this information and you should destroy the e-mail and any attachments >>>> or copies. >>>> >>> >>> >>> This e-mail and any attachments contain URS Corporation confidential >>> information that may be proprietary or privileged. If you receive this >>> message in error or are not the intended recipient, you should not retain, >>> distribute, disclose or use any of this information and you should destroy >>> the e-mail and any attachments or copies.