Re: Polygon search returning "InvalidShapeException: incompatible dimension (2)... error.

2014-03-10 Thread Smiley, David W.
You need to either quote your query (after the colon, and another at the very end), or escape any special characters, or use a different query parser like “field”. I prefer to use the field query parser: {!field f=loc}Intersects(POLYGON(... ~ David On 3/6/14, 10:52 AM, "leevduhl" wrote: >Gett

Re: Solr spatial search within the polygon

2014-03-10 Thread Smiley, David W.
On 3/10/14, 6:45 AM, "Javi" wrote: >Hi all. > >I need your help! I have read every post about Spatial in Solr because I >need to check if a point (latitude,longitude) is inside a Polygon. > >/**/ >/* 1. library */ >/**/ > >(1) I use "jts-1.13.jar" and "spatial4j-0.4.1.ja

Re: Solr spatial search within the polygon

2014-03-10 Thread Smiley, David W.
On 3/10/14, 12:12 PM, "Smiley, David W." wrote: >> >> >> >>c) I tried no WKT format by adding a comma and using "longitude,latitude" >> >> >> >> 40.442179,-3.69278 >> >> > >That is *wrong*. Remo

Re: Solr spatial search within the polygon

2014-03-10 Thread Smiley, David W.
On 3/10/14, 12:56 PM, "javinsnc" wrote: >>> >>>/*/ >>>/* Document contents */ >>>/*/ >>>I have tried with 3 different content for my documents (lat-lon refers >>>to >>>Madrid, Spain): >> >> Um…. Just to be absolutely sure, are you adding the data in Solr’

Re: Issue with spatial search

2014-03-10 Thread Smiley, David W.
Hi Steven, Set distErrPct to 0 in order to get non-point shapes to always be as accurate as maxDistErr. Point shapes are always that accurate. As long as you only index points, not other shapes (you don’t index polygons, etc.) then distErrPct of 0 should be fine. In fact, perhaps a future So

Re: Doing spatial search on multiple location points

2014-03-17 Thread Smiley, David W.
Absolutely. The most straight-forward approach is to use the default query parser comprised of OR clauses of geofilt query parser based clauses. Another way to do it in Solr 4.7 that is probably faster is to use WKT with the custom “buffer" extension: myLocationRptField:"BUFFER(MULTIPOINT(x y, x

Re: Doing spatial search on multiple location points

2014-03-18 Thread Smiley, David W.
have one more question: How do I boost the score of the >matching documents based on geodist? How will I get the geodist based on >the closest matching lat-long point. > >Thanks in advance. > >-- >Varun Gupta > >On Mon, Mar 17, 2014 at 7:27 PM, Smiley, David W. >wrot

Re: geo/spatial search performance comparison using different methods

2013-11-06 Thread Smiley, David W.
Hi Kuro, I don't know of any benchmarks featuring distance-sort performance. Presumably you are using SOLR-2155 because you have multi-valued spatial fields? If so, LatLonType is not an option. SOLR-2155 sorting performance is *probably* about the same as the equivalent in Solr 4 RPT. If you ac

Re: Question regarding Indexsize with Spatial4j Rectangulars

2013-11-06 Thread Smiley, David W.
Hi Dennis, I would not expect the index growth to be quite linear as the number of shapes grows, but nonetheless it may be significant. Indexing non-point shapes will index more term data than it ideally should: LUCENE-4942 I need to find the time/priority to do it. Probably within the next cou

Re: geo/spatial search performance comparison using different methods

2013-11-06 Thread Smiley, David W.
an you give me some idea how much query-time performance gain >we can expect by switching to LatLonType from Solr-2155? > >On 11/06/2013 09:56 AM, Smiley, David W. wrote: >> Hi Kuro, >> >> I don't know of any benchmarks featuring distance-sort performance. >> >

Re: Solr spatial search within the polygon

2013-11-18 Thread Smiley, David W.
Hi. It's clear there is an ordering problem in your latitudes and longitudes. If indeed you intend to index latitude 9.44Š and longitude 76.45Š as you said, then you are indexing it correctly. You may also choose to index in WKT format, which would be POINT(76.45 9.44) but either is fine. Howev

Re: Solr spatial search within the polygon

2013-11-19 Thread Smiley, David W.
On 11/19/13 4:06 AM, "Dhanesh Radhakrishnan" wrote: >Hi David, >Thank you so much for the detailed reply. I've checked each and every lat >lng coordinates and its a purely polygon. >After some time I did one change in the lat lng indexing. >Changed the indexing format. > >Initially I indexed t

Re: Solr spatial search within the polygon

2013-11-20 Thread Smiley, David W.
0 = >queryNorm\n" >}, >"QParser": "LuceneQParser", >"filter_queries": [ >"state:Kerala", >"location:\"IsWithin(POLYGON((9.471920923238988 >76.5496015548706,9.464174399734185 76.53947353363037,9.457232

RE: Range queries with Grouping is slow?

2014-01-07 Thread Smiley, David W.
Kranti, I can't speak to the specific slow-down while grouping, but if you expect to run [* TO *] queries with any frequency then you should index a boolean flag and query for that instead. You might also reduce the precisionStep value for the field you are using to 6 or even 4. But wow that'

Re: Range queries with Grouping is slow?

2014-01-09 Thread Smiley, David W.
d by definition. >> > >> > Am I missing something here? >> > >> > >> > >> > >> > Thanks, >> > Kranti K. Parisa >> > http://www.linkedin.com/in/krantiparisa >> > >> > >> > >> > On Wed

Re: Indexing spatial fields into SolrCloud (HTTP)

2014-01-13 Thread Smiley, David W.
reference the SpatialStrategy, for example. ~ David From: , "Jim (US-KOP)" mailto:jim.be...@hibu.com>> Date: Friday, January 10, 2014 at 12:15 PM To: "solr-user@lucene.apache.org<mailto:solr-user@lucene.apache.org>" mailto:solr-user@lucene.apache.org>> Cc: "

Re: Solr spatial clustering GPS

2014-01-29 Thread Smiley, David W.
Hi Guido, Check this out: http://wiki.apache.org/solr/SpatialClustering It captures some information on the subject. What I really want to do is built-in heatmap-faceting but I have no time right now. ~ David On 1/29/14, 10:38 AM, "Guido Medina" wrote: >Hi, > >Is there a way to cluster groups

RE: Geospatial clustering + zoom in/out help

2014-01-31 Thread Smiley, David W.
Hi Bojan. You've got some good ideas here along the lines of some that others have tried. I've through together a page on the wiki about this subject some time ago that I'm sure you will find interesting. It references a relevant stack-overflow post, and also a presentation at DrupalCon which

Re: Solr and Polygon/Radius based spatial searches

2014-02-03 Thread Smiley, David W.
Hi Lee, On 2/3/14, 1:59 PM, "leevduhl" wrote: >We have a public property search site that we are looking to replace the >back >end index server on and we are looking at Solr as a possible replacement >(ElasticSearch is another possibility). Both should work equally well. > >One of the key sear

Re: Spatial Score by overlap area

2014-02-11 Thread Smiley, David W.
Hi, BBoxStrategy is still only in “trunk” (not the 4x branch). And furthermore… the Solr portion, a FieldType, is over in Spatial-Solr-Sandbox — https://github.com/ryantxu/spatial-solr-sandbox/blob/master/LSE/src/main/ja va/org/apache/solr/spatial/pending/BBoxFieldType.java It should be quite eas

Re: Indexing spatial fields into SolrCloud (HTTP)

2014-02-12 Thread Smiley, David W.
ch can get abbreviated. ~ David From: , "Jim (US-KOP)" mailto:jim.be...@hibu.com>> Date: Wednesday, February 12, 2014 at 2:05 PM To: "Smiley, David W." mailto:dsmi...@mitre.org>>, "solr-user@lucene.apache.org<mailto:solr-user@lucene.apache.org>" mailto:s

Re: Indexing spatial fields into SolrCloud (HTTP)

2014-02-12 Thread Smiley, David W.
: , "Jim (US-KOP)" mailto:jim.be...@hibu.com>> Date: Wednesday, February 12, 2014 at 5:21 PM To: "Smiley, David W." mailto:dsmi...@mitre.org>>, "solr-user@lucene.apache.org<mailto:solr-user@lucene.apache.org>" mailto:solr-user@lucene.apache.org>&g

Re: range types in SOLR

2014-03-03 Thread Smiley, David W.
The main reference for this approach is here: http://wiki.apache.org/solr/SpatialForTimeDurations Hoss’s illustrations he developed for the meetup presentation are great. However, there are bugs in the instruction — specifically it’s important to slightly buffer the query and choose an appropriat

Re: Solr 4.3.1: Errors When Attempting to Index LatLon Fields

2013-07-17 Thread Smiley, David W.
Another problem in addition to dynamicField being declared in the wrong place, is that you've declared that your geoFindspot field is multi-valued. LatLonType can't handle that. Use location_rpt in the example schema to get a multi-value capable geo field. ~ David On 7/15/13 5:10 PM, "Scott Vand

Re: custom field type plugin

2013-07-23 Thread Smiley, David W.
Kevin, Those are some good query response times but they could be better. You've configured the field type sub-optimally. Look again at http://wiki.apache.org/solr/SpatialForTimeDurations and note in particular maxDistErr. You've left it at the value that comes pre-configured with Solr, 0.0

Re: custom field type plugin

2013-07-24 Thread Smiley, David W.
ing, whole numbers were working for >all my edge cases. > >-Kevin > >On 7/23/13 10:45 PM, "Smiley, David W." wrote: > >>Kevin, >> >>Those are some good query response times but they could be better. >>You've >>configured the field type

Re: Performance question on Spatial Search

2013-07-30 Thread Smiley, David W.
I see the problem ‹ it's +pp:*. It may look innocent but it's a performance killer. What your telling Lucene to do is iterate over *every* term in this index to find all documents that have this data. Most fields are pretty slow to do that. Lucene/Solr does not have some kind of cache for this. I

Re: Performance question on Spatial Search

2013-07-30 Thread Smiley, David W.
12:02 PM, Steven Bower >>wrote: >> >>> Will give the boolean thing a shot... makes sense... >>> >>> >>> On Tue, Jul 30, 2013 at 11:53 AM, Smiley, David W. >>>wrote: >>> >>>> I see the problem ‹ it's +pp:*. It may lo

Re: Performance question on Spatial Search

2013-07-30 Thread Smiley, David W.
ould like to know the internal behavior of Solr. > >Best regards, > >- Luis Cappa > > >2013/7/30 Smiley, David W. > >> Steve, >> The FieldCache and DocValues are irrelevant to this problem. Solr's >> FilterCache is, and Lucene has no counterpart. Perha

Re: Multipoint date ranges with spatial - Invalid Longitude Exception?

2013-08-12 Thread Smiley, David W.
Whoops; I copy'ed your error of using commas. I meant: Less clear: grantRoundDates:"Intersects(0 2013224 2014231 300)" More clear: grantRoundDates:["0 2013224" TO "2014231 300"] On 8/12/13 3:13 PM, "David Smiley (@MITRE.org)" wrote: > Less clear: grantRoundDates:"Intersects(0

Re: SOLR4 Spatial sorting and query string

2013-08-14 Thread Smiley, David W.
Roy, How fast/slow this is is dependent on the total number of points in documents that match the search results. If one of those documents has 1000 points but most have a handful then it isn't such a big deal. The bigger problem is: https://issues.apache.org/jira/browse/LUCENE-4698 ~ David On

Re: Distance sort on a multi-value field

2013-08-14 Thread Smiley, David W.
On 8/14/13 2:26 PM, "Jeff Wartes" wrote: > >I'm still pondering aggregate-type operations for scoring multi-valued >fields (original thread: http://goo.gl/zOX53f ), and it occurred to me >that distance-sort with SpatialRecursivePrefixTreeFieldType must be doing >something like that. It isn't.

Re: Searching for closed polylines that contain a given point

2013-09-23 Thread Smiley, David W.
Mark, Yes you can. You should index polygons, not polylines. A polyline semantically refers to the actual line but rather you want to index the coverage of the nation (the space encircled by the polyline), not the border literally. One thing to be aware of is that indexed non-point shapes are p

Re: Among LatLonType & SpatialRecursivePrefixTreeFieldType which one for filtering outside of bounding box?

2013-10-07 Thread Smiley, David W.
Use the location_rpt field type in the example schema.xml -- it has "good performance & less memory" (what you asked for) compared to LatLonType. To learn how to tweak some of the settings to get better performance at the expense of some accuracy, see http://wiki.apache.org/solr/SolrAdaptersForLuce

Re: Solr 4.4.0 on Ubuntu 10.04 with Jetty 6.1 from package Repository

2013-10-10 Thread Smiley, David W.
*Don't* use JDK 7u40, it's been known to cause index corruption and SIGSEGV faults with Lucene: LUCENE-5212 This has not been unnoticed by Oracle. ~ David On 10/10/13 12:34 PM, "Guido Medina" wrote: >2. Java version: There are huges performance winning between Java 5, 6 >and 7; we use Ora

Re: Solr 4.2.1 sorting by distance to polygon centre.

2013-04-16 Thread Smiley, David W.
Guido, The field type solr.SpatialRecursivePrefixTreeFieldType can only participate in distance reporting for indexed points, not other shapes. In fact, I recommend not attempting to get the distance if the field isn't purely indexed points, as it may get confused if it seems some small shapes. F

Re: Solr 4.2.1 sorting by distance to polygon centre.

2013-04-16 Thread Smiley, David W.
On 4/16/13 10:57 AM, "Guido Medina" wrote: >David, > >I have been following your stackoverflow posts, I understand what you >say, we decided to change the criteria and index an extra field (close >to your suggestion), so the sorting will happen now by polygon area desc >(Which induced another p

Re: Solr 4.2.1 sorting by distance to polygon centre.

2013-04-16 Thread Smiley, David W.
Guido, I encourage you to try to open-source the shape-related code you have to Spatial4j. I realize that for some organizations, that can be really difficult. ~ David On 4/16/13 11:55 AM, "Guido Medina" wrote: >David, > > I just peak it at github, the method will estimate well for our >p

Re: solr.LatLonType type vs solr.SpatialRecursivePrefixTreeFieldType

2013-05-07 Thread Smiley, David W.
Hi Barani, This identical question was posed at the same time on StackOverflow, and I answered it there already: http://stackoverflow.com/questions/16407110/solr-4-2-solr-latlontype-type-v s-solr-spatialrecursiveprefixtreefieldtype/16409327#16409327 ~ David On 5/6/13 12:28 PM, "bbarani" wrote:

Re: Associate item with more than one location

2013-05-28 Thread Smiley, David W.
Absolutely. Use "location_rpt" in the example schema. Do *not* use LatLonType, which doesn't support multiValued data. ~ David Smiley On 5/28/13 8:02 AM, "Spadez" wrote: > currently have an item which gets imported into solr, lets call it a book >entry. Well that has a single location associa

Re: SpatialRecursivePrefixTreeFieldType Spatial Searching

2013-06-03 Thread Smiley, David W.
Hi Chris: Have you read: http://wiki.apache.org/solr/SpatialForTimeDurations You're modeling your data sub-optimally. Full precision rectangles (distErrPct=0) doesn't scale well and you're seeing that. You should represent your durations as a point and it will take up a fraction of the space (se

Re: SpatialRecursivePrefixTreeFieldType Spatial Searching

2013-06-04 Thread Smiley, David W.
n-spatial-meetup-2013011 >>7/ >> >> Here are the suggestions: >> >> q=fieldX:"Intersects(-ƒ end start ƒ)" >> q=fieldX:"Intersects(-ƒ start end ƒ)" >> q=fieldX:"Intersects(start -ƒ ƒ end)" >> >> All of these, are great

Re: sort=geodist() asc

2013-06-17 Thread Smiley, David W.
Bill, I added this comment: https://issues.apache.org/jira/browse/SOLR-2345?focusedCommentId=13685627&p age=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel#commen t-13685627 On 6/17/13 1:50 AM, "William Bell" wrote: >This simple feature of "sort=geodist() asc" is very powerful s

Re: Geo spatial search with multi-valued locations (SOLR-2155 / lucene-spatial-playground)

2011-08-29 Thread Smiley, David W.
Hi Mike. I have hopes that LSP will be ready in time for Solr 4. It's usable now with the understanding that it's still fairly early and so there are bound to be bugs. I've been focusing a lot on testing lately. You could try applying SOLR-2155 but I think there was some Lucene/Solr code re-or

Re: Indexing geohash in solrj - Multivalued spatial search

2011-09-29 Thread Smiley, David W.
Hi Alessandro. I can't think of any good reason anyone would use the geohash field type that is a part of Solr today. If you are shocked I would say that, keep in mind the work I've done with geohashes is an extension of what's in Solr, it's not what's in Solr today. Recently I ported SOLR-2155

Re: Indexing geohash in solrj - Multivalued spatial search

2011-09-29 Thread Smiley, David W.
multivalued location field and I have to make location > queries on it! > So I figured to use the geohash type ... > Any hint about indexing and searching on a multivalued geohash field? > > > 2011/9/29 Smiley, David W. > >> Hi Alessandro. >> >> I can't t

Re: Indexing geohash in solrj - Multivalued spatial search

2011-09-30 Thread Smiley, David W.
On Sep 30, 2011, at 4:14 AM, Alessandro Benedetti wrote: > Ok this is a good news ! > I will integrate the jar and test the feature :) > Only one question regarding the indexing process in solrj. > We could index the location data in format : lat,lon in the geohash field? > Or we must encode lan &

[ANNOUNCEMENT] Second Edition of the First Book on Solr

2011-11-17 Thread Smiley, David W.
Fellow Solr users, I am proud to announce that the book "Apache Solr 3 Enterprise Search Server" is officially published!  This is the second edition of the first book on Solr by me, David Smiley, and my co-author Eric Pugh.  You can find full details about the book, download a free chapter, an

Re: SpatialSearch, geofilt and documents missing a value in sfield

2012-01-12 Thread Smiley, David W.
Hi Tanguy, On Jan 11, 2012, at 6:14 AM, Tanguy Moal wrote: > Dear ML, > > I'm performing some developments relying on spatial capabilities of solr. > > I'm using Solr 3.5, have been reading > http://wiki.apache.org/solr/SpatialSearch#Spatial_Query_Parameters and have > the basic behaviours I

I was at a search vendor round table today...

2010-09-22 Thread Smiley, David W.
(I don't twitter or blog so I thought I'd send this message here) Today at work (at MITRE outside DC) there was (is) a day of technical presentations about topics related to information dissemination and discovery (broad squishy words there, but mostly covered "search") at which I spoke about t

Re: solr4 MULTIPOLYGON search syntax

2012-11-20 Thread Smiley, David W.
Hi jend, You need an extra layer of parenthesis for MultiPolygon. I see that you opened up with MULTIPOLYGON((… instead of MULTIPOLYGON(((… Of course ensure you balance your parenthesis. For examples of WKT, see Wikipedia: http://en.wikipedia.org/wiki/Well-known_text ~ David On Nov 19, 2

Re: Is there faceting with Solr 4 spatial?

2013-01-09 Thread Smiley, David W.
Erick, Alex asked about Solr 4 spatial, and his use-case requires it because he's got multi-value spatial fields (multiple business office locations per document). So the Solr 3 spatial solution you posted won't cut it. Alex, You can do this in Solr 4.0. Use one facet.query per circle (I.e.

Re: Problem with migration from solr 3.5 with SOLR-2155 usage to solr 4.0

2013-01-23 Thread Smiley, David W.
Viacheslav, SOLR-2155 is only compatible with Solr 3. However the technology it is based on lives on in Lucene/Solr 4 in the "SpatialRecursivePrefixTreeFieldType" field type. In the example schema it's registered under the name "location_rpt". For more information on how to use this field type

Re: Problem with migration from solr 3.5 with SOLR-2155 usage to solr 4.0

2013-01-29 Thread Smiley, David W.
or. > >Also could you update the WIKI page after the words "it needs to be in >WEB-INF/lib in Solr's war file, basically" also add the maven artifact >code like this? > > >com.vividsolutions >jts >1.13 > > >I think this may help for users us

Re: MERGING SPATIAL SEARCH QUERY

2013-01-29 Thread Smiley, David W.
Hi Jaspreet. Your post is confusing. You're using spatial, so you say, yet your question suggests you have yet to use it. If your documents are associated with a city, then you should index the lat-lon location of that city in your documents. It's denormalized like this. ~ David On 1/23/13 11

Re: Eastings and northings support in Solr Spatial

2013-02-12 Thread Smiley, David W.
Yeah, solr.PointType. Or use solr.SpatialRecursivePrefixTree with geo=false http://wiki.apache.org/solr/SolrAdaptersForLuceneSpatial4 On 2/8/13 10:38 AM, "Kissue Kissue" wrote: >I can see Solr has the field type solr.LatLonType which supports spatial >based on longitudes and latitudes. Does it

Re: Solr 4 Spatial: NoClassDefFoundError: com/vividsolutions/jts/geom/Geometry

2013-02-27 Thread Smiley, David W.
Dotan, http://wiki.apache.org/solr/SolrAdaptersForLuceneSpatial4#Configuration You need to put the its jar within Solr's WEB-INF/lib; unfortunately you can't simply reference it via a entry and put it wherever. FWIW you can find the same question and my response on Stackoverflow. ~ David On 2/

Re: solr 4.1 spatial with JTS - spatial query withitin a WKT polygon contained within another query ...

2013-02-27 Thread Smiley, David W.
Hi Guilherme, That's a neat idea for a feature. It'd be nice if there was a proper Solr "Qparser" for these fields because that would then make a nice extension point to further dereference the shape reference from the index itself. There is a JIRA issue for that. At least writing such a Qparser

RE: Solr 4.1: problems with Spatial Search.

2013-03-12 Thread Smiley, David W.
Hi Luis, I'm glad it's working out. When I *eventually* get a patch together addressing the issue, I'll let you know so you can try it out. 'd' is measured in kilometers. "degrees" is only for the Solr 4 spatial field's Circle radius parameter and for its distance score results. Kind of a m

Re: The index speed in the solr

2012-04-23 Thread Smiley, David W.
On Apr 23, 2012, at 9:27 AM, Erick Erickson wrote: > 50 hours is a really long time for 2M docs though, so something > doesn't seem right unless the docs are really unusual. Don't forget he's n-gramming ;-) There's not much more demanding you could ask of text analysis except for throwing shin

Re: Spatial4j

2012-04-23 Thread Smiley, David W.
Ericz, See this issue: https://issues.apache.org/jira/browse/SOLR-3304 It's just a TODO issue right now but when it's completed, you'll be able to do polygon spatial queries. All the software is written to do it right now but the missing Solr piece is temporarily at Spatial4j.com. If you were

Re: Query multiple cores

2010-12-29 Thread Smiley, David W.
I recommend looking for answers on the wiki (or my book) before asking basic questions on the list. Here you go: http://wiki.apache.org/solr/DistributedSearch ~ David Smiley Author: http://www.packtpub.com/solr-1-4-enterprise-search-server/ On Dec 29, 2010, at 3:24 PM, Mark wrote: > Is it poss

Re: MailEntityProcessor

2011-02-23 Thread Smiley, David W.
I assume you found this?: http://wiki.apache.org/solr/MailEntityProcessor You don't provide enough information to get assistance when you simply say "I couldn't get it working". (disclaimer: I haven't used DIH's mail feature) ~ David On Feb 23, 2011, at 5:15 PM, Husrev Yilmaz wrote: > Hi, > >

Re: DataImportHandler in Solr 4.0

2011-02-23 Thread Smiley, David W.
The DIH is no longer supplied embedded in the Solr war file. You need to get it on the classpath somehow. You could add another http://www.packtpub.com/solr-1-4-enterprise-search-server/ On Feb 23, 2011, at 4:11 PM, Alexandre Rocco wrote: > Hi guys, > > I'm having some issues when trying to us

Re: True master-master fail-over without data gaps (choosing CA in CAP)

2011-03-09 Thread Smiley, David W.
I was just about to jump in this conversation to mention Solandra and go fig, Solandra's committer comes in. :-) It was nice to meet you at Strata, Jake. I haven't dug into the code yet but Solandra strikes me as a killer way to scale Solr. I'm looking forward to playing with it; particularly

Re: NRT in Solr

2011-03-09 Thread Smiley, David W.
Zoie adds NRT to Solr: http://snaprojects.jira.com/wiki/display/ZOIE/Zoie+Solr+Plugin I haven't tried it yet but looks cool. ~ David Smiley Author: http://www.packtpub.com/solr-1-4-enterprise-search-server/ On Mar 9, 2011, at 9:01 AM, Jason Rutherglen wrote: > Jae, > > NRT hasn't been implemen

Re: Sorting on multiValued fields via function query

2011-03-16 Thread Smiley, David W.
Heh heh, you say "it worked correctly for me" yet you didn't actually have multi-valued data ;-) Funny. The only solution right now is to store the max and min into indexed single-valued fields at index time. This is pretty straight-forward to do. Even if/when Solr supports sorting on a mult

Re: [WKT] Spatial Searching

2011-03-28 Thread Smiley, David W.
(This is one of those messages that I would have responded to at the time if I only noticed it.) There is not yet indexing of arbitrary shapes (i.e. your data can only be points), but with SOLR-2155 you can query via WKT thanks to JTS. If you want to index shapes then you'll have to wait a mon

RE: [WKT] Spatial Searching

2011-03-29 Thread Smiley, David W.
tegory-x In practice, this was the reason we started the SIS project. Cheers, Chris On Mar 28, 2011, at 11:16 AM, Smiley, David W. wrote: > (This is one of those messages that I would have responded to at the time if > I only noticed it.) > > There is not yet indexing of arbitra

dismax "boost query" not useful?

2011-04-04 Thread Smiley, David W.
As I was reviewing the boosting capabilities of the dismax & edismax query parsers, it's not clear to me that the "boost query" has much use. The value of boost functions, particularly with a multiplied boost that edismax supports, is very clear -- there are a variety of uses. But I can't thin

Re: dismax "boost query" not useful?

2011-04-06 Thread Smiley, David W.
On Apr 5, 2011, at 3:17 PM, Chris Hostetter wrote: > one of the original use cases for bq was for artificial keyword boosting, > in which case it still comes in handy... > > bq=meta:promote^100 text:new^10 category:featured^100 (*:* > -category:accessories)^10 Yeah I thought of this specific

Re: difference between geospatial search from database angle and from solr angle

2011-04-07 Thread Smiley, David W.
I haven't used PostGIS so I can't offer a real comparison. I think if you were to try out both, you'd be impressed with Solr's performance/scalability thanks in large part to its sharding. But for "functionality richness" in so far as geospatial is concerned, that's where Solr currently comes s

Re: KStemmer for Solr 3.x +

2011-04-08 Thread Smiley, David W.
LucidKStemmer (& LucidGaze) are LGPL licensed -- I just verified this with the NOTICE.txt in the download. I wish Lucid's site was more clear on this -- I checked their first but found no information on the license terms. I don't know why you want an alternative. If you insist I suppose you cou

Re: Field compression

2011-04-18 Thread Smiley, David W.
It's probably not accurate to say that a lot of sites were *relying* on that feature. It's an optimization. Getting a working patch applying to trunk is on my TODO-list within the next couple months. https://issues.apache.org/jira/browse/SOLR-752 "Watch" the issue to see when I get to it. ~ Dav

Re: Is it possible to build Solr as a maven project?

2011-05-04 Thread Smiley, David W.
Hi folks. What you're supposed to do is run: mvn -N -Pbootstrap install as the very first one-time only step. It copies several custom jar files into your local repository. From then on you can build like normally with maven. ~ David Smiley Author: http://www.packtpub.com/solr-1-4-enterprise-

Re: Spatial search - SOLR 3.1

2011-05-11 Thread Smiley, David W.
Hi Roy. See this: http://wiki.apache.org/solr/SpatialSearch#Returning_the_distance I recommend returning the point location and calculating the distance yourself -- it's not hard. Getting Solr to return it is a bit of a hack now. ~ David Smiley Author: http://www.packtpub.com/solr-1-4-enterpri

Re: Anyone familiar with Solandra or Lucandra?

2011-05-12 Thread Smiley, David W.
The old name is "Lucandra" not Lucendra. I've changed the subject accordingly. I'm looking forward to responses from people but I'm afraid it appears it has not yet gotten much uptake yet. I think it has enormous potential once it's hardened a bit and there's more documentation. Personally, I've

Re: K-Stemmer for Solr 3.1

2011-05-16 Thread Smiley, David W.
Lucid's KStemmer is LGPL and the Solr committers have shown that they don't want LGPL libraries shipping with Solr. If you are intent on releasing your changes, I suggest attaching both the modified source and the compiled jar onto Solr's k-stemmer wiki page; and of course say that it's LGPL lic

Re: Spatial Solr 3.1: filter by viewport

2011-05-24 Thread Smiley, David W.
Hi Zac. The syntax in your example is odd, I didn't know you could do that. Except it doesn't quite work as you show. You could file a bug. As an alternative that might suffice, use the point-radius arguments in which Solr will take the minimum-bounding-box for. See {!bbox} http://wiki.apache.

Re: Dismax + spatial constraints

2011-05-24 Thread Smiley, David W.
Hi Jamie. You can definitely use dismax & geospatial; these are unrelated. Use defType=dismax to get dismax and then use an appropriate geospatial filter like fq={!bbox}&sfield=store&pt=45.15,-93.85&d=5 For temporal based constraints, add a temporal filter query: fq=timestamp:[NOW-1MONTH TO N

Re: Dismax + spatial constraints

2011-05-24 Thread Smiley, David W.
eria in > addition then correct? > > On Tue, May 24, 2011 at 9:43 AM, Smiley, David W. wrote: > >> Hi Jamie. >> >> You can definitely use dismax & geospatial; these are unrelated. Use >> defType=dismax to get dismax and then use an appropriate geospatia

Re: multiple spatial values

2011-06-28 Thread Smiley, David W.
It is precisely this limitation which triggered me to develop a grid indexing approach using Geohashes: https://issues.apache.org/jira/browse/SOLR-2155 This patch requires a Solr trunk release. If you have a small number of distinct points in total, and you only need filtering, then the geohash

Re: Solr Ecosystem / Integration wiki pages

2011-07-15 Thread Smiley, David W.
Thanks for offering feedback; if nobody commented I was going to send an FYI post to the dev list. Comments below. On Jul 15, 2011, at 3:39 PM, Chris Hostetter wrote: > > : integrating Solr with other applications. What isn't there is a list of > : what web/email/file crawlers exist, data inte

Re: Spatial Search with distance as a parameter

2011-07-19 Thread Smiley, David W.
Hi Michael, It appears that you want to index circles (aka point-radius) and you want to do a query that is a point that matches documents where this point is within an indexed circle. I'm working with a couple Lucene/Solr committers on a geospatial module that can do this today against Solr 4

Re: Geospatial queries in Solr

2011-07-19 Thread Smiley, David W.
Hi Jamie. I work on LSP; it can index polygons and query for them. Although the capability is there, we have more testing & benchmarking to do, and then we need to put together a tutorial to explain how to use it at the Solr layer. I recently cleaned up the READMEs a bit. Try downloading the t

Re: Geospatial queries in Solr

2011-07-20 Thread Smiley, David W.
til the updates have been made. Thanks again. > > On Tue, Jul 19, 2011 at 3:51 PM, Smiley, David W. wrote: >> Hi Jamie. >> I work on LSP; it can index polygons and query for them. Although the >> capability is there, we have more testing & benchmarking to do, and th

Re: Geospatial queries in Solr

2011-07-20 Thread Smiley, David W.
;> Thanks for the update David, I'll give that a try now. >> >> On Wed, Jul 20, 2011 at 10:58 AM, Smiley, David W. wrote: >>> Ryan just updated LSP for Lucene/Solr trunk compatibility so you should do >>> a "mvn clean install" and you'll

Re: Geospatial queries in Solr

2011-07-20 Thread Smiley, David W.
ere do you set that? > > On Wed, Jul 20, 2011 at 2:37 PM, Smiley, David W. wrote: >> You can set the system property SpatialContextProvider to >> com.googlecode.lucene.spatial.base.context.JtsSpatialContext >> >> ~ David >> >> On Jul 20, 2011, at 2:02

Re: Geospatial queries in Solr

2011-07-21 Thread Smiley, David W.
David. When trying to execute queries on a complex irregular > polygon (say the shape of NJ) I'm getting results which are actually > outside of that polygon. Is there a setting which controls this > resolution? > > On Wed, Jul 20, 2011 at 2:53 PM, Smiley, David W. wrote: &g

Re: Geospatial queries in Solr

2011-07-21 Thread Smiley, David W.
query. Given >> this it sounds as if I can get more precise results by changing the >> distErrPct on a query parameter. I'll give this a whirl. Again thank >> you. >> >> >> On Thu, Jul 21, 2011 at 11:13 AM, Smiley, David W. wrote: >>> If yo

Re: Geospatial queries in Solr

2011-07-22 Thread Smiley, David W.
Wrapping the dateline or being able to encircle one of the poles (but not necessarily both) are polygon query features that I feel need to be addressed before this module is first released (whenever that is), definitely. And arguably before benchmarking, which we're looking to focus on soon. S

Re: Spatial Search and Highlighting

2011-08-01 Thread Smiley, David W.
Can you demonstrate the bug against the example data? If so, provide the URL please. ~ David On Aug 1, 2011, at 4:00 PM, Ralf Musick wrote: > Hi, > > I combined a spatial distance search with a fulltext search as described > in > http://wiki.apache.org/solr/SpatialSearch#geodist_-_The_distan

Re: Spatial Search and Highlighting

2011-08-01 Thread Smiley, David W.
pseudo field solution described here > http://wiki.apache.org/solr/SpatialSearch#Returning_the_distance did not > word, so I created the query above. > > Thanks, > Ralf > > > Am 01.08.2011 22:21, schrieb Smiley, David W.: >> Can you demonstrate the bug against the examp

Re: Matching queries on a per-element basis against a multivalued field

2011-08-02 Thread Smiley, David W.
"LucidWorks Enterprise" (which is more than Solr, and a modified Solr at that) isn't free; so you can't extract the Solr part of that package and use it unless you are willing to pay them. Lucid's "Certified Solr", on the other hand, is free. But they have yet to bump that to trunk/4.x; it was

Re: Matching queries on a per-element basis against a multivalued field

2011-08-02 Thread Smiley, David W.
On Aug 2, 2011, at 5:47 PM, eks dev wrote: > Sure, I know..., > the point I was trying to make, "if someone serious like Lucid is > using solr 4.x as a core technology for own customers, the trunk could > not be all that bad" => release date not as far as 2012 :) Oh the current trunk is most def

Re: Strategies for sorting by array, when you can't sort by array?

2011-08-03 Thread Smiley, David W.
Hi Ron. This is an interesting problem you have. One idea would be to create an index with the entity relationship going in the other direction. So instead of one to many, go many to one. You would end up with multiple documents with varying names but repeated parent entity information -- perh

Re: Solr support for multiple points (latitude-longitude) for a document

2011-08-19 Thread Smiley, David W.
Hi. Either port it to Solr 3, or use Solr 4 (trunk). I know and have used a Metacarta solution but that is also based on Solr 4 and I don't think they've back-ported it. I have no clue what they charge for it or where to get it; I have it as part of their larger solution. There's also a sma

Re: Spatial Search problems

2011-08-23 Thread Smiley, David W.
Could you reproduce a very simple example of this? For example if there is a particular indexed point in your data that should be returned from your query (a query smaller than d=4k10), then reproduce that bug in the Solr example app by supplying a dummy document with this point and running your

Re: Spatial Search problems

2011-08-24 Thread Smiley, David W.
Well that's your problem :-P You need to be using the same version of Lucene for reading & writing. Create your index with Lucene 3.3. FYI I tried indexing the point you said you had trouble with, and with a 300km radius, and it found it. On Aug 24, 2011, at 4:39 AM, Javier Heras wrote: > An

Re: Spatial Search problems

2011-08-25 Thread Smiley, David W.
Um, You might try googling LocalSolr or LocalLucene -- dead projects but you insist on using an old Solr/Lucene. Of course if all you need is a bounding box filter than a pair of lat & lon range queries is sufficient. ~ David Smiley On Aug 25, 2011, at 4:01 AM, Javier Heras wrote: > Thanx Dav

  1   2   >