Recommended Python Library for Complex Querying?

2017-08-29 Thread ron visbord
Hi all, I'm rebuilding the Solr part of my search engine in Python. I work with both Solr 5[.2.1] and 6[.3.0]. I looked around but found no satisfactory python library to help me write queries. I come from SolrJ so I'm used to having classes for all types or queries. What would you say is the m

Re: solr-map-reduce:jar:6.6.0

2017-08-29 Thread Hrishikesh Gadre
>>If we do need that functionality somehow, what is the recommended approach? Was it replaced by something? AFAIK it was not replaced by anything on the Solr side. Kite sdk provides identical functionality and it looks like it supports Solr 6.6. You may want to try that out https://github.com/ki

Re: Spatial search with arbitrary rectangle?

2017-08-29 Thread David Smiley
Hi, The "rectangular area" refers to a hypothetical map UI. In this scenario, the UI ought to communicate the lat-lon of each corner. The geofilt and bbox query parsers don't handle that; they only take a point and distance. RE projections: You may or may not need to care depending on exactly w

Re: Download Sunplot for SQL/Streaming expr

2017-08-29 Thread Joel Bernstein
This is the github site https://github.com/sunplot/sunplot. You can ask Michael about how to download. Joel Bernstein http://joelsolr.blogspot.com/ On Wed, Aug 23, 2017 at 2:43 PM, Susheel Kumar wrote: > Hello, > > From where we can download Sunplot/setup to use SQL and streaming > expressions?

Re: solr 6.6.1: Lock held by this virtual machine

2017-08-29 Thread Erick Erickson
I need to look at this a bit. If either of you have the time/inclination, I have some anecdotal evidence that if you specify 5000 in solrconfig.xml you won't see this problem. This is not a proper fix of the root issue, but if you test this and don't see the error it'd be a great help in me trac

Re: solr-map-reduce:jar:6.6.0

2017-08-29 Thread Erick Erickson
This is now apparently maintained at http://kitesdk.org and was living in both places. unless you're using the MapReduceIndexerTool (a bulk indexing option when running over HDFS) these contribs aren't needed. Best, Erick On Tue, Aug 29, 2017 at 3:28 PM, John Bickerstaff wrote: > If we do need

Re: solr 6.6.1: Lock held by this virtual machine

2017-08-29 Thread Shawn Heisey
On 8/26/2017 9:53 AM, Erick Erickson wrote: > Setting loadOnStartup=false won't work for you in the long run, > although it does provide something of a hint. Setting this to false > means the core at that location simply has its coreDescriptor read and > stashed away in memory. The first time you _

Re: solr-map-reduce:jar:6.6.0

2017-08-29 Thread John Bickerstaff
If we do need that functionality somehow, what is the recommended approach? Was it replaced by something? On Tue, Aug 29, 2017 at 4:27 PM, John Bickerstaff wrote: > A quick search of the code's imports suggests we aren't actually using it. > However I see it explicitly mentioned in the POM. > >

Re: solr-map-reduce:jar:6.6.0

2017-08-29 Thread John Bickerstaff
A quick search of the code's imports suggests we aren't actually using it. However I see it explicitly mentioned in the POM. I'll have to do more digging to be sure... On Tue, Aug 29, 2017 at 3:44 PM, Hrishikesh Gadre wrote: > Hi John, > > The map-reduce contrib module is removed as part of SOL

Re: solr-map-reduce:jar:6.6.0

2017-08-29 Thread Hrishikesh Gadre
Hi John, The map-reduce contrib module is removed as part of SOLR-9221 . Are you using this contrib module? Thanks Hrishikesh On Tue, Aug 29, 2017 at 2:39 PM, John Bickerstaff wrote: > All, > > I'm looking at upgrading some java projects to sol

solr-map-reduce:jar:6.6.0

2017-08-29 Thread John Bickerstaff
All, I'm looking at upgrading some java projects to solr and lucene 6.6.0. I get an error when trying to "mvn package" one of them - it complained about the solr-map-reduce:jar:6.6.0 not being available. I went here: https://mvnrepository.com/artifact/org.apache.solr/solr-map-reduce And it look

Re: solr 6.6.1: Lock held by this virtual machine

2017-08-29 Thread Karthik Ramachandran
I am also seeing 2 threads loading the cores, I am using Solr 6.6.0. On Sat, Aug 26, 2017 at 11:53 AM, Erick Erickson wrote: > Setting loadOnStartup=false won't work for you in the long run, > although it does provide something of a hint. Setting this to false > means the core at that location s

Re: Solr learning to rank features question

2017-08-29 Thread Brian Yee
Thank you Diego! This works with some small changes. My feature ended up looking like this: { "name" : "FeatureA", "store" : "commonFeatureStore", "class" : "org.apache.solr.ltr.feature.SolrFeature", "params" : { "q" : "{!func}if(gt(ms(CutoffDate,NOW),0),exists(query({!v= PreZones:${zo

Re: Indexed=false for a field,but still able to search on field.

2017-08-29 Thread AshB
Hi, Thanks ,got this issue is happening because of docValues=true. Please elaborate on "full table scan search" Regards Ashish -- View this message in context: http://lucene.472066.n3.nabble.com/Indexed-false-for-a-field-but-still-able-to-search-on-field-tp4352338p4352599.html Sent from the

Re: Solr cloud in kubernetes

2017-08-29 Thread Björn Häuser
Hi Lars, sorry, external traffic is a wrong name. Basically all traffic to Solr goes through a k8s service which uses all solr pods as endpoints. Additionally we use another service for intra cluster communication. We do not use pod affinity. Feel free to ask more question if something is un

Re: Searching With UTF-8

2017-08-29 Thread Diego Ceccarelli
Hello Lawrence, Which type did you use in the solr schema for your fields? Cheers, Diego On Tue, Aug 29, 2017 at 5:34 PM, Elitzer, Lawrence < lelit...@lgsinnovations.com> wrote: > Hello! > > > > It seems I can correctly import (with DIH) UTF-8 characters such as J but > I am unable to search on

Re: Solr learning to rank features question

2017-08-29 Thread Diego Ceccarelli
Hi Brian, The plugin doesn't allow you to express multiple function queries in the same feature. Maybe in this case you can express both the tw queries in one unique function query, using the if function. Something like: "fq":"if(gt(ms(NOW,mydatefield),0,query(PreCutOffZones:${zone}), query( Pos

Searching With UTF-8

2017-08-29 Thread Elitzer, Lawrence
Hello! It seems I can correctly import (with DIH) UTF-8 characters such as J but I am unable to search on the fields containing the UTF-8 data. I have tried from the Solr admin backend to send just a J and even URL encode it in the q parameter I am specifying. How would I go about searching UTF

Solr learning to rank features question

2017-08-29 Thread Brian Yee
Hello, I have a somewhat complex solr filter query that I am hoping to turn into a feature for learning to rank, but I am not sure if it's possible. I would like to OR two fq together for one of my features. I have a cutoff date and I need to check one field if NOW is before the cutoff, and a diff

Fwd: Solr learning to rank features question

2017-08-29 Thread Brian Yee
Hello, I have a somewhat complex solr filter query that I am hoping to turn into a feature for learning to rank, but I am not sure if it's possible. I would like to OR two fq together for one of my features. I have a cutoff date and I need to check one field if NOW is before the cutoff, and a diff

Re: ClassCastException when using HighFrequencyDictionaryFactory with SearchComponent

2017-08-29 Thread Craig Smiles
Woops. Thanks Rick, that was it. I'm so used to typing "str" that it became white noise. On 29 August 2017 at 16:03, Rick Leir wrote: > Craig, > Just a guess, but your threshold is in a string field. Cheers -- Rick > > On August 29, 2017 7:37:56 AM MDT, Craig Smiles > wrote: > >Hi, > > > >I've

Re: ClassCastException when using HighFrequencyDictionaryFactory with SearchComponent

2017-08-29 Thread Rick Leir
Craig, Just a guess, but your threshold is in a string field. Cheers -- Rick On August 29, 2017 7:37:56 AM MDT, Craig Smiles wrote: >Hi, > >I've been trying to get a suggester working with the >HighFrequencyDictionaryFactory but when setting the threshold I'm >getting a >ClassCastException when t

Re: Search by similarity?

2017-08-29 Thread Josh Lincoln
I reviewed the dismax docs and it doesn't support the fieldname:term portion of the lucene syntax. To restrict a search to a field and use mm you can either A) use edismax exactly as you're currently trying to use dismax B) use dismax, with the following changes * remove the title: portion of the q

Re: Search by similarity?

2017-08-29 Thread Josh Lincoln
Darko, Can you use edismax instead? When using dismax, solr is parsing the title field as if it's a query term. E.g. the query seems to be interpreted as title "title-123123123-end" (note the lack of a colon)...which results in querying all your qf fields for both "title" and "title-123123123-end"

ClassCastException when using HighFrequencyDictionaryFactory with SearchComponent

2017-08-29 Thread Craig Smiles
Hi, I've been trying to get a suggester working with the HighFrequencyDictionaryFactory but when setting the threshold I'm getting a ClassCastException when the dictionary is built. Could someone please advise? To reproduce: 1. Download solr 6.6 2. Replace the SuggestComponent within the techp

Re: Solr client

2017-08-29 Thread Susheel Kumar
Looks good, Ganesh. I do not see SolrJ explicitly mentioned in solr-client page. On Tue, Aug 29, 2017 at 2:28 AM, Aditya wrote: > Hi > > I am aggregating open source solr client libraries across all languages. > Below are the links. Very few projects are currently active. Most of them > are las

Re: Search by similarity?

2017-08-29 Thread Darko Todoric
Hi Erick, "debug":{ "rawquerystring":"title:\"title-123123123-end\"", "querystring":"title:\"title-123123123-end\"", "parsedquery":"(+(DisjunctionMaxQuery(((author_full:title)^7.0 | (abstract:titl)^2.0 | (title:titl)^3.0 | (keywords:titl)^5.0 | (authors:title)^4.0 | (doi:title:)^1.0)) Disjun

Re: Indexed=false for a field,but still able to search on field.

2017-08-29 Thread Susheel Kumar
#1 If you will apply seach on this field in the Solr Admin Panel, no result found. But you can see this field on doc there. >> Yes, because this field is stored, you can see in the search result. #2 . Its searchable and can do faceting also. >> Yes, correct but if you want to use it for searchin

What do field(..) on fl parameter ?

2017-08-29 Thread Barbet Alain
Hi ! I was previously using field(..) to escape some parameter on field name. Like this: fl=field(my:data) Not good to use it on binary data as you will get "Can't initialize DocTermsIndex to generate (function) FunctionValues for field: my:data" So now I use fl=my*data And it work's like a c

Re: Fetch a binary field

2017-08-29 Thread Barbet Alain
Mmmmh ... my problem come from another side. My field name has ":" in it. To avoid this, i use this in request: fl=(field(name:point) but it's look like it isn't just to escape the field name, it's do stuff on it. If I use fl=name*point no problem I get my binary data 2017-08-18 6:01 GMT+02:00 GW