Re: Using parameter values in a sort

2017-02-27 Thread Walter Underwood
No, I tried that before adding the default. But the solrconfig.xml is rejected before there is a request, so this is not about requests. I did try “scores” in the requests, but of course it didn’t work because the solrconfig.xml was not loaded. I did not turn off parameter substitutions. This i

Re: Using parameter values in a sort

2017-02-27 Thread Erik Hatcher
It looks like you’ve got score/scores mismatching going on. I feel your frustration through e-mail. It’s voodoo for sure, but hopefully it’s just typos that are getting you now. I’d simplify it down to an example like I provided without mixing in any other variables or params (even for us

Re: Using parameter values in a sort

2017-02-27 Thread Erik Hatcher
> On Feb 27, 2017, at 9:42 PM, Walter Underwood wrote: > Pretty ready to give up. The documentation around function queries and params > is not working for me, though I’ve been using Solr for ten years. I have > figured out a lot of systems. This is impenetrable. Here’s how I (try to) explain

Re: Using parameter values in a sort

2017-02-27 Thread Walter Underwood
I added that line because I was getting an error about it being undefined. At this point, I’m just doing random shit hoping it will work. There is not enough documentation to use this. wunder Walter Underwood wun...@wunderwood.org http://observer.wunderwood.org/ (my blog) > On Feb 27

Re: Using parameter values in a sort

2017-02-27 Thread Erik Hatcher
`scores` (plural), you’ve got this below: Remove that, and like my previous e-mail, and use `scores` (plural) from the request and _should_ work? Erik > On Feb 27, 2017, at 9:42 PM, Walter Underwood wrote: > > I’ve passed in a score parameter, but the solrconfig.xml is rejected bef

Re: Using parameter values in a sort

2017-02-27 Thread Erik Hatcher
And by turning off parameter substitutions I meant disable `expandMacros` - https://cwiki.apache.org/confluence/display/solr/Parameter+Substitution Likely you haven’t and this feature should work. I’d remove `scores` fro

Re: Using parameter values in a sort

2017-02-27 Thread Walter Underwood
I’ve passed in a score parameter, but the solrconfig.xml is rejected before any requests. Pretty ready to give up. The documentation around function queries and params is not working for me, though I’ve been using Solr for ten years. I have figured out a lot of systems. This is impenetrable. w

Re: Using parameter values in a sort

2017-02-27 Thread Erik Hatcher
You have an empty “scores” parameter in there. You’re not showing your full search request, but did you provide that in the request? Have you perhaps turned off parameter substitutions? Erik > On Feb 27, 2017, at 9:26 PM, Walter Underwood wrote: > > With this in the config… > >

Re: Using parameter values in a sort

2017-02-27 Thread Walter Underwood
With this in the config… edismax 0 false id, image_thumb_large, image_thumb_medium, image_thumb_small, image_thumb_xlarge, uri, user_id, last_name, first_name, name, school, major, graduation_year, tutor_profile_id, positive_re

Re: Using parameter values in a sort

2017-02-27 Thread Erik Hatcher
Walter - How about this, for the latter part of your request: /handler?features=a,b,c with &sort=sum(${features}) desc That ought to do the trick. At first I thought the #foreach nature of the list of features was prohibitive, but since you’re literally plugging in the exact string

Re: Using parameter values in a sort

2017-02-27 Thread Erick Erickson
Hmm, the syntax can be tricky. I'd start with a vanilla solrconfig.xml and get the syntax right just with curl or the browser, _then_ go to trying to embed it in solrconfig.xml. What error are you getting anyway? Erick On Mon, Feb 27, 2017 at 4:17 PM, Walter Underwood wrote: > We have documents

Re: OOM

2017-02-27 Thread Erick Erickson
How much memory are you giving the JVM anyway? On Mon, Feb 27, 2017 at 5:02 PM, Alexandre Rafalovitch wrote: > Marple will (probably) tell you whether you are indexing Chinese as > English text. Unlikely it would help with OOM (though I would be happy > to know if it did). > > Are you actually ge

Re: solr warning - filling logs

2017-02-27 Thread Walter Underwood
“Brittle” means that if the node fails, your cluster cannot change until the node is back up. Single point of failure. The whole point of Zookeeper is redundant protection against failure. So running a single Zookeeper node is just wrong. A Zookeeper ensemble needs to be an odd number of insta

Re: OOM

2017-02-27 Thread Alexandre Rafalovitch
Marple will (probably) tell you whether you are indexing Chinese as English text. Unlikely it would help with OOM (though I would be happy to know if it did). Are you actually getting the error as you are starting? Repeatedly? What's the stack trace looks like? Regards, Alex. http://www.s

Re: solr warning - filling logs

2017-02-27 Thread Mike Thomsen
It's a brittle ZK configuration. A typical ZK quorum is three nodes for most production systems. One is fine, though, for development provided the system it's on is not overloaded. On Mon, Feb 27, 2017 at 6:43 PM, Rick Leir wrote: > Hi Mike > We are using a single ZK node, I think. What problems

Using parameter values in a sort

2017-02-27 Thread Walter Underwood
We have documents with parameterized features. For a school subject (calculus, accounting), we have three sets of features. So for subject=4 and subject=186, we have: feature_a_4: 0.9 feature_b_4: 1.6 feature_c_4: 8.2 feature_a_186: 3.0 feature_b_186: 2.1 feature_c_186: 99.2 I’d like to pass in

OOM

2017-02-27 Thread Rick Leir
Hi all, We get an OOM after stopping then starting Solr (with a tiny index). Is there something I could check quickly before I break out the Eclipse debugger? Maybe Marple could tell me about problems in the index? Thanks -- Rick -- Sent from my Android device with K-9 Mail. Please excuse my br

Re: solr warning - filling logs

2017-02-27 Thread Rick Leir
Hi Mike We are using a single ZK node, I think. What problems should we expect? Thanks -- Rick -- Sent from my Android device with K-9 Mail. Please excuse my brevity.

Re: DIH: last_index_time not updated on if 0 docs updated

2017-02-27 Thread Erick Erickson
Seems like a legitimate request, if you can't find a JIRA feel free to open one. And if you wanted to supply a patch, _well_ ;) On Mon, Feb 27, 2017 at 10:37 AM, xavier jmlucjav wrote: > Hi, > > After getting our interval for calling delta index shorter and shorter, I > have found out that last_

DIH: last_index_time not updated on if 0 docs updated

2017-02-27 Thread xavier jmlucjav
Hi, After getting our interval for calling delta index shorter and shorter, I have found out that last_index_time in dataimport.properties is not updated every time the indexing runs, it is skipped if no docs where added. This happens at least in the following scenario: - running delta as full i

Re: About editing managed-schema by hand

2017-02-27 Thread Erick Erickson
see: https://cwiki.apache.org/confluence/display/solr/Schema+Factory+Definition+in+SolrConfig#SchemaFactoryDefinitioninSolrConfig-Switchingfromschema.xmltoManagedSchema bq: If we can modify the schema.xml through Schema API You can't do this by default, but if you insist you can change the Schem

Re: Query construction in custom Solr component plugin

2017-02-27 Thread Erick Erickson
Look for a couple of parameters, FROMLEADER and/or distrib=false. Not quite sure which one you need though. When a request comes in to the "aggregator" (just the first node in the cluster that the request lands on) it sends out sub-requests to one replica in each shard. These have to be marked do t

Re: Announcing Marple, a RESTful API & GUI for inspecting Lucene indexes

2017-02-27 Thread Alan Woodward
At the moment it only works with indexes accessible via the filesystem (ie via java.nio.Paths.get()). But pull requests are always welcome :) Alan Woodward www.flax.co.uk > On 27 Feb 2017, at 14:56, Joe Obernberger > wrote: > > Hi Charlie - will this work with an index stored in HDFS as wri

Re: Announcing Marple, a RESTful API & GUI for inspecting Lucene indexes

2017-02-27 Thread Doug Turnbull
Marple looks great, and if you want to work on really interesting Solr problems, I can heartily vouch for a career in consulting and recommend Flax as a great firm to work for! Best -Doug On Fri, Feb 24, 2017 at 12:26 PM Charlie Hull wrote: > On 24/02/2017 17:24, Charlie Hull wrote: > > Hi all,

Re: Announcing Marple, a RESTful API & GUI for inspecting Lucene indexes

2017-02-27 Thread Joe Obernberger
Hi Charlie - will this work with an index stored in HDFS as written by Solr Cloud? -Joe On 2/24/2017 12:24 PM, Charlie Hull wrote: Hi all, Very pleased to announce the first release of Marple, an open source tool for inspecting Lucene indexes. We've blogged about it here: http://www.flax.co

Re: Index Segments not Merging

2017-02-27 Thread Mike Thomsen
Just barely skimmed the documentation, but it looks like the tool generates its own shards and pushes them into the collection by manipulating the configuration of the cluster. https://www.cloudera.com/documentation/enterprise/5-8-x/topics/search_mapreduceindexertool.html If that reading is corre

Re: solr warning - filling logs

2017-02-27 Thread Mike Thomsen
When you transition to an external zookeeper, you'll need at least 3 ZK nodes. One is insufficient outside of a development environment. That's a general requirement for any system that uses ZK. On Sun, Feb 26, 2017 at 7:14 PM, Satya Marivada wrote: > May I ask about the port scanner running? Ca

Query construction in custom Solr component plugin

2017-02-27 Thread Baloo
Hi, I have developed a solr component which expands users query and adds additional clauses to the query. For this expansion we are making request to external REST api's. This query expansion logic is mainly in prepare() method. Everything works as expected in standalone mode. When we deploy this

solr warning - filling logs

2017-02-27 Thread Satya Marivada
Hi All, I have configured solr with SSL and enabled http authentication. It is all working fine on the solr admin page, indexing and querying process. One bothering thing is that it is filling up logs every second saying no authority, I have configured host name, port and authentication parameters

Re: About editing managed-schema by hand

2017-02-27 Thread Issei Nishigata
Thank you for your reply. If I was to say which one, I'd maybe be talking about the concept for Solr. I understand we should use "ClassicSchemaFactory" when we want to hand-edit, but why are there two files, schema.xml and managed-schema, in spite that we can hand-edit managed-schema? If we can mo

Re: Boolean expression for spatial query

2017-02-27 Thread Emir Arnautovic
Hi Michael, I haven't been playing with spatial for a while, but if it fully supports WKT, you could use Intersects instead of Contains and MULTIPOINT instead of POINT. Something like: fq={!field f=regionGeometry}Intersects(MULTIPOINT((x1 y1), (x2, y2))) In any case you can use OR-ed _query_