Re: Understanding query behaviour in LBHttpSolrServer

2014-07-17 Thread search engn dev
Thanks Shawn, I am also not sure about query flow , >From my understanding solr and solrj works as below, 1. LBHttpSolrServer keeps pinging above list of servers and maintains list of live servers. 2. Every time query arives it picks one server from the list (round-robin fashion) 3. Sends que

Re: Understanding query behaviour in LBHttpSolrServer

2014-07-17 Thread Shawn Heisey
On 7/17/2014 11:15 PM, search engn dev wrote: > I just want to understand query flow and how load balancing works in case of > LBHttpSolrServer. We have setup SolrCloud with one collection, and that > collection has 4 shards and each shard has two nodes i.e one master and one > replica. If you're

SolrCloud performance issues regarding hardware configuration

2014-07-17 Thread search engn dev
I need help regarding hardware configuration of my SolrCloud setup. most of the queries to our SolrCloud are boolean queries involving 6-7 fields and spatial and facet queries. currently for facet queries solr throws OOM errors. below are my solrcloud stats, solr version 4.6.1 1 collection : 4 sha

Query join on multiple fields

2014-07-17 Thread Haiying Wang
Can Solr query join on multiple fields? Or, anyway to achieve equivalent function with current join syntax? From the Solr Wiki and examples found on the web, the syntax only supports join on one field from a doc to another field of other docs, like below: {!join from=customer_name to=name}stat

Re: Memory leak for debugQuery?

2014-07-17 Thread Umesh Prasad
Histogram by itself isn't sufficient to root cause the JVM heap issue. We have found JVM heap memory issues multiple times in our system and each time it was due to a different reasons. I would recommend taking heap dumps at regular interval (using jmap/visual vm) and analyze those heap dumps. T

Understanding query behaviour in LBHttpSolrServer

2014-07-17 Thread search engn dev
I just want to understand query flow and how load balancing works in case of LBHttpSolrServer. We have setup SolrCloud with one collection, and that collection has 4 shards and each shard has two nodes i.e one master and one replica. I have configured LBHttpSolrServer as below. SolrServer lbHttpS

Re: How do I get faceting to work with Solr JOINs

2014-07-17 Thread Umesh Prasad
Hi Vinay, You can customize the FacetsComponent. Basically FacetComponent uses SimpleFacets to compute the facet count. It passes matched docset present in responsebuilder to SimpleFacets's constructor. 1. Build a mapping between parent space and auxiliary document space in (say an int array) a

Re: Inconsistant result's on solr cloud 4.8

2014-07-17 Thread Joel Bernstein
Also, it would be a good idea to verify if the numDocs are in sync between leaders and replicas. You can view this from the admin screens. Joel Bernstein Search Engineer at Heliosearch On Thu, Jul 17, 2014 at 9:53 PM, Erick Erickson wrote: > Is there any chance that there's a commit happening

Re: problem with replication/solrcloud - getting 'missing required field' during update intermittently (SOLR-6251)

2014-07-17 Thread nneul
There are several required fields - timestamp is one of them. All the required fields are present in the document, including a single element in the 'channel' array. SOLR-6255 created. I'll try to reproduce with a minimal schema asap. -- Nathan On 07/17/2014 09:07 PM, Erick Erickson [via Lucen

Re: problem with replication/solrcloud - getting 'missing required field' during update intermittently (SOLR-6251)

2014-07-17 Thread Erick Erickson
Hmmm, is "channel" a multiValued field or not? I'm guessing that "id" is the only required field, and if so the error message is misleading at best. So yeah, it's probably a reasonable thing to open a JIRA. Please include the schema file (as small as you can make it) and the JSON as well. Not prom

Re: Shard Replicas not getting replicated data from leader

2014-07-17 Thread Erick Erickson
Right, so did that fix your problem? On Thu, Jul 17, 2014 at 7:10 AM, Marc Campeau wrote: > Turns out updateLog had been disabled in solrconfig.xml > > Marc > > > 2014-07-16 16:44 GMT-04:00 Marc Campeau : > > > Hi, > > > > I have setup 4 Solr (4.9.0) Nodes into a single shard for a given > > co

Re: questions on Solr WordBreakSolrSpellChecker and WordDelimiterFilterFactory

2014-07-17 Thread Erick Erickson
Zeroth, take a look at the admin/analysis page with that input and see if your field in analyzing x-box and xbox like you expect. First, try adding &debug=all to the URL, that'll show you exactly what the parsed query was. It may surprise you. Second, examine what's actually _in_ the index with t

Re: Inconsistant result's on solr cloud 4.8

2014-07-17 Thread Erick Erickson
Is there any chance that there's a commit happening in between these calls causing the number of files to change? Is there any indexing going on at all? Best, Erick On Wed, Jul 16, 2014 at 7:26 PM, Cool Techi wrote: > Hi, > We are using solr cloud with solr version 4.8, we have 2 shard/2 repli

Re: weird drastic query latency during performance testing and DIH import delay after performance testing

2014-07-17 Thread Erick Erickson
This is very strange. I have no idea why DIH is taking so long. What happens if you execute the DIH query in some SQL front end? It's possible that DIH is just taking forever to execute the SQL query because of how it's written. I'm having trouble following the query results, but again this is sup

Re: Contiguous Phrase Highlighting Example

2014-07-17 Thread Koji Sekiguchi
Hi Teague, If you want phrase-unit tagging for highlighter, you need to use FastVectorHighlighter instead of the ordinary Highlighter. To turn on FVH, set hl.useFastVectorHighlighter=on when querying. In addition, when indexing, you need to set termVectors=on, termPositions=on and termOffsets=on

Re: Solr 4.7.2 auto suggestion

2014-07-17 Thread Alexandre Rafalovitch
On Thu, Jul 17, 2014 at 11:01 PM, benjelloun wrote: > i'm trying to do auto suggestion but thats not working. Not working specifically how? What do you put in, what did you get back, what did you expect? Regards, Alex. Personal: http://www.outerthoughts.com/ and @arafalov Solr resources: htt

Re: Boost using date and a field value

2014-07-17 Thread Hakim Benoudjit
The real issue is that I'm having issues to balance my two boosted fields, although I've added a coefficient to them. What I've done is that I have a boost query with the two fields: field1:value1 AND date:[ TO ], to have all today's docs satisfying the condition field1 = value1 first of the list.

How do I get faceting to work with Solr JOINs

2014-07-17 Thread Vinay B,
Some Background info : In our application, we have a requirement to update large number of records often. I investigated solr child documents but it requires updating both the child and the parent document . Therefore, I'm investigating adding frequently updated information in an "auxillary docume

Re: problem with replication/solrcloud - getting 'missing required field' during update intermittently (SOLR-6251)

2014-07-17 Thread nneul
Should I go ahead and submit this as a distinct bug issue w/ the query parsing/json now that it's more clear what the problem is? Jack Krupansky-2 wrote > At least parts of Solr use semi-custom JSON parsing that allows repeating > a > map key, so either this particular feature didn't use that pa

Re: Solr/Tomcat (embedded) Replication

2014-07-17 Thread Shawn Heisey
On 7/17/2014 12:56 PM, SWP wrote: > Trying to get replication working with embedded Solr (4.4.0) running in a > Tomcat6 container with the below master & slave configuration -> If you are using EmbeddedSolrServer, regardless of whether that code is running in Tomcat or not, there is no HTTP access

Solr/Tomcat (embedded) Replication

2014-07-17 Thread SWP
Hello, Trying to get replication working with embedded Solr (4.4.0) running in a Tomcat6 container with the below master & slave configuration -> Master (solrconfig.xml): true startup commit Slave (solrconfig.xml): ${enable.slave:true} http://$search_master:

Re: problem with replication/solrcloud - getting 'missing required field' during update intermittently (SOLR-6251)

2014-07-17 Thread nneul
Actually, turns out the 'intermittent' was our misinterpretation - we never noticed that we were only occcasionally adding to two channels... Once I figured that out, symptom is 100% repeatable and consistent. Yonik Seeley-5 wrote > On Wed, Jul 16, 2014 at 10:20 PM, Nathan Neulinger < > nneul@

Contiguous Phrase Highlighting Example

2014-07-17 Thread Teague James
Hi everyone! Does anyone have any good examples of generating a contiguous highlight for a phrase? Here's what I have done: curl http://localhost/solr/collection1/update?commit=true -H "Content-Type: text/xml" --data-binary '100blah blah blah knowledge of science blah blah blah' Then, using a br

Fwd: Script Transformer Help

2014-07-17 Thread pavan patharde
Hi Alex, I tried putting the transformer on the inner entity. Now i can not access the parent entity fields. Can you tell me how to read the parent fields ? Regards, Pavan .P.Patharde On Thu, Jul 17, 2014 at 10:08 AM, Alexandre Rafalovitch wrote: > Have you tried putting the transformer on

Re: solr wiki: 'Support for Solr' page edit policy

2014-07-17 Thread jmlucjav
appreciated Stefan. Done updating. On Thu, Jul 17, 2014 at 5:36 PM, Stefan Matheis wrote: > Xavi > > It’s the former :) I’ve adding you to the contributors group > > -Stefan > > > On Thursday, July 17, 2014 at 5:19 PM, jmlucjav wrote: > > > Hi guys, > > > > I don't remember anymore what is the

Re: Script Transformer Help

2014-07-17 Thread pavan patharde
Hi Alex, I tried putting the transformer on the inner entity. Now i can not access the parent entity fields. Can you tell me how to read the parent fields ? Regards, Pavan .P.Patharde On Thu, Jul 17, 2014 at 10:08 AM, Alexandre Rafalovitch wrote: > Have you tried putting the transformer on

Re: problem with replication/solrcloud - getting 'missing required field' during update intermittently (SOLR-6251)

2014-07-17 Thread Yonik Seeley
On Wed, Jul 16, 2014 at 10:20 PM, Nathan Neulinger wrote: > [{"id":"4b2c4d09-31e2-4fe2-b767-3868efbdcda1","channel": {"add": > "preet"},"channel": {"add": "adam"}}] > > Look at the JSON... It's trying to add two "channel" array elements... > Should have been: [...] > From what I'm reading on JSON

Solr 4.7.2 auto suggestion

2014-07-17 Thread benjelloun
Hello, i'm trying to do auto suggestion but thats not working. here is my configuration: schema:

Re: Indexing database in Solr using Data Import Handler

2014-07-17 Thread Sam Barber
Hi, You have the wrong varname in your sub query. select favouritedby from filefav where id= '${filemetadata.id}' should be select favouritedby from filefav where id= '${restaurant.id}'

Re: solr boosting any perticular URL

2014-07-17 Thread Michael Della Bitta
Rahul, Check out the relevancy FAQ. You probably want to boost that field value at index time, or use the query elevation component. http://wiki.apache.org/solr/SolrRelevancyFAQ Michael Della Bitta Applications Developer o: +1 646 532 3062 appinions inc. “The Science of Influence Marketing”

Re: Strange Scoring Results

2014-07-17 Thread Michael Carlson
Okay, not sure if the following will help with troubleshooting, but here are a couple of links that show visual representations of how the scores for these results are calculated. For these queries I got rid of my boosts to make the results easier to read. Here are the top 10 scoring results: h

Re: solr wiki: 'Support for Solr' page edit policy

2014-07-17 Thread Stefan Matheis
Xavi It’s the former :) I’ve adding you to the contributors group -Stefan On Thursday, July 17, 2014 at 5:19 PM, jmlucjav wrote: > Hi guys, > > I don't remember anymore what is the policy to have someone added to this > page: > > - ask for edit rights and add your own line where needed

Re: problem with replication/solrcloud - getting 'missing required field' during update intermittently (SOLR-6251)

2014-07-17 Thread Jack Krupansky
At least parts of Solr use semi-custom JSON parsing that allows repeating a map key, so either this particular feature didn't use that parsing technique, or didn't have the logic to kick out the problem, or didn't process it properly. So, I think this is SOME kind of issue on the Solr side, if

solr wiki: 'Support for Solr' page edit policy

2014-07-17 Thread jmlucjav
Hi guys, I don't remember anymore what is the policy to have someone added to this page: - ask for edit rights and add your own line where needed - send someone your line and they'll add it for you. If the former, could I get edit permissions for the wiki? My login is jmlucjav. If the later, who

solr boosting any perticular URL

2014-07-17 Thread rahulmodi
Hi There, I am new to Solr. My client is asking me to boost a particular URL so that it should appear on the top of the results. I have already searched on various websites but i did not found boosting for particular URL. Please tell me whether this feature is available or not, if available then

Re: Shard Replicas not getting replicated data from leader

2014-07-17 Thread Marc Campeau
Turns out updateLog had been disabled in solrconfig.xml Marc 2014-07-16 16:44 GMT-04:00 Marc Campeau : > Hi, > > I have setup 4 Solr (4.9.0) Nodes into a single shard for a given > collection, meaning I should have 4 replicated nodes. I have 3 Zookeepers > in ensemble managing the configs for t

RE: SolrCloud Issues

2014-07-17 Thread Cool Techi
1) The Zookeepers are on the same node as Solr, should we move them out? What would be the basic config's of machine just running Zookeepers? 2) The servers are pretty big, 2 X Quad Core processors 64 bit 96Gb of RAM 500GB SSD drive on which solr resides The index side

RE: SolrCloud Issues

2014-07-17 Thread Dan Murphy
Have you deployed ZooKeeper on servers other than the Solr nodes? If you have them on the Solr nodes, then you may be getting elections when under pressure. -Original Message- From: Shawn Heisey [mailto:s...@elyograg.org] Sent: 17 July 2014 14:25 To: solr-user@lucene.apache.org Subject:

Re: SolrCloud Issues

2014-07-17 Thread Shawn Heisey
On 7/17/2014 6:57 AM, Cool Techi wrote: > We have moved to SolrCloud (version 4.8) and are facing several issues in > this setup compared to the master/slave setup we have had for a while now, > 1) We have a 2 shard set-up with one replica each, we notice that most of the > time the replica's are

Re: Slow inserts when using Solr Cloud

2014-07-17 Thread ian
Hi Tim Thanks for the info about the bug. I've just looked at the CPU usage for the leader using JConsole, while my bulk load process was running, inserting documents into my Solr cloud. Is that what you meant by profiling and looking for hotspots? I find the CPU usage goes up quite a lot when

SolrCloud Issues

2014-07-17 Thread Cool Techi
Hi, We have moved to SolrCloud (version 4.8) and are facing several issues in this setup compared to the master/slave setup we have had for a while now, 1) We have a 2 shard set-up with one replica each, we notice that most of the time the replica's are in recovering status. What could be causing

Re: questions on Solr WordBreakSolrSpellChecker and WordDelimiterFilterFactory

2014-07-17 Thread jiag
Hi Ahmet, using or didn't make any difference. Still running into the same issues aforementioned :( Thanks, Jia On 7/16/2014, "Ahmet Arslan" wrote: >Hi Jia, > >What happens when you use  > >  > >instead of  > >  > >Ahmet > > >On Wednesday, July 16, 2014 3:07 AM, "j...@ece.ubc.ca" wrote: > >

Re: Request to be added to the ContrubitorsGroup

2014-07-17 Thread Stefan Matheis
Hey Vitaly i’ve added you to the contributors group -Stefan On Thursday, July 17, 2014 at 12:58 PM, p...@satisware.com wrote: > Hi there, > Could you please add me as a contributor? > My username is VitaliyVerbenko > Thanks in advance! > - > Vitaliy Verbenko > Marketing Guy > Helprace by S

Request to be added to the ContrubitorsGroup

2014-07-17 Thread pr
Hi there, Could you please add me as a contributor? My username is VitaliyVerbenko Thanks in advance! - Vitaliy Verbenko Marketing Guy Helprace_by_Satisware

Re: Boost using date and a field value

2014-07-17 Thread Alexandre Rafalovitch
Well, to start, it would help to know what "can't combine the boosts" mean in your case. Are you saying you can only apply one at a time? Are you saying that you see the effect of both but having troubles balancing them? Something else? The more complex use cases become, the more precise informat

Re: Boost using date and a field value

2014-07-17 Thread Hakim Benoudjit
Any idea please? 2014-07-15 15:00 GMT+01:00 Hakim Benoudjit : > Hi, > I want to boost recent (*today's*) documents having a certain *field > value*. The two fields to be bosted are respectively: '*date*' & '*site*'. > But I dont want to penalize *recent *documents not satisfying the field > valu