solrCloud insert data steps

2013-02-27 Thread rulinma
numshards=2 for example ids(1,4) will go to same shards I have shard1(ip1,ip2,ip3) shard2(ip4,ip5,ip6) that each shard has 3 nodes, and ip1 as the lead of shard1. If i insert ids(1,4), I think basic step is: 1 search lead, and insert ids(1,4) to the lead locally 2 at the lead node, search follow

Re: Solr 4 Spatial: NoClassDefFoundError: com/vividsolutions/jts/geom/Geometry

2013-02-27 Thread Smiley, David W.
Dotan, http://wiki.apache.org/solr/SolrAdaptersForLuceneSpatial4#Configuration You need to put the its jar within Solr's WEB-INF/lib; unfortunately you can't simply reference it via a entry and put it wherever. FWIW you can find the same question and my response on Stackoverflow. ~ David On 2/

Re: solr 4.1 spatial with JTS - spatial query withitin a WKT polygon contained within another query ...

2013-02-27 Thread Smiley, David W.
Hi Guilherme, That's a neat idea for a feature. It'd be nice if there was a proper Solr "Qparser" for these fields because that would then make a nice extension point to further dereference the shape reference from the index itself. There is a JIRA issue for that. At least writing such a Qparser

Re: Solr 4 Spatial: NoClassDefFoundError: com/vividsolutions/jts/geom/Geometry

2013-02-27 Thread Dotan Cohen
On Wed, Feb 27, 2013 at 10:24 AM, Smiley, David W. wrote: > Dotan, > > http://wiki.apache.org/solr/SolrAdaptersForLuceneSpatial4#Configuration > You need to put the its jar within Solr's WEB-INF/lib; unfortunately you > can't simply reference it via a entry and put it wherever. FWIW you > can fi

Re: Solrj. How to set different default field on a (join)filter query?

2013-02-27 Thread David Vdd
Hi, I think I fixed it by combining the join with edismax. sq.addFilterQuery{!join fromIndex=pageCore from=pageId to=fileId }{!edismax qf=description}Solr rocks) It seems to work now. -- View this message in context: http://lucene.472066.n3.nabble.com/Solrj-How-to-set-different-default-fiel

Re: Faceting on the first part or first letter of values

2013-02-27 Thread Alan Woodward
Hi Teun, In the past I've done this by creating a separate field that contains just the first letter of the original field, and faceting on that. So say you've got a 'colour' field with contents [red, yellow, blue], then you'd add a 'colourPrefix' field with contents [r, y, b] and facet/filter

SolrCloud query with shardid or not, different route

2013-02-27 Thread rulinma
I use SolrCloud with 2 shards and 4 nodes. for example: shard1: node1, node2. shard2: node3, node4 (1) If I request http://node1/*:*, then node1 and node2 will be queried and response data. (2) If I reqeust http://node1/*:*&shards=shard1, node1 will be queried and response, node2 no response. (3)

Re: Slaves always replicate entire index & Index versions

2013-02-27 Thread Bernd Fehling
May be the info about index version is pulled from the repeaters "data/replication.properties" file and the content of that file is wrong. Had something similar and only solution for me was deleting the replication.properties file. But no guarantee about this. Actually the replication is pretty mu

Re: update fails if one doc is wrong

2013-02-27 Thread Mikhail Khludnev
Colleagues, Here are my considerations If the exception is occurs somewhere in updateprocessor we can add a special update processor on top of the head of update processor chain, which will catch exception from delegated processAdd call, log and/or swallow it. If it fits for the purpose we can tr

Facet get distinct terms

2013-02-27 Thread yriveiro
Hi all, Anyone know if this patch works in distributed collections and if it's reliable? https://issues.apache.org/jira/browse/SOLR-2242 Thanks. /Yago - Best regards -- View this message in context: http://lucene.472066.n3.nabble.com/Facet-get-distinct-terms-tp4043350.html Sent from t

RE: solr 4.1 spatial with JTS - spatial query withitin a WKT polygon contained within another query ...

2013-02-27 Thread Pires, Guilherme
Hello David, Thanks for your response. I'm working deeply in this and it's fully decided that solr 4.1 + JTS is going to be supporting the map navigation for a 'public facing' GIS solution, i.e. will deliver the objects return by a bounding box intersection. Initially decided to index EVERYTHIN

Multicore Master - Slave - solr 3.6.1

2013-02-27 Thread Sujatha Arun
We have a multicore setup with more that 200 cores . Some of the cores have different schema based on the search type /language. While trying to migrate to Master /Slave set up. I see that we can specify the Master /Slave properties in solrcore.properties file . However does this have to done at

Re: Multi-threaded post.jar?

2013-02-27 Thread Upayavira
I took the cheap and cheerful approach, and created another class that wraps SimplePostTool. It makes lots of assumptions, such as that the shell will already have expanded any globs/wildcards, and just assigns various arguments to the various threads. It is good enough for what I need. The idea

Re: Unexpected '-' Results

2013-02-27 Thread Jan Høydahl
Well, as long as you know that introducing operators in your query will fallback to a pure boolean SHOULD query, you can do the workaround in your client query generating code, such as prefixing non-prefixed words with a "+". -- Jan Høydahl, search solution architect Cominvent AS - www.cominvent

Zookeeper/Solr Cloud not replicating

2013-02-27 Thread Christopher Gross
I've been trying out Solr 4 -- I was able to get it working with 3 instances of Tomcat on the same box (different ports), and 5 Zookeeper nodes on that box as well. I've started to get my production layout going, but I can't seem to get the Solr to replicate among the nodes. I can see that the So

Please ignore, testing my email

2013-02-27 Thread johnmunir
Hi, Please ignore, I'm testing my email (I have not received any email from Solr mailing list for over 12 hours now). -- MJ

Apache Solr 4.1 with RankingAlgorithm 1.4.7 available now -- includes realtime-search with multiple granularities

2013-02-27 Thread Nagendra Nagarajayya
Hi! I am very excited to announce the availability of Solr 4.1 with RankingAlgorithm40 1.4.7 with realtime-search (multiple granularities). realtime-search is very fast NRT and allows you to not only lookup a document by id but also allows you to search in realtime, see http://tgels.org/realt

Boosting Original Indexed Terms

2013-02-27 Thread dhaivat dave
Hello All, I need help in boosting original indexed terms. I am storing multiple terms at same position and i want to boost the original term. consider following scenario i am indexing document which contain the following text: "*baby t-shirts*" i am storing terms as following position12term

Re: Slaves always replicate entire index & Index versions

2013-02-27 Thread raulgrande83
I always have a "clean" index folder, I mean I don't get the index. folder at any time. Besides, I haven't noticed that slaves pull entire index in replication. I restarted my repeater node and replication started to work fine again, the slaves updated all the changes that their master had. But af

Boosting Original Indexed Terms

2013-02-27 Thread dhaivat
Hello All, I need help in boosting original indexed terms. I am storing multiple terms at same position and i want to boost the original term. consider following scenario i am indexing document which contain the following text: "baby t-shirts" i am storing terms as following here is the ind

Re: Slaves always replicate entire index & Index versions

2013-02-27 Thread Mark Miller
On Feb 27, 2013, at 4:40 AM, Bernd Fehling wrote: > Under this circumstances with replication I would not even dream about using > SolrCloud. The funny part about that is that the master->slave replication issue(s) in 4.1 don't apply to SolrCloud, so you would have had better luck :) - Mark

Re: Zookeeper/Solr Cloud not replicating

2013-02-27 Thread Mark Miller
First, looks at the admin/cloud tab and make sure the urls are right and reachable for each node. Are you using 4.0 or 4.1? 4.1 should make a better guess at the host name to use - you can override that and be explicit if it's guessing wrong. If you have nodes on different machines, you don't wa

Re: Zookeeper/Solr Cloud not replicating

2013-02-27 Thread Christopher Gross
After looking over the lucidworks documentation, they mentioned the "host" field in the solr.xml file. I had that as "localhost" -- since my last setup and all examples are done from a single server. Switching that out to be the actual hostname for each box fixed it all. I am using 4.1, FYI. Th

Re: Dropping slow queries

2013-02-27 Thread Michael Della Bitta
I'm pretty sure David's answer is correct. When this happens, you'll see a "partialResults" field in the response. Michael Della Bitta Appinions 18 East 41st Street, 2nd Floor New York, NY 10017-6271 www.appinions.com Where Influence Isn’t a Gam

Re: Multicore Master - Slave - solr 3.6.1

2013-02-27 Thread Michael Della Bitta
On Wed, Feb 27, 2013 at 7:01 AM, Sujatha Arun wrote: > 1) Added the properties as name value pairs in the solr.xml - *But these > values are lost on Server Restart* This is how you do it in my experience. Just make sure persistent="true" is set, and don't edit the file while the server is runnin

Solr 4.1 Master -> Slave Replication Issues and Solr 4.2

2013-02-27 Thread Mark Miller
FYI There have been a couple issues discovered around master->slave replication with Solr 4.1. The biggest issue tends to be that a full replication is triggered every time the slave polls the master, even if this is not needed. I'm out of my home base next week, but I plan on helping to drive

Re: Solr 4.1 Master -> Slave Replication Issues and Solr 4.2

2013-02-27 Thread Mark Miller
Oh yeah, forgot to mention. This is just for master-slave replication - these issues don't affect SolrCloud's use of replication. - Mark On Feb 27, 2013, at 10:43 AM, Mark Miller wrote: > FYI > > There have been a couple issues discovered around master->slave replication > with Solr 4.1. >

Re: Solr 4.1 Master -> Slave Replication Issues and Solr 4.2

2013-02-27 Thread Michael Della Bitta
Hello Mark, Thanks for the heads up. Are there any temporary fixes to this problem aside from waiting for 4.2? Thanks, Michael Della Bitta Appinions 18 East 41st Street, 2nd Floor New York, NY 10017-6271 www.appinions.com Where Influence Isn’t

Solr 3.6.1 Query large field

2013-02-27 Thread Mark Wilson
Hi I am using Nutch to crawl a site, and post it in Solr 3.6.1. The page is very large. When I query the index, using the Solr Admin query page, it only finds the result if it is in the top X% of the page, probably about 30%. The page is about 79Kb, and consists of 19,067 words. Is there a set

Re: Solr 4.1 Master -> Slave Replication Issues and Solr 4.2

2013-02-27 Thread Mark Miller
On Feb 27, 2013, at 10:51 AM, Michael Della Bitta wrote: > Are there any temporary fixes to this problem aside from waiting for 4.2? Not really. I guess my advice would be this: If you use SolrCloud or single node, don't worry, this doesn't affect you. If you use 4.1 master->slave replicatio

RE: solr 4.1 spatial with JTS - spatial query withitin a WKT polygon contained within another query ...

2013-02-27 Thread David Smiley (@MITRE.org)
Pires, Guilherme wrote > Hello David, > > Thanks for your response. > I'm working deeply in this and it's fully decided that solr 4.1 + JTS is > going to be supporting the map navigation for a 'public facing' GIS > solution, i.e. will deliver the objects return by a bounding box > intersection. In

RE: Solr 4.1 Master -> Slave Replication Issues and Solr 4.2

2013-02-27 Thread Hung Huynh
I found a blog a few days ago (don't remember the source now) stating that if you name the index folder as "index" and not "index.x", then the slave would stop pulling the full catalog every time. That was what I did and that seemed to be a good workaround for me. I stopped solr, rena

Re: Unexpected '-' Results

2013-02-27 Thread z...@navigo.com
Yes... we were trying to avoid getting between solr and the user query, but that's a good suggestion on a relatively simple approach. To make it full correct, I fear, gets towards a full formal query parser, but we may be able to slide. For now, we can leave it as a known issue and just let the pow

Formal Query Grammar

2013-02-27 Thread z...@navigo.com
I found where this had been asked, but did not find an answer. Is there a formal definition of the solr query grammar? Like a Chomsky grammar? Previous ask: http://lucene.472066.n3.nabble.com/FW-Formal-grammar-for-solr-lucene-td4010949.html -- View this message in context: http://lucene.4720

Re: DocValues support on 4.2

2013-02-27 Thread Shawn Heisey
On 2/27/2013 9:32 AM, yriveiro wrote: This new feature will force to index the collections again? Only if you add docValues="true" to fields in your schema. This represents a schema change, and re-indexing is already a requirement for most schema changes. Thanks, Shawn

RE: Solr 4.1 Master -> Slave Replication Issues and Solr 4.2

2013-02-27 Thread adityab
@Hung, Did you rename the index directory on master or on Slave? I tried this but didn't work for me. :( with every commit the slave creates a new index.x directory and download the complete index from master. My setup is JBoss7.1.1 with Solr 4.1 thanks Aditya -- View this message in

RE: Solr 4.1 Master -> Slave Replication Issues and Solr 4.2

2013-02-27 Thread Hung Huynh
Renamed it on the Slave server. The slave does create a new index.xx directory to store temporary files, but they are much smaller than the full catalog size. These files then get copied/merged to the "index" directory, and the index.xx directory is deleted at the end. I end up wit

Nodes out of sync, deletes fail

2013-02-27 Thread jimtronic
I'm not sure how it happened, but one of my nodes has different data than the others. When I try to delete the offending document by posting json to the /update url, it hangs and after a minute it just fails with no reply. I disconnected the offending node from the cloud and was able to delete t

Re: Nodes out of sync, deletes fail

2013-02-27 Thread Mark Miller
Solr 4.0 or 4.1? - Mark On Feb 27, 2013, at 12:33 PM, jimtronic wrote: > I'm not sure how it happened, but one of my nodes has different data than the > others. > > When I try to delete the offending document by posting json to the /update > url, it hangs and after a minute it just fails with

Re: Nodes out of sync, deletes fail

2013-02-27 Thread jimtronic
solrspec: 5.0.0.2012.12.03.13.10.02 -- View this message in context: http://lucene.472066.n3.nabble.com/Nodes-out-of-sync-deletes-fail-tp4043433p4043437.html Sent from the Solr - User mailing list archive at Nabble.com.

Re: Distributed Search and the Stale Check

2013-02-27 Thread Ryan Zezeski
On Mon, Feb 25, 2013 at 8:26 PM, Mark Miller wrote: > Please file a JIRA issue and attach your patch. Great write up! (Saw it > pop up on twitter, so I read it a little earlier). > > Done. https://issues.apache.org/jira/browse/SOLR-4509

Re: Solr regex search wiki page

2013-02-27 Thread Jack Krupansky
The Solr doc simply says: "Solr 4.0 added regular expression support, which means that '/' is now a special character and must be escaped if searching for literal forward slash." See: http://wiki.apache.org/solr/SolrQuerySyntax The Lucene doc adds a tiny bit: Regular Expression Searches Lu

Re: Formal Query Grammar

2013-02-27 Thread Jack Krupansky
Right here: http://svn.apache.org/viewvc/lucene/dev/tags/lucene_solr_4_1_0/solr/core/src/java/org/apache/solr/parser/QueryParser.jj?revision=1436334&view=markup -- Jack Krupansky -Original Message- From: z...@navigo.com Sent: Wednesday, February 27, 2013 11:44 AM To: solr-user@lucene.

Re: Formal Query Grammar

2013-02-27 Thread Roman Chyla
Or if you prefer EBNF, look here (but it differs slghtly from the grammar Jack linked to): https://github.com/romanchyla/montysolr/blob/master/contrib/antlrqueryparser/grammars/StandardLuceneGrammar.g roman On Wed, Feb 27, 2013 at 1:38 PM, Jack Krupansky wrote: > Right here: > > http://svn.apac

Re: Nodes out of sync, deletes fail

2013-02-27 Thread Mark Miller
You are working off trunk? Do you have any interesting info in the logs? - Mark On Feb 27, 2013, at 12:55 PM, jimtronic wrote: > solrspec: 5.0.0.2012.12.03.13.10.02 > > > > -- > View this message in context: > http://lucene.472066.n3.nabble.com/Nodes-out-of-sync-deletes-fail-tp4043433p4043

Re: Nodes out of sync, deletes fail

2013-02-27 Thread jimtronic
Oddly, not much info there. Here's what I do know. - I had a three node cluster running. - adding documents was also failing in the same exact way. - updates/deletes would make it to the elected leader, but then never show up on the other nodes. - eventually, after 30 seconds or so, the write to t

Re: Nodes out of sync, deletes fail

2013-02-27 Thread Mark Miller
On Feb 27, 2013, at 2:32 PM, jimtronic wrote: > It seems odd that the write should succeed on the leader even though it > didn't work on the other nodes. Currently, a leader does an update locally before sending in parallel to all replicas. If we can't send an update to a replica, because it c

Zookeeper Error When Trying to Setup SolrCloud on Weblogic

2013-02-27 Thread Mishra, Shikhar
Hi, I'm trying to setup Solr Could on Weblogic 12c. I've started Zookeeper in an independent mode (Host: localhost:2181). My solr.war is deployed on Weblogic with startup arguments: -Dsolr.solr.home=/opt/wwtdomain/solr -Dbootstrap_confdir=/opt/wwtdomain/solr/my_core/conf -Dcollection.configName=m

Re: Nodes out of sync, deletes fail

2013-02-27 Thread jimtronic
> > > Currently, a leader does an update locally before sending in parallel to > all replicas. If we can't send an update to a replica, because it crashed, > or because of some other reason, we ask that replica to recover if we can. > In that case, it's either gone and will come back and recover, o

query builder for solr UI?

2013-02-27 Thread eShard
Good day, Currently we are building a front end for solr (in jquery, html, and css) and I'm struggling with making a query builder that can handle pretty much whatever the end user types into the search box. does something like this already exist in javascript/jquery? Thanks, -- View this messa

Re: Nodes out of sync, deletes fail

2013-02-27 Thread Mark Miller
On Feb 27, 2013, at 3:51 PM, jimtronic wrote: > This seems to violate the strong consistency model doesn't it? If a write > doesn't succeed at a replica, it shouldn't succeed anywhere. We don't provide a strong consistency model - we provide an eventual consistency model overall - though you c

Re: org.apache.solr.cloud.ZkCLI timeout

2013-02-27 Thread Mark Miller
Did you adjust ZooKeeper so that it will accept files greater than 1MB per node? That's more config files than I've ever tried to deal with... - Mark On Feb 27, 2013, at 4:02 PM, varun srivastava wrote: > Hi, > I am using org.apache.solr.cloud.ZkCLI to push some a 56MB config into > zookeeper

RE: org.apache.solr.cloud.ZkCLI timeout

2013-02-27 Thread Markus Jelsma
That's very big indeed, why not store it locally in the core's lib dir? It should work IIRC. -Original message- > From:Mark Miller > Sent: Wed 27-Feb-2013 22:07 > To: solr-user@lucene.apache.org > Subject: Re: org.apache.solr.cloud.ZkCLI timeout > > Did you adjust ZooKeeper so that it

Re: org.apache.solr.cloud.ZkCLI timeout

2013-02-27 Thread varun srivastava
Hi Markus, Do you mean keeping the file in solr-cores/lib directory or inside collection1 ( if name of my solr cloud collection is collection1) ? In case I keep it inside solr-cores/lib will I get the file by calling SolrResourceLoader.openConfig(...) ? Mark, How can I tweak zookeeper limits

Re: org.apache.solr.cloud.ZkCLI timeout

2013-02-27 Thread varun srivastava
solr-cores is my solr/home On Wed, Feb 27, 2013 at 1:16 PM, varun srivastava wrote: > Hi Markus, > Do you mean keeping the file in solr-cores/lib directory or inside > collection1 ( if name of my solr cloud collection is collection1) ? > In case I keep it inside solr-cores/lib will I get the fi

Re: Problems with Solr 3.6 and Magento

2013-02-27 Thread dboychuck
I noticed that Magento is using the overwritePending commit directive but I can't find any documentation on this. Does the overwritePending directive purge any added docs since the last commit? Any help would be appreciated. -- View this message in context: http://lucene.472066.n3.nabble.com/Pr

Re: Unexpected '-' Results

2013-02-27 Thread Jan Høydahl
Or you can put that energy or money into contributing to solving SOLR-2649 :) -- Jan Høydahl, search solution architect Cominvent AS - www.cominvent.com Solr Training - www.solrtraining.com 27. feb. 2013 kl. 17:36 skrev z...@navigo.com: > Yes... we were trying to avoid getting between solr and t

Re: query builder for solr UI?

2013-02-27 Thread Jan Høydahl
Hi, Can you be more specific on what query you want to build an what you expect end users to enter into that/those boxes? Why are you not just using eDisMax? -- Jan Høydahl, search solution architect Cominvent AS - www.cominvent.com Solr Training - www.solrtraining.com 27. feb. 2013 kl. 22:05 s

Re: Problems with Solr 3.6 and Magento

2013-02-27 Thread Jan Høydahl
Please direct your questions to Magento Inc or whoever maintains the integration. -- Jan Høydahl, search solution architect Cominvent AS - www.cominvent.com Solr Training - www.solrtraining.com 28. feb. 2013 kl. 00:22 skrev dboychuck : > I noticed that Magento is using the overwritePending comm

Solr3.5 Vs Solr4.1 - Help please

2013-02-27 Thread adityab
Hi, A little history before i tell the actual issue. Please bare with me. In Dev lab with a single VM (2vCPU, 4gb RAM, 3Gb to JVM, JBoss5.1, JDK1.6.0.30) we used Solr 4.1 and indexed 250K documents with each document of avg size 22Kb - Totla index size is 3.6GB. Every thing works good. The only q

MultiValued Search using Filter Query

2013-02-27 Thread Deepak
Hi How can I filter records using filter query on multiValued field. Here are two records { "sub_count":8, "long_name":"Mike", "first_name":"John", "id":45949, "sym":"TEST", "type":"T", "last_name":"Account", "person_id":"3613

Re: Dropping slow queries

2013-02-27 Thread adm1n
Am I missing something? which answer do you mean? And actually, just to clarify, the question was how can I force the partial results and drop the results from the slow shard? -- View this message in context: http://lucene.472066.n3.nabble.com/Dropping-slow-queries-tp4043074p4043549.html Sent

RE: Can't search words in quotes

2013-02-27 Thread Alex Cougarman
Thanks, Oussama. That was very useful information and we have added the double quotes. One interesting trick: we had to change the way we did it to wrap the pattern value in single quotes so we could have double quotes inside. Warm regards, Alex Cougarman Bahá'í World Centre Haifa, Israel Offi

Re: Can't search words in quotes

2013-02-27 Thread Dotan Cohen
On Thu, Feb 28, 2013 at 8:14 AM, Alex Cougarman wrote: > Thanks, Oussama. That was very useful information and we have added the > double quotes. One interesting trick: we had to change the way we did it to > wrap the pattern value in single quotes so we could have double quotes inside. > Hi Al

RE: Can't search words in quotes

2013-02-27 Thread Jilal Oussama
You are welcome Alex Glad it worked fine. On Feb 28, 2013 6:15 AM, "Alex Cougarman" wrote: > Thanks, Oussama. That was very useful information and we have added the > double quotes. One interesting trick: we had to change the way we did it to > wrap the pattern value in single quotes so we could

Re: Solr3.5 Vs Solr4.1 - Help please

2013-02-27 Thread Otis Gospodnetic
Hi, Could it be field compression that, I believe, is on by default? Otis -- SOLR Performance Monitoring - http://sematext.com/spm/index.html On Wed, Feb 27, 2013 at 9:51 PM, adityab wrote: > Hi, > A little history before i tell the actual issue. Please bare with me. > In Dev lab with a s