Solr 5.2.1 deadlock on commit

2015-12-07 Thread Ali Nazemian
Hi, There is a while since I have had problem with Solr 5.2.1 and I could not fix it yet. The only think that is clear to me is when I send bulk update to Solr the commit thread will be blocked! Here is the thread dump output: "qtp595445781-8207" prio=10 tid=0x7f0bf68f5800 nid=0x5785 waiting f

Re: Use multiple istance simultaneously

2015-12-07 Thread Shawn Heisey
On 12/4/2015 6:37 AM, Gian Maria Ricci - aka Alkampfer wrote: > Many thanks for your response. > > I worked with Solr until early version 4.0, then switched to ElasticSearch > for a variety of reasons. I've used replication in the past with SolR, but > with Elasticsearch basically I had no problem

Solr Spatial search with self-intersecting polygons

2015-12-07 Thread Vishnu perumal
Hi, I’m using Solr 4.10.2 with an up to date version of JTS and spatial4j. As field type in my schema.xml i’m using “location_rpt” like the description in the documentation. ( http://wiki.apache.org/solr/SolrAdaptersForLuceneSpatial4#How_to_Use) location_rpt field type setup: My filter quer

Re: secure solr 5.3.1

2015-12-07 Thread Don Bosco Durai
Have you considered running your Solr as SolrCloud with embedded zookeeper? If you do, you have multiple options. Basic Auth, Kerberos and authorization support. Bosco On 12/7/15, 7:03 AM, "kostali hassan" wrote: >How I shoud secure my server of solr 5 .3.1 in single-node Mode. I Am >se

Re: how to control location of solr PID file

2015-12-07 Thread Shawn Heisey
On 12/5/2015 3:21 PM, tedsolr wrote: > I'm running v5.2.1 on red hat linux. The "solr status" command is not > recognizing all my nodes. Consequently, "solr stop -all" only stops the node > on 8983. What's the recommended file structure for placing multiple nodes on > the same host? I am trying mul

Re: ZooKeeper nodes die taking down Solr Cluster?

2015-12-07 Thread Shawn Heisey
On 12/1/2015 8:21 AM, Kelly, Frank wrote: > java.lang.OutOfMemoryError: Java heap space > 597593838 INFO > (zkCallback-4-thread-1103-processing-n:52.91.90.134:8983_solr) [ ] > o.a.s.s.ZkIndexSchemaReader A schema change: WatchedEvent > state:SyncConnected type:NodeDataChanged > path:/configs/my

Re: Match All terms in indexed field value

2015-12-07 Thread Ahmet Arslan
Hi Senthil, Please see my response (FunctionQery) to the same question on the list: http://find.searchhub.org/document/d3af5d5a74114a07#5081d5c01219dbdf Thanks, Ahmet On Monday, December 7, 2015 4:52 AM, Senthil wrote: Scenario: Document should be matched/returned ONLY IF user entered search

Re: Highlighting tag problem

2015-12-07 Thread Erick Erickson
bq: So the fields in the fl will affect the fields that will be highlighted? No. The pedantry was that one of the replies could be read as the fl specification affected what fields were _searched_. On Mon, Dec 7, 2015 at 2:43 PM, Zheng Lin Edwin Yeo wrote: > So the fields in the fl will affect t

Re: Highlighting tag problem

2015-12-07 Thread Zheng Lin Edwin Yeo
So the fields in the fl will affect the fields that will be highlighted? Isn't only those fields that are specified in hl.fl be highlighted? As I found some fields that are not specified in hl.fl also got highlighted, but since it is not specified in hl.fl, that field is not shown in the result se

Re: how to control location of solr PID file

2015-12-07 Thread tedsolr
Thanks Hoss. I did not use the service install script to install solr. I don't have the service tool setup as a shortcut. I suppose I'll just have to specify the port when shutting down a node since "-all" does not work. Obviously I'm not a unix admin. -- View this message in context: http://l

Re: FastVector Highlighter

2015-12-07 Thread Zheng Lin Edwin Yeo
Hi Emir, Thanks for the clarification. If that improve the search performance then it is worthwhile to have the bigger index size. Since for any search engine, it is the search returning speed and accuracy that determines if the search engine is a good one. Regards, Edwin On 7 December 2015 at

Re: Solrcloud: 1 server, 1 configset, multiple collections, multiple schemas

2015-12-07 Thread Shawn Heisey
On 12/7/2015 9:46 AM, bengates wrote: > If I understand well, there is actually no way to create a core or a > collection from the API, with a defined-at-once configset, without having to > do some CLI commands on the remote server? With SolrCloud, the only step that requires commandline is upload

Re: how to control location of solr PID file

2015-12-07 Thread Chris Hostetter
: Subject: how to control location of solr PID file https://cwiki.apache.org/confluence/display/solr/Taking+Solr+to+Production https://cwiki.apache.org/confluence/display/solr/Taking+Solr+to+Production#TakingSolrtoProduction-Environmentoverridesincludefile >> Environment overrides include file

Re: Highlighting tag problem

2015-12-07 Thread Erick Erickson
Pedantry here: bq: Unless you override fl or hl.fl in url parameters you can get a hit in content_type, last_modified, url, or score and those fields will not get highlighted. In the main correct, but the phrasing makes it seem like the fl parameter has something to do with the fields _searched_,

Re: Highlighting tag problem

2015-12-07 Thread Scott Stults
I see. There appears to be a gap in what you can match on and what will get highlighted: id, title, content_type, last_modified, url, score id, title, content, author, tag Unless you override fl or hl.fl in url parameters you can get a hit in content_type, last_modified, url, or score and those

Re: Solr 5.2.1 Most solr nodes in a cluster going down at once.

2015-12-07 Thread Erick Erickson
Tell us a bit more. Are you adding documents to your collections or adding more collections? Solr is a balancing act between the number of docs you have on each node and the memory you have allocated. If you're continually adding docs to Solr, you'll eventually run out of memory and/or hit big GC

Re: Stop adding content in Solr through /update URL

2015-12-07 Thread Chris Hostetter
: Never made it into CHANGES.txt either. Not part of any patch either. : Appears to have been secretly committed as a part of SOLR-6787 (Blob API) via : Revision *1650448 : * in Solr 5.1. Really? ... huh ... i could have sworn it was mu

Solr 5.2.1 Most solr nodes in a cluster going down at once.

2015-12-07 Thread philippa griggs
Hello, I'm using: Solr 5.2.1 10 shards each with a replica. (20 nodes in total) Zookeeper 3.4.6. About half a year ago we upgraded to Solr 5.2.1 and since then have been experiencing a 'wipe out' effect where all of a sudden most if not all nodes will go down. Sometimes they will recover

Re: Solrcloud: 1 server, 1 configset, multiple collections, multiple schemas

2015-12-07 Thread bengates
F*ck. I switched from normal Solr to SolrCloud, thanks to the feature that allow to create cores (collections) on-the-fly with the API, without having to tell Solr where to find a schema.xml / a solrconfig.xml and let it create them itself from a pre-defined configset. If I understand well, there

Re: FastVector Highlighter

2015-12-07 Thread Emir Arnautovic
Hi Edwin, It is expected since you are storing more info about document. Thanks, Emir p.s. one correction - I meant offsets, not frequencies. On 07.12.2015 15:47, Zheng Lin Edwin Yeo wrote: Hi Emir, The term vector, positions and frequencies wasn't enabled, so I'm doing the re-indexing. That

Re: Max indexing threads & RamBuffered size

2015-12-07 Thread KNitin
Thanks Eric. I will profile and check it out. On Saturday, December 5, 2015, Erick Erickson wrote: > bq: What adds bottleneck in the indexing flow? Is it the buffering and > flushing > out to disk ? > > It Depends (tm). What do the Solr logs show when one of these two things > happens? > > You p

secure solr 5.3.1

2015-12-07 Thread kostali hassan
How I shoud secure my server of solr 5 .3.1 in single-node Mode. I Am searching for the best way to secure my server solr but I found only for cloud mode.

Re: FastVector Highlighter

2015-12-07 Thread Zheng Lin Edwin Yeo
Hi Emir, The term vector, positions and frequencies wasn't enabled, so I'm doing the re-indexing. That is where I found that the index size is bigger than previously when I was using the Original Highlighter. Regards, Edwin On 7 December 2015 at 19:19, Emir Arnautovic wrote: > Hi Edwin, > Fas

Increasing Solr5 time out from 30 seconds while starting solr

2015-12-07 Thread D
Hi, Many time while starting solr I see the below message and then the solr is not reachable. |debraj@boutique3:~/solr5$ sudo bin/solr start -p 8789 Waiting to see Solr listening on port 8789 [-] Still not seeing Solr listening on 8789 after 30 seconds!| However when I try to start solr ag

NullPointer from updateLog in solr4.8

2015-12-07 Thread Miriam Wells
I was trying to update a bunch of documents in Solr and commit them: I got this error (It's been working for a long time.) I have a setup of multiple cores and I'm updating docs from a bunch of them.. I commit all the cores I change. Once I stop and start my Solr again I can add and commit the ob

Joins with SolrCloud

2015-12-07 Thread Mugeesh Husain
I have create 3 cores on same machine using solrlcoud. core: Restaurant,User,Review each of core has only 1 shards and 2 replicas. Question 1.) It is possible to use join among 3 of cores on same machine( or different machine) 2.)I am struggling how to use join among 3 of core in solrlcoud mode.

Re: Grouping by simhash signature

2015-12-07 Thread Toke Eskildsen
On Wed, 2015-12-02 at 13:00 -0700, Nickolay41189 wrote: > I try to implement NearDup detection by SimHash > algorithm in Solr. [...] > How can I get groups of nearDup by /simhash_signature/? You could follow the suggested recipe at the page y

Re: FastVector Highlighter

2015-12-07 Thread Emir Arnautovic
Hi Edwin, FastVector Highlighter requires term vector, positions and frequencies, so if it is not enabled on fields that you want to highlight, it will increase index size. Since it is common to have those enabled for standard highlighter to speed up highlighting, those might already be enable

FastVector Highlighter

2015-12-07 Thread Zheng Lin Edwin Yeo
Hi, Would like to check, will using the FastVector Highlighter takes up more indexing space (the index size) as compared to the Original Highlighter? I'm using Solr 5.3.0 Regards, Edwin