Solr 4.10 Suggestor

2016-03-19 Thread Matt Kuiper
All, Using the Suggestor component and running Solr 4.10. I have read that on Solr startup (or commit, depending on config) the building of the Suggestor can be CPU intensive and take some time. Does anyone know how to determine that the Suggestor has completed it's build? Something to look

RE: Solr 4.10 Suggestor

2016-03-19 Thread Matt Kuiper
ifying the buildOnStartup=false was ignored. See SOLR-6679. That JIRA just took the suggester out of solrconfig.xml, it wasn't until SOLR-6845 IMO, this pretty much makes suggester unusable for a large corpus. Erick On Wed, Mar 16, 2016 at 2:35 PM, Matt Kuiper wrote: > All, > > Using the

Reload or Reload and Solr Restart

2016-03-23 Thread Matt Kuiper
Hi, I am preparing for a Production install. In this release we will be moving from an AutoSuggest feature based on the Suggestor component to one based on an Ngram approach. We will perform a re-index of the source data. [ After up

RE: Reload or Reload and Solr Restart

2016-03-24 Thread Matt Kuiper
Based on what I have read, it looks like only a collection reload is needed for the scenario below and for that matter for applying any modifications to the solrconfig.xml. Matt From: Matt Kuiper Sent: Wednesday, March 23, 2016 10:26 AM To: solr-user@lucene.apache.org Subject: Reload or Reload

Tips for Shard recovery?

2015-07-31 Thread Matt Kuiper
Hello, Wondering if there are any tips on how to recover a shard when all nodes are down for a shard and ZK cannot find a leader ( clusterstate.json has no replica marked as leader for a shard)? Bouncing the nodes does not seem to help. Seems like I need to reset the clusterstate Running

Solr Monitoring - Stored Stats?

2015-03-25 Thread Matt Kuiper
Hello, I am familiar with the JMX points that Solr exposes to allow for monitoring of statistics like QPS, numdocs, Average Query Time... I am wondering if there is a way to configure Solr to automatically store the value of these stats over time (for a given time interval), and then allow a u

RE: Solr Monitoring - Stored Stats?

2015-03-26 Thread Matt Kuiper
sure whether things like Nagios, Zabbix and the like have this kind of stuff built in seems like a natural extension of those kinds of tools though Not much help here... Erick On Wed, Mar 25, 2015 at 8:26 AM, Matt Kuiper wrote: > Hello, > > I am familiar with the JMX points that S

How to recover a Shard

2015-04-01 Thread Matt Kuiper
Hello, I have a SolrCloud (4.10.1) where for one of the shards, both replicas are in a "Recovery Failed" state per the Solr Admin Cloud page. The logs contains the following type of entries for the two Solr nodes involved, including statements that it will retry. Is there a way to recover fro

RE: How to recover a Shard

2015-04-01 Thread Matt Kuiper
way to recover without restarting the Solr node? Basically to delete one replica and then somehow declare the other replica the leader and break it out of its recovery process? Thanks, Matt From: Matt Kuiper Sent: Wednesday, April 01, 2015 8:43 PM To: solr-user@lucene.apache.org Subject: How to

RE: How to recover a Shard

2015-04-02 Thread Matt Kuiper
replicas back it'd replicate the index from the leader, but at least you might not have to take Solr down. I'm not completely sure that this'll work, mind you but Erick On Wed, Apr 1, 2015 at 8:04 PM, Matt Kuiper wrote: > Maybe I have been working too many long hours as I m

RE: Clusterstate - state active

2015-04-08 Thread Matt Kuiper
at org.apache.solr.common.util.RetryUtil.retryOnThrowable(RetryUtil.java:34) Matt -Original Message----- From: Matt Kuiper [mailto:matt.kui...@issinc.com] Sent: Wednesday, April 08, 2015 4:36 PM To: solr-user@lucene.apache.org Subject: RE: Clusterstate - state active Erick, Anshum,

Clusterstate - state active

2015-04-08 Thread Matt Kuiper
Hello, When creating a new replica, and the state is recorded as active with in ZK clusterstate, does that mean that new replica has synched with the leader replica for the particular shard? Thanks, Matt

RE: Clusterstate - state active

2015-04-09 Thread Matt Kuiper
plica1", "node_name":"172.29.24.76:8983_solr", "base_url":"http://172.29.24.76:8983/solr"}}}, Thanks, Matt -Original Message- From: Erick Erickson [mailto:erickerick...@gmail.com] Sent: Wednesday, April 08

RE: Clusterstate - state active

2015-04-08 Thread Matt Kuiper
ile, though, you should at least see the "Recovering" state, during which time there won't be any searches forwarded to that node. Best, Erick On Wed, Apr 8, 2015 at 2:58 PM, Matt Kuiper wrote: > Hello, > > When creating a new replica, and the state is recorded as acti

RE: Search in Solr Index

2015-04-20 Thread Matt Kuiper
What type of field are you using? String? If so try another type, like text_general. I believe with type String the contents are stored in the index exactly as they are inputted into the index. So a search hit will have to match exactly the full value of the field, I assume in your case "Birm

Solr Doc Site Down?

2016-12-01 Thread Matt Kuiper
FYI - This morning I am no longer able to access - https://cwiki.apache.org/confluence/display/solr/Apache+Solr+Reference+Guide Matt

RE: Solr Doc Site Down?

2016-12-01 Thread Matt Kuiper
Thank, Look like it is backup now. Matt -Original Message- From: Shawn Heisey [mailto:apa...@elyograg.org] Sent: Thursday, December 01, 2016 9:42 AM To: solr-user@lucene.apache.org Subject: Re: Solr Doc Site Down? On 12/1/2016 9:11 AM, Matt Kuiper wrote: > FYI - This morning I am

Schemaless Mode - Multivalued

2016-12-01 Thread Matt Kuiper
Hi - I have noticed when using schemaless mode that it appears that all fields created by this mode are defined as Multivalued. Is there a way to modify a configuration so that the default is to be not Multivalued? Thanks, Matt

RE: Schemaless Mode - Multivalued

2016-12-02 Thread Matt Kuiper
/ - Resources for Solr users, new and experienced On 1 December 2016 at 15:11, Matt Kuiper wrote: > Hi - > > I have noticed when using schemaless mode that it appears that all fields > created by this mode are defined as Multivalued. Is there a way to modify a > configuration so that the d

RE: Solr Index issue on string type while querying

2017-05-16 Thread Matt Kuiper
Your problem statement is not quite clear, however I will make a guess. Assuming your problem is that when you remove the '>' sign from your query term you receive zero results, then this is actually expected behavior for field types that are of type string. When searching against string fields

cache warming questions

2014-04-15 Thread Matt Kuiper
Hello, I have a few questions regarding how Solr caches are warmed. My understanding is that there are two ways to warm internal Solr caches (only one way for document cache and lucene FieldCache): Auto warming - occurs when there is a current searcher handling requests and new searcher is bei

RE: cache warming questions

2014-04-16 Thread Matt Kuiper
to autowarm. So the firstSearcher queries might be quite a bit more complex than newSearcher queries. HTH, Erick On Tue, Apr 15, 2014 at 1:55 PM, Matt Kuiper wrote: > Hello, > > I have a few questions regarding how Solr caches are warmed. > > My understanding is that there a

RE: cache warming questions

2014-04-17 Thread Matt Kuiper
Ok, that makes sense. Thanks again, Matt Matt Kuiper - Software Engineer Intelligent Software Solutions p. 719.452.7721 | matt.kui...@issinc.com www.issinc.com | LinkedIn: intelligent-software-solutions -Original Message- From: Erick Erickson [mailto:erickerick...@gmail.com] Sent

RE: Easises way to insatll solr cloud with tomcat

2014-05-15 Thread Matt Kuiper
Check out http://heliosearch.com/download.html This is a distribution of Apache Solr packaged with Tomcat. I have found it simple to use. Matt -Original Message- From: Aman Tandon [mailto:amantandon...@gmail.com] Sent: Monday, May 12, 2014 6:24 AM To: solr-user@lucene.apache.org Subj

SolrCloud zkcli

2014-05-27 Thread Matt Kuiper
Hello, I am using ZkCLI -cmd upconfig with a reload of each Solr node to update my solrconfig within my SolrCloud. I noticed the linkconfig option at https://cwiki.apache.org/confluence/display/solr/Command+Line+Utilities, and do not quite understand where this option is designed to be used.

RE: SolrCloud zkcli

2014-05-27 Thread Matt Kuiper
Great, thanks Matt -Original Message- From: Shawn Heisey [mailto:s...@elyograg.org] Sent: Tuesday, May 27, 2014 11:13 AM To: solr-user@lucene.apache.org Subject: Re: SolrCloud zkcli On 5/27/2014 10:41 AM, Matt Kuiper wrote: > I am using ZkCLI -cmd upconfig with a reload of each S

RE: Cache response time

2014-06-04 Thread Matt Kuiper
I have not come across one. Is your question directed to the queryResultCache? My understanding is that the queryResultCache is the only cache that contains full query results that could be used to compare against non-cached results times. I believe the other caches can participate in speed

1 Solr many Shards?

2015-02-09 Thread Matt Kuiper
starting a Solr server within a Solr Cloud that handles a single shard of an index by specifying the DzkHost parameter. Thanks, Matt Kuiper

RE: 1 Solr many Shards?

2015-02-10 Thread Matt Kuiper
Thanks Anshum! Very helpful. Matt Kuiper - Software Engineer Intelligent Software Solutions p. 719.452.7721 | matt.kui...@issinc.com www.issinc.com | LinkedIn: intelligent-software-solutions -Original Message- From: Anshum Gupta [mailto:ans...@anshumgupta.net] Sent: Monday, February

Solr on Tomcat

2015-02-10 Thread Matt Kuiper
I am starting to look in to Solr 5.0. I have been running Solr 4.* on Tomcat. I was surprised to find the following notice on https://cwiki.apache.org/confluence/display/solr/Running+Solr+on+Tomcat (Marked as Unreleased) Beginning with Solr 5.0, Support for deploying Solr as a WAR in

RE: Solr on Tomcat

2015-02-10 Thread Matt Kuiper
Thanks for all the responses. I am planning a new project, and considering deployment options at this time. It's helpful to see where Solr is headed. Thanks, Matt Kuiper  -Original Message- From: Shawn Heisey [mailto:apa...@elyograg.org] Sent: Tuesday, February 10, 2015 10:05

How to make SolrCloud more elastic

2015-02-11 Thread Matt Kuiper
I am starting a new project and one of the requirements is that Solr must scale to handle increasing load (both search performance and index size). My understanding is that one way to address search performance is by adding more replicas. I am more concerned about handling a growing index size.

RE: How to make SolrCloud more elastic

2015-02-12 Thread Matt Kuiper
anks, Matt Matt Kuiper - Software Engineer Intelligent Software Solutions p. 719.452.7721 | matt.kui...@issinc.com www.issinc.com | LinkedIn: intelligent-software-solutions -Original Message- From: Alexandre Rafalovitch [mailto:arafa...@gmail.com] Sent: Wednesday, February 11, 2015 2:31 P

RE: How to make SolrCloud more elastic

2015-02-12 Thread Matt Kuiper
, 2015 at 3:32 PM, Matt Kuiper wrote: > I am starting a new project and one of the requirements is that Solr > must scale to handle increasing load (both search performance and index size). > > My understanding is that one way to address search performance is by > adding more

RE: How to make SolrCloud more elastic

2015-02-12 Thread Matt Kuiper
-Original Message- From: Toke Eskildsen [mailto:t...@statsbiblioteket.dk] Sent: Wednesday, February 11, 2015 11:47 PM To: solr-user@lucene.apache.org Subject: Re: How to make SolrCloud more elastic On Wed, 2015-02-11 at 21:32 +0100, Matt Kuiper wrote: > I am starting a new project and

RE: Solr query with mandatory values

2012-05-09 Thread Matt Kuiper
l is to be placed just before the mandatory value, not before the field name in the query. Matt Kuiper Intelligent Software Solutions -Original Message- From: G.Long [mailto:jde...@gmail.com] Sent: Wednesday, May 09, 2012 10:45 AM To: solr-user@lucene.apache.org Subject: Solr query with

RE: Querying Dynamic Fields

2015-10-26 Thread Matt Kuiper (Springblox)
Give the following a try - http://localhost:8983/solr/core_name/admin/luke?numTerms=0 Matt Matt Kuiper -Original Message- From: Patrick Hoeffel [mailto:patrick.hoef...@issinc.com] Sent: Monday, October 26, 2015 4:56 PM To: solr-user@lucene.apache.org Subject: Querying Dynamic Fields

RE: Easises way to insatll solr cloud with tomcat

2014-05-13 Thread Matt Kuiper (Springblox)
Check out http://heliosearch.com/download.html It is a distribution of Apache Solr packaged with Tomcat. I have found it simple to use. Matt -Original Message- From: Aman Tandon [mailto:amantandon...@gmail.com] Sent: Monday, May 12, 2014 6:24 AM To: solr-user@lucene.apache.org Subject

RE: To warm the whole cache of Solr other than the only autowarmcount

2014-07-24 Thread Matt Kuiper (Springblox)
I don't believe this would work. My understanding (please correct if I have this wrong) is that the underlying Lucene document ids have a potential to change and so when a newSearcher is created the caches must be regenerated and not copied. Matt -Original Message- From: YouPeng Yang

RE: java.lang.OutOfMemoryError: Requested array size exceeds VM limit

2014-07-25 Thread Matt Kuiper (Springblox)
You might consider looking at your internal Solr cache configuration (solrconfig.xml). These caches occupy heap space, and from my understanding do not overflow to disk. So if there is not enough heap memory to support the caches an OOM error will be thrown. I also believe these caches live i

RE: Updates to index not available immediately as index scales, even with autoSoftCommit at 1 second

2014-08-12 Thread Matt Kuiper (Springblox)
Based on your solrconfig.xml settings for the filter and queryResult caches, I believe Chris's initial guess is correct. After a commit, there is likely plenty of time spent warming these caches due to the significantly high autowarm counts. Suggest you try setting the autowarmcount v