Null pointer on multi-core search

2014-08-27 Thread Shay Sofer
Hi, I'm using solr 4.8.1and with following scenario I got a null pointer exception: 1. I'm trying to search over multi-cores and group search. 2. SearchHandler is called and when executing for(SearchComponent c : components) { c.finishStage(rb);

Re: Solr CPU Usage

2014-08-27 Thread hendra_budiawan
Yes we do complex query with a lot of clauses and facets and data is growing up bigger every day, i agree with you it might not on the hardware issue maybe i need to tune up solr/OS/jetty system configration to optimize solr process. Thank you so much for help. Best regards, Hendra -- View this

Re: Solr CPU Usage

2014-08-27 Thread Shawn Heisey
On 8/27/2014 8:42 PM, hendra_budiawan wrote: > Yes i'm just worried about load average reported by OS, because last week > suddenly server can't accessed so we have to hard reboot. I'm still > investigating what is the problem, because this server is dedicated to solr > only, we suspect the proble

Re: Basic auth on SolrCloud /admin/* calls

2014-08-27 Thread rulinma
mark -- View this message in context: http://lucene.472066.n3.nabble.com/Basic-auth-on-SolrCloud-admin-calls-tp4052266p4155521.html Sent from the Solr - User mailing list archive at Nabble.com.

Re: Solr CPU Usage

2014-08-27 Thread hendra_budiawan
Hi Shawn, Yes i'm just worried about load average reported by OS, because last week suddenly server can't accessed so we have to hard reboot. I'm still investigating what is the problem, because this server is dedicated to solr only, we suspect the problem came from the solr process but i'm stil

Re: Solr CPU Usage

2014-08-27 Thread Shawn Heisey
On 8/27/2014 7:53 PM, hendra_budiawan wrote: > HI Shawn, thank's for reply here is standard top > > > > My server have enough RAM, so i think it's not RAMproblem > > total used free sharedbuffers cac

Re: Solr CPU Usage

2014-08-27 Thread hendra_budiawan
Hi Jack, High usage is happening when we restart the server a week ago, we still investigating to find the problem maybe there is something i'm missed to check. Regards, Hendra Budiawan -- View this message in context: http://lucene.472066.n3.nabble.com/Solr-CPU-Usage-tp4155370p4155507.html S

Re: Solr CPU Usage

2014-08-27 Thread hendra_budiawan
HI Shawn, thank's for reply here is standard top My server have enough RAM, so i think it's not RAMproblem total used free sharedbuffers cached Mem: 32073 12629 19443 0

Re: Schema Updates and Core Reload with SolrCloud

2014-08-27 Thread Marc Campeau
Thanks for your validation Shawn. Marc 2014-08-27 15:18 GMT-04:00 Shawn Heisey : > On 8/27/2014 1:03 PM, Marc Campeau wrote: > > Well I got my answer by trying it. I issued the Collections API reload > > action on one of the shards (Shard4 to be exact, not the leader) and I > got > > this back

Solr and HDFS

2014-08-27 Thread Leo Oliveira
Hello everyone! Simple question: is Solr 4.8 working with HDFS of Hadoop in CDH 5? Documentation page says that Solr would work with Hadoop 2.0.x, but it doesn't mention newer Hadoop versions. There's a comment of an user asking about this problem, but it's not sure for me whether there's an i

Re: Schema Updates and Core Reload with SolrCloud

2014-08-27 Thread Shawn Heisey
On 8/27/2014 1:03 PM, Marc Campeau wrote: > Well I got my answer by trying it. I issued the Collections API reload > action on one of the shards (Shard4 to be exact, not the leader) and I got > this back as output. So the action triggers a reload of all shards > composing the Collection. The Colle

Using wild characters in query doesn't work with my configuraiton

2014-08-27 Thread Romain Pigeyre
Hi, I have a little mistake using Solr : I can query this : "lastName:HK+IE" The result contains the next record : { "customerId": "0003500226598", "countryLibelle": "HONG KONG", "firstName1": "lC /o", "countryCode": "HK", "address1": " 1F0/", "address2": "11-35", " storeId": "100", "lastName1":

Re: Schema Updates and Core Reload with SolrCloud

2014-08-27 Thread Marc Campeau
Well I got my answer by trying it. I issued the Collections API reload action on one of the shards (Shard4 to be exact, not the leader) and I got this back as output. So the action triggers a reload of all shards composing the Collection. 0 11957 0 4585 0 2839 0 2655 0 7705

Re: Queries slow on replicas after replication

2014-08-27 Thread Walter Underwood
With such a short replication period, the statistics for autowarming won’t be very good. They will be recent, but not the most popular and likely, because of the tiny sampling period. You might try some static warming queries instead. Find a fairly stable set of most popular queries and put tho

Re: Queries slow on replicas after replication

2014-08-27 Thread Scott Rankin
Thanks for the suggestions, Erick. I took a look in the config and it turns out that we didn¹t have any auto warming going on. I set the filterCache to be about 75% autowarm and the document and query result cache to be 50%. That had a marked impact on the performance, with the average response

Re: solr query gives different numFound upon refreshing

2014-08-27 Thread Shawn Heisey
On 8/27/2014 10:44 AM, Bryan Bende wrote: > Theoretically this shouldn't happen, but is it possible that the two > replicas for a given shard are not fully in sync? > > Say shard1 replica1 is missing a document that is in shard1 replica2... if > you run a query that would hit on that document and r

Re: Synonym - multiple words and position

2014-08-27 Thread Walter Underwood
It should work to do something like: antigravity => anti antigravity => gravity That makes two independent synonyms for “antigravity”. But the filter is doing the right thing, because “anti gravity” is a phrase and should be at sequential positions. wunder Walter Underwood wun...@wunderwood.or

Synonym - multiple words and position

2014-08-27 Thread Jae Joo
In the synonym file, antigravity, anti gravity In the analysis, I see the position of anti is 1 and gravity is 2. Is there any way to keep postions of "anti" and "gravity" to 1? And any ways to configure or define to have synonym "anti gravity" rather than "anti" and "gravity" for "antigravity"

Re: Schema Updates and Core Reload with SolrCloud

2014-08-27 Thread Marc Campeau
This past thread from June might hold the answer to my question. Posting this here for other folks that might stumble upon this question. -- Forwarded message -- From: Shawn Heisey Date: 2014-06-28 1:36 GMT-04:00 Subject: Re: Some questions about Solrcloud To: solr-user@lucene.apa

Schema Updates and Core Reload with SolrCloud

2014-08-27 Thread Marc Campeau
Hi, I want to apply a change to a Schema of a Collection deployed on SolrCloud. This SolrCloud consists of a 3 Zookeepers ensemble overseeing 4 Solr Instances that each have a replicated version of a single Collection. As I understand it, I need to update my schema.xml and then upload it to the

Business Name spell check

2014-08-27 Thread Corey Gerhardt
Sorry to keep beating this to death. I could be looking for perfection which isn't possible. I'm trying to spell check the user term "C Wishes" to collate to "B Wishes". If I use a tokenizer on the spell check field which splits "c wishes" into 2 tokens then there are no suggestions for "c". O

Re: How to set storageDir for managed resource?

2014-08-27 Thread Timothy Potter
You can set the storageDir init-arg in the solrconfig.xml for the RestManager for each core. However, since it is at the core config level, you can't have a different storageDir per language. Here's an example of how to configure the RestManager in solrconfig.xml to customize the storageDir:

Re: solr query gives different numFound upon refreshing

2014-08-27 Thread Bryan Bende
Theoretically this shouldn't happen, but is it possible that the two replicas for a given shard are not fully in sync? Say shard1 replica1 is missing a document that is in shard1 replica2... if you run a query that would hit on that document and run it a bunch of times, sometimes replica 1 will ha

Re: Indexing srt files

2014-08-27 Thread Alexandre Rafalovitch
If you want to find individual subtitles, you have to index them separately. Maybe as parent child block. Regards, Alex On 27/08/2014 11:43 am, "Rafael Merino García" < rmer...@paradigmatecnologico.com> wrote: > Hi all > > I have to index srt files belonged to videos so that the users can get

Indexing srt files

2014-08-27 Thread Rafael Merino García
Hi all I have to index srt files belonged to videos so that the users can get not only the video but also the time when their search takes place in it. For the sake of clarity, you can find below an example of this kind of files: 1 00:00:08,580 --> 00:00:12,880 Welcome back, and in this video we'

solr query gives different numFound upon refreshing

2014-08-27 Thread Joshi, Shital
Hi, We have SolrCloud cluster (5 shards and 2 replicas) on 10 boxes. We have three collections. We recently upgraded from 4.4.0 from 4.8. We have ~850 mil documents. We are facing an issue where refreshing a Solr query may give different results (number of documents returned). This issue is se

Re: Solr CPU Usage

2014-08-27 Thread Jack Krupansky
Is the high usage just suddenly happening after a long period of up-time without it, or is this on a server restart? The latter can happen if you have a large commit log to replay because you haven't done hard commits. -- Jack Krupansky -Original Message- From: Shawn Heisey Sent: Wed

Re: Announcing "Splainer" -- Open Source Solr Sandbox

2014-08-27 Thread Doug Turnbull
As per documentation, it should be paste in your Solr URL and go. Generally we try to follow the maxim of "Bad UI is like a bad joke if I have to explain it... its not good". So if something is not obvious (like having to prefix id: to an id field that's not "id") that's a bug too me, not just a UI

Re: Solr CPU Usage

2014-08-27 Thread Shawn Heisey
On 8/27/2014 4:16 AM, hendra_budiawan wrote: > I'm having high cpu usage on my server, detailed on picture below > > > Using default config for solrconfig.xml & schema.xml, can anyone help me to > identified why the cpu so high on

Re: Solr content limits?

2014-08-27 Thread Shawn Heisey
On 8/26/2014 9:36 PM, lalitjangra wrote: > I am using SOlr 4.6.0 with single collection/core and want to know details > about following. > > 1. What is the maximum number of documents which can be uploaded in a single > collection/core? > 2. What is the maximum size of a document i can upload in

Re: Solr content limits?

2014-08-27 Thread Jack Krupansky
There are no such "limits" in Solr. Rather, it is up to you to configure as much hardware as you need. From a practical perspective, I would say that you should try to limit machines to 100 million documents per node, and maybe 100 nodes maximum in a cluster. Those are not hard limits in any w

RE: Announcing "Splainer" -- Open Source Solr Sandbox

2014-08-27 Thread Jacques du Rand
ANY documentation as to how to setup this thing ? From: Doug Turnbull [dturnb...@opensourceconnections.com] Sent: Wednesday, August 27, 2014 1:46 PM To: solr-user@lucene.apache.org Subject: Re: Announcing "Splainer" -- Open Source Solr Sandbox Thanks! Abo

Re: Solr range query issue

2014-08-27 Thread Jack Krupansky
The "AND" and "-" operators are being parsed at the same level - no parentheses are involved, so they generate a single, flat Boolean query. So it really is equivalent to: -name:[A TO Z] -name:[a TO z] That is a purely negative query, so Solr should automatically supply a *:* terms so that it

Re: Announcing "Splainer" -- Open Source Solr Sandbox

2014-08-27 Thread Doug Turnbull
Thanks! About the id field, in "displayed fields" you can specify an alternate Id field by prefixing a field name with "id:". IE: "id:uuid". You'll need to adjust this after pasting in a URL Doug On Wednesday, August 27, 2014, Markus Jelsma wrote: > Yeah, very cool. Since this is all just clie

RE: Announcing "Splainer" -- Open Source Solr Sandbox

2014-08-27 Thread Markus Jelsma
Yeah, very cool. Since this is all just client side, how about integrating it in Solr's UI? Also, it seems to assume `id` is the ID field, which is not always true. -Original message- > From:david.w.smi...@gmail.com > Sent: Friday 22nd August 2014 19:42 > To: solr-user@lucene.apache.or

Solr CPU Usage

2014-08-27 Thread hendra_budiawan
Hi all, I'm having high cpu usage on my server, detailed on picture below Using default config for solrconfig.xml & schema.xml, can anyone help me to identified why the cpu so high on solr process? Thank's in advanced. -- Vie

How to set storageDir for managed resource?

2014-08-27 Thread Phuong Doan
Hi, currently I am using REST Api for managing synonyms and stopwords. My setup for Apache Solr 4.8.1 looks like: /conf/ _schema_analysis_synonyms_english.json _schema_analysis_stopwords_english.json solrconfig.xml english/schema.xml german/schema.xml