Slow query response.

2015-12-17 Thread Modassar Ather
Hi, I have a field f which is defined as follows. Solr-5.2.1 is used. The index is spread across 12 shards (no replica) and the index size on each node is around 100 GB. When I search for 50 thousand values (ORed) in the field f it takes almost around 45 to 55 seconds. Per my understanding it i

Re: Slow query response.

2015-12-21 Thread Modassar Ather
f the index and probably additional CPU usage > as well. > > How many rows are you returning on each query? Are you using all these > terms just to filter a smaller query or to return a large bulk of > documents? > > > -- Jack Krupansky > > On Thu, Dec 17, 2015 at 7:01 AM, Mod

Re: Best practices on monitoring Solr

2015-12-22 Thread Modassar Ather
Last week our Solr Search was un-responsive and we need to re-boot the server, but we were able to find out after customer complained about it. What's best way to monitor that search is working? May not be the best way but you can write a class which keeps on checking the status of all the nodes o

Query behavior difference.

2016-01-04 Thread Modassar Ather
Hi, Kindly help me understand how will relevance ranking differ int following searches. query : fl:network query : fl:networ* What I am observing that the results returned are different in both of them in a way that the top documents returned for q=fl:network is not present in the top results of

solr-user@lucene.apache.org

2016-01-05 Thread Modassar Ather
Hi, *q=fl1:net*&facet.field=fl&facet.limit=50&stats=true&stats.field={!cardinality=1.0}fl* is returning cardinality around 15 million. It is taking around 4 minutes. Similar response time is seen with different queries which yields high cardinality. Kindly note that the cardinality=1.0 is the desi

Re: Query behavior difference.

2016-01-05 Thread Modassar Ather
met > > > > On Monday, January 4, 2016 12:22 PM, Modassar Ather < > modather1...@gmail.com> wrote: > Hi, > > Kindly help me understand how will relevance ranking differ int following > searches. > > query : fl:network > query : fl:networ* > > What I

Re: Query behavior difference.

2016-01-06 Thread Modassar Ather
. Thanks, Modassar On Wed, Jan 6, 2016 at 12:56 PM, Modassar Ather wrote: > Thanks for your response Ahmet. > > Best, > Modassar > > On Mon, Jan 4, 2016 at 5:07 PM, Ahmet Arslan > wrote: > >> Hi, >> >> I think wildcard queries fl:networ* are re-written i

Re: Query behavior difference.

2016-01-06 Thread Modassar Ather
ne.apache.org/core/5_4_0/core/org/apache/lucene/search/MultiTermQuery.html#CONSTANT_SCORE_REWRITE > > https://lucene.apache.org/core/5_4_0/core/org/apache/lucene/search/WildcardQuery.html > > > -- Jack Krupansky > > On Wed, Jan 6, 2016 at 6:07 AM, Modassar Ather > wrote: > > >

solr-user@lucene.apache.org

2016-01-08 Thread Modassar Ather
Hi, An input will be helpful. Thanks, Modassar On Wed, Jan 6, 2016 at 12:39 PM, Modassar Ather wrote: > Hi, > > > *q=fl1:net*&facet.field=fl&facet.limit=50&stats=true&stats.field={!cardinality=1.0}fl* > is returning cardinality around 15 million. It is tak

solr-user@lucene.apache.org

2016-01-08 Thread Modassar Ather
Hi Toke, Is this a single shard or multiple? It is 12 shard cluster without replicas and has around 90+ GB on each shard. Thanks for sharing the link. I will look into that. Regards, Modassar On Fri, Jan 8, 2016 at 4:28 PM, Toke Eskildsen wrote: > On Wed, 2016-01-06 at 12:39 +0530, Modas

Position increment in WordDelimiterFilter.

2016-01-14 Thread Modassar Ather
Hi, I have following definition for WordDelimiterFilter. The analysis of 3d shows following four tokens and their positions. token position 3d 1 3 1 3d 1 d 2 Please help me understand why d is at 2? Should not it also be at position

Re: Position increment in WordDelimiterFilter.

2016-01-14 Thread Modassar Ather
think it should be at position 1? In that case searching for > > "3 d" would not find anything. Is it what you expect? > > > > Thanks, > > Emir > > > > On 14.01.2016 10:15, Modassar Ather wrote: > > > Hi, > > > > > > I have f

Re: Position increment in WordDelimiterFilter.

2016-01-14 Thread Modassar Ather
at the same > position. There was also some discussion about whether this was either a > bug or a bug fix, but I don't recall any resolution. > > -- Jack Krupansky > > On Thu, Jan 14, 2016 at 4:15 AM, Modassar Ather > wrote: > > > Hi, > > >

Re: Position increment in WordDelimiterFilter.

2016-01-15 Thread Modassar Ather
es where it is > useful? > > Thanks, > Emir > > > On 15.01.2016 05:13, Modassar Ather wrote: > >> Thanks for your responses. >> >> It seems to me that you don't want to split on numbers. >> It is not with number only. Even if you try to analyze WiFi

Re: Position increment in WordDelimiterFilter.

2016-01-18 Thread Modassar Ather
, Emir Arnautovic < emir.arnauto...@sematext.com> wrote: > Can you please send us tokens you get (and positions) when you analyze > *WiFi device* > > On 15.01.2016 13:15, Modassar Ather wrote: > >> Are you saying that WiFi Wi-Fi and Wi Fi should not match each other? >&g

Re: Position increment in WordDelimiterFilter.

2016-01-18 Thread Modassar Ather
ining WiFi device will be seen as a phrase with no word in between hence it should match phrase "WiFi device" but it will not whereas "WiFi device"~1 will matched. Best, Modassar On Mon, Jan 18, 2016 at 7:57 PM, Shawn Heisey wrote: > On 1/18/2016 6:21 AM, Modassar Ather

CorruptIndexException during optimize.

2016-01-31 Thread Modassar Ather
Hi, Got following error during optimize of index on 2 nodes of 12 node cluster. Please let me know if the index can be recovered and how and what could be the reason? Total number of nodes: 12 No replica. Solr version - 5.4.0 Java version - 1.7.0_91 (Open JDK 64 bit) Ubuntu version : Ubuntu 14.04.

Re: CorruptIndexException during optimize.

2016-02-09 Thread Modassar Ather
Hi, Kindly provide your inputs on the issue. Thanks, Modassar On Mon, Feb 1, 2016 at 12:40 PM, Modassar Ather wrote: > Hi, > > Got following error during optimize of index on 2 nodes of 12 node > cluster. Please let me know if the index can be recovered and how and what > coul

Re: Multi-lingual search

2016-02-09 Thread Modassar Ather
And what does proximity search exactly mean? A proximity search means searching terms with a distance in between them. E.g. Search for a document which has java near 3 words of network. field:"java network"~3 So the above query will match any document having a distance of 3 by its position between

Re: Searching special characters

2016-02-12 Thread Modassar Ather
You can search them by escaping with backslash. Best, Modassar

Re: Searching special characters

2016-02-12 Thread Modassar Ather
; Thanks for quick response. > > Should these be treated differently during index ? > > I have tried *\"Audit* which is returning results of *Audit *also which is > incorrect. what do you say ? > > On 12 February 2016 at 15:07, Modassar Ather > wrote: > > > You

Re: SOLR ranking

2016-02-15 Thread Modassar Ather
First it will search for "Eating Disorders" together and then the individual words "Eating" and "Disorders" I don't think the phrase will be searched as individual ANDed terms until the query has it like below. "Eating Disorders" OR (Eating AND Disorders). Best, Modassar On Tue, Feb 16, 2016 at

Re: SOLR ranking

2016-02-16 Thread Modassar Ather
Actually you can get it with the edismax. Just set mm to 100% and then configure a pf field ( or more) . You are going to search all the search terms mandatory and boost phrases match . @Alessandro Thanks for your insight. I thought that the document will be boosted if all of the terms appear in c

Re: SOLR ranking

2016-02-16 Thread Modassar Ather
I debugged that recently. > > Cheers > > On 16 February 2016 at 11:42, Modassar Ather > wrote: > > > Actually you can get it with the edismax. > > Just set mm to 100% and then configure a pf field ( or more) . > > You are going to search all the search terms mandatory

Query behavior.

2016-03-08 Thread Modassar Ather
Hi, Kindly help me understand the parsing of following query. I am using edismax parser and Solr-5.5.0. q.op is set to AND and there is no explicit mm value set. fl:(java OR book) => "boost(+((fl:java fl:book)~2),int(val))" When the query has explicit OR then why the ~2 is present in the parsed

Re: Query behavior.

2016-03-09 Thread Modassar Ather
Hi, A suggestion will be very helpful. Thanks, Modassar On Wed, Mar 9, 2016 at 12:37 PM, Modassar Ather wrote: > Hi, > > Kindly help me understand the parsing of following query. I am using > edismax parser and Solr-5.5.0. > q.op is set to AND and there is no explicit mm va

Re: Query behavior.

2016-03-10 Thread Modassar Ather
Thanks Shawn for pointing to the jira issue. I was not sure that if it is an expected behavior or a bug or there could have been a way to get the desired result. Best, Modassar On Thu, Mar 10, 2016 at 11:32 AM, Shawn Heisey wrote: > On 3/9/2016 10:55 PM, Shawn Heisey wrote: > > The ~2 syntax, w

Re: Query behavior.

2016-03-14 Thread Modassar Ather
.) > > > -- Jack Krupansky > > On Thu, Mar 10, 2016 at 3:41 AM, Modassar Ather > wrote: > > > Thanks Shawn for pointing to the jira issue. I was not sure that if it is > > an expected behavior or a bug or there could have been a way to get the > > desired res

Understanding parsed queries.

2016-03-15 Thread Modassar Ather
Hi, Kindly help me understand the parsed queries of following three queries. How these parsed queries can be interpreted for boolean logic. Please ignore the boost part. *Query : *fl:term1 OR fl:term2 AND fl:term3 *"parsedquery_toString" : *"boost(+(fl:term1 +fl:term2 +fl:term3),int(doc_wt))", *m

Re: Understanding parsed queries.

2016-03-15 Thread Modassar Ather
is that it's present only in docs with term2 and term3 in them > perhaps? > > Best, > Erick > > Best, > Erick > > On Tue, Mar 15, 2016 at 12:22 AM, Modassar Ather > wrote: > > Hi, > > > > Kindly help me understand the parsed queries of followin

Re: Query behavior.

2016-03-15 Thread Modassar Ather
> On Tue, Mar 15, 2016 at 1:46 AM, Modassar Ather > wrote: > > > Thanks Jack for your response. > > The following jira bug for this issue is already present so I have not > > created a new one. > > https://issues.apache.org/jira/browse/SOLR-8812 > > > > Kindly

Re: Query behavior.

2016-03-19 Thread Modassar Ather
to perform some function in a query with only two terms and and OR > operator? I mean, why not just drop the q.op=AND? > > -- Jack Krupansky > > On Wed, Mar 16, 2016 at 1:31 AM, Modassar Ather > wrote: > > > Jack as suggested I have created following jira issue. > > &g

Re: Query behavior.

2016-03-19 Thread Modassar Ather
ieve following? "+((fl:java fl:book))"", which has an extra AND > outside of the inner sub-query, which is a little different than just > "(fl:java > fl:book)". Sure, the results should be the same, but why insist on the > extra level of nested boolean query? > > -

Wildcard query behavior.

2016-04-18 Thread Modassar Ather
Hi, Please help me understand following. I have analysis chain which uses KStemFilterFactory for a field. Solr version is 5.4.0 When I search for f:validator I get 80K+ documents whereas if I search for f:validator* I get only around 150 results. When I checked on analysis page I see that valid

Re: Wildcard query behavior.

2016-04-18 Thread Modassar Ather
er which stems "validator" to "validate" (if this stemming > was applied at index time as well as query time) its looking for records > that have "validate" or "validator", so for obvious reasons, numFound might > have been different. > > > &g

Re: Wildcard query behavior.

2016-04-19 Thread Modassar Ather
; the same way at all, so searching for "validato*" wouldn't produce the > expected response. > > Best, > Erick > > On Mon, Apr 18, 2016 at 6:23 AM, Shawn Heisey wrote: > > On 4/18/2016 1:18 AM, Modassar Ather wrote: > >> When I search for f:va

Results of facet differs with change in facet.limit.

2016-05-02 Thread Modassar Ather
Hi, I have a field f which is defined as follows on solr 5.x. It is 12 shard cluster with no replica. When I facet on this field with different facet.limit I get different facet count. E.g. Query : text_field:term&facet.field=f&facet.limit=100 Result : 1225 1082 1076 Query : text_field:term&f

Re: Results of facet differs with change in facet.limit.

2016-05-02 Thread Modassar Ather
Hi, Kindly share your inputs on this issue. Thanks, Modassar On Mon, May 2, 2016 at 3:53 PM, Modassar Ather wrote: > Hi, > > I have a field f which is defined as follows on solr 5.x. It is 12 shard > cluster with no replica. > > stored="false" indexed="fal

Re: Results of facet differs with change in facet.limit.

2016-05-03 Thread Modassar Ather
I tried to reproduce the same issue with a field of following type but could not. Please share your inputs. Best, Modassar On Tue, May 3, 2016 at 10:32 AM, Modassar Ather wrote: > Hi, > > Kindly share your inputs on this issue. > > Thanks, > Modassar > > On Mon

Re: Results of facet differs with change in facet.limit.

2016-05-03 Thread Modassar Ather
I'd be interested what you get if you restrict your > queries to individual shards using &distrib=false. This > will go to the individual shard you address and no others. > > Does the facet count change in those circumstances? > > Best, > Erick > > On Tue, May 3, 2016

Re: Results of facet differs with change in facet.limit.

2016-05-04 Thread Modassar Ather
1 PM, Toke Eskildsen wrote: > On Mon, 2016-05-02 at 15:53 +0530, Modassar Ather wrote: > > E.g. > > Query : text_field:term&facet.field=f&facet.limit=100 > > Result : > > 1225 > > 1082 > > 1076 > > > > Query : text_field:term&facet.fie

Zookeeper state and its effect on Solr cluster.

2015-07-27 Thread Modassar Ather
Hi, Kindly help me understand following with respect to Solr version 5.2.1. 1. What happens to the solr cluster if the standalone external zookeeper is stopped/restarted with some changes done in zoo_data during the restart? E.g After restarting the zookeeper the solr configs are reloaded wit

Re: Zookeeper state and its effect on Solr cluster.

2015-07-27 Thread Modassar Ather
eadPool.java:555)\n\tat java.lang.Thread.run(Thread.java:745)\n","code":500}} Regards, Modassar On Mon, Jul 27, 2015 at 8:45 PM, Shawn Heisey wrote: > On 7/27/2015 6:17 AM, Modassar Ather wrote: > > Kindly help me understand following with respect to Solr version 5.2.1

Re: Zookeeper state and its effect on Solr cluster.

2015-07-27 Thread Modassar Ather
ocess that's well established > and tested for maintaining the Solr specific data? > > Best, > Erick > > On Mon, Jul 27, 2015 at 9:48 AM, Modassar Ather > wrote: > > Thanks for your response Erick and Shawn. > > > > We had automated the solr/zookeeper futu

Re: Zookeeper state and its effect on Solr cluster.

2015-07-27 Thread Modassar Ather
, after restart the Solr nodes should come insync with the ZK state. Please correct me if I am wrong. On Tue, Jul 28, 2015 at 10:22 AM, Shawn Heisey wrote: > On 7/27/2015 10:21 PM, Modassar Ather wrote: > > Erick I am using the ZK upload process only. It is just that it is added > >

Re: Zookeeper state and its effect on Solr cluster.

2015-07-30 Thread Modassar Ather
Modassar On Tue, Jul 28, 2015 at 11:40 AM, Shawn Heisey wrote: > On 7/27/2015 10:59 PM, Modassar Ather wrote: > > If we upgrade zookeeper we need to restart. This upgrade process is > > automated for future releases/changes of zookeeper. > > This is a single external zookeep

Clarification on WordDelimiterFilter.

2015-08-06 Thread Modassar Ather
I am using WordDelimiterFilter while indexing and searching both with the following attributes. Parser used is edismax. Solr version is 5.2.1. ** During search some of the results returned are not wanted. Following is the example. Search query: "3d image" Search results with 3-d image/3 d image/

Re: Clarification on WordDelimiterFilter.

2015-08-06 Thread Modassar Ather
Hi, Any suggestion will be really helpful. Kindly provide your inputs. Thanks, Modassar On Thu, Aug 6, 2015 at 2:06 PM, Modassar Ather wrote: > I am using WordDelimiterFilter while indexing and searching both with the > following attributes. Parser used is edismax. Solr version is

Re: Renaming Solr webapp in release 5.2.1

2015-08-10 Thread Modassar Ather
May be you can look at solr-jetty-context.xml present under server/context folder of solr. Regards, Modassar On Mon, Aug 10, 2015 at 2:42 PM, saurabh tewari wrote: > Hi, > > Is there any way through which one can change the name of solr webapp? I > used to name my instances differently accordin

Count of distinct values in faceting.

2015-08-11 Thread Modassar Ather
Hi, Count of distinct values can be retrieved by following ways. Please note that the Solr version is 5.2.1. 1. Using cardinality=true. 2. Using hll() facet function. Kindly help me understand: 1. How accurate are them comparatively and better performance wise with millions of documents? 2. Per

Re: Count of distinct values in faceting.

2015-08-11 Thread Modassar Ather
Please read docVlaues as docValues in my mail above. Regards, Modassar On Tue, Aug 11, 2015 at 4:01 PM, Modassar Ather wrote: > Hi, > > Count of distinct values can be retrieved by following ways. Please note > that the Solr version is 5.2.1. > 1. Using cardinality=true. > 2.

Re: Clarification on WordDelimiterFilter.

2015-08-13 Thread Modassar Ather
ent ways the user can search for a term, so there's no need to > actually modify the query to get a match). > > -Original Message- > From: Modassar Ather [mailto:modather1...@gmail.com] > Sent: Friday, August 07, 2015 12:21 AM > To: solr-user@lucene.apache.org > Subject:

Query time out. Solr node goes down.

2015-08-17 Thread Modassar Ather
Hi, I have a Solr cluster which hosts around 200 GB of index on each node and are 6 nodes. Solr version is 5.2.1. When a huge query is fired, it times out *(The request took too long to iterate over terms.)*, which I can see in the log but at same time the one of the Solr node goes down and the lo

Re: Query time out. Solr node goes down.

2015-08-17 Thread Modassar Ather
e logs (e.g. > OutOfMemoryError)? > > On Mon, Aug 17, 2015, at 12:29 PM, Modassar Ather wrote: > > Hi, > > > > I have a Solr cluster which hosts around 200 GB of index on each node and > > are 6 nodes. Solr version is 5.2.1. > > When a huge query is fired

Re: Query time out. Solr node goes down.

2015-08-17 Thread Modassar Ather
that, I'd expect that to improve performance, > not to cause JVM crashes. > > It might also help to know what version of Java you are running. > > Upayavira > > On Mon, Aug 17, 2015, at 12:45 PM, Modassar Ather wrote: > > The servers have 32g memory each. Solr JVM memory

Re: Query time out. Solr node goes down.

2015-08-17 Thread Modassar Ather
n (ZK timeout), the > JVM stops, the whole machine crashes? > > On 17 August 2015 at 14:17, Shawn Heisey wrote: > > > On 8/17/2015 5:45 AM, Modassar Ather wrote: > > > The servers have 32g memory each. Solr JVM memory is set to -Xms20g > > > -Xmx24g. There are

Re: Query time out. Solr node goes down.

2015-08-17 Thread Modassar Ather
collection.Please provide your inputs. On Tue, Aug 18, 2015 at 10:38 AM, Modassar Ather wrote: > Shawn! The container I am using is jetty only and the JVM setting I am > using is the default one which comes with Solr startup scripts. Yes I have > changed the JVM memory setting as

Re: Exception while using {!cardinality=1.0}.

2015-08-17 Thread Modassar Ather
Any suggestions please. Regards, Modassar On Thu, Aug 13, 2015 at 4:25 PM, Modassar Ather wrote: > Hi, > > I am getting following exception for the query : > *q=field:query&stats=true&stats.field={!cardinality=1.0}field*. The > exception is not seen once the cardinalit

Re: Query time out. Solr node goes down.

2015-08-18 Thread Modassar Ather
, migrating to Java > 8 is on our "list of things to do", so our settings are probably not that > relevant. > > > On 18 August 2015 at 09:04, Toke Eskildsen wrote: > > > On Tue, 2015-08-18 at 10:38 +0530, Modassar Ather wrote: > > > Kindly help me understan

Re: Exception while using {!cardinality=1.0}.

2015-08-18 Thread Modassar Ather
Ahmet/Chris! Thanks for your replies. Ahmet I think "net.agkn.hll.serialization" is used by hll() function implementation of Solr. Chris I will try to create sample data and create a jira ticket with details. Regards, Modassar On Tue, Aug 18, 2015 at 9:58 PM, Chris Hostetter wrote: > > : > I

Re: How to add second Zookeeper to same machine?

2015-08-20 Thread Modassar Ather
You might want to look into the following documentation. These documents have explanation on how to setup Zookeeper ensemble and Zookeeper administration. https://cwiki.apache.org/confluence/display/solr/Setting+Up+an+External+ZooKeeper+Ensemble http://zookeeper.apache.org/doc/r3.4.6/zookeeperAdmi

Re: How to configure solr to not bind at 8983

2015-08-20 Thread Modassar Ather
I think you need to add the port number in solr.xml too under hostPort attribute. STOP.PORT is SOLR.PORT-1000 and set under /bin/solr file. As far as I understand this can not be changed but I am not sure. Regards, Modassar On Thu, Aug 20, 2015 at 11:39 AM, Samy Ateia wrote: > I changed the so

Re: Exception while using {!cardinality=1.0}.

2015-08-20 Thread Modassar Ather
id not get the question but as much I understood and verified in the Solr log the stat is computed on the field given with stats.field={!cardinality=1.0}field. Regards, Modassar On Wed, Aug 19, 2015 at 10:24 AM, Modassar Ather wrote: > Ahmet/Chris! Thanks for your replies. >

Re: Exception while using {!cardinality=1.0}.

2015-08-21 Thread Modassar Ather
Hi Chris, I have added a method in SOLR-7954 jira ticket to index sample data which can be used to reproduce the issue. Regards, Modassar On Fri, Aug 21, 2015 at 11:49 AM, Modassar Ather wrote: > Hi Chris, > > I have raised https://issues.apache.org/jira/browse/SOLR-7954 for th

Re: Exception while using {!cardinality=1.0}.

2015-08-23 Thread Modassar Ather
see if you can reproduce using > the *exact* same data in two different fields, and if the choice of query > makes a differnce in the behavior you see. > > > : > : Regards, > : Modassar > : > : On Wed, Aug 19, 2015 at 10:24 AM, Modassar Ather > > : wro

Query timeAllowed and its behavior.

2015-08-25 Thread Modassar Ather
Hi, Kindly help me understand the query time allowed attribute. The following is set in solrconfig.xml. 30 Does this setting stop the query from running after the timeAllowed is reached? If not is there a way to stop it as it will occupy resources in background for no benefit. Thanks, Modass

Re: Query timeAllowed and its behavior.

2015-08-25 Thread Modassar Ather
Thanks for your response Jonathon. Please correct me if I am wrong in following points. -query actually ceases to run once time allowed is reached and releases all the resources. -query expansion is stopped and the query is terminated from execution releasing all the resources. Thanks, Moda

Behavior of grouping on a field with same value spread across shards.

2015-08-25 Thread Modassar Ather
Hi, As per my understanding, to group on a field all documents with the same value in the field have to be in the same shard. Can we group by a field where the documents with the same value in that field will be distributed across shards? Please let me know what are the limitations, feature not a

Re: Behavior of grouping on a field with same value spread across shards.

2015-08-25 Thread Modassar Ather
t; group.ngroups and group.facet with just grouping? > > See the ref guide: > > https://cwiki.apache.org/confluence/display/solr/Result+Grouping#ResultGrouping-DistributedResultGroupingCaveats > > Best, > Erick > > On Tue, Aug 25, 2015 at 4:51 AM, Modassar Ather > wrot

Re: Behavior of grouping on a field with same value spread across shards.

2015-08-26 Thread Modassar Ather
Thanks Erick. On Wed, Aug 26, 2015 at 12:11 PM, Erick Erickson wrote: > That should be the case. > > Best, > Erick > > On Tue, Aug 25, 2015 at 8:55 PM, Modassar Ather > wrote: > > Thanks Erick, > > > > I saw the link. So is it that the grouping func

Search results differs with sorting on pagination.

2015-09-09 Thread Modassar Ather
Hi, Search results are changed every time the following query is hit. Please note that it is 7 shard cluster of Solr-5.2.1. Query: q=network&start=50&rows=50&sort=f_sort asc&group=true&group.field=id Following are the fields and their types in my schema.xml. As per my understanding it see

Re: Search results differs with sorting on pagination.

2015-09-09 Thread Modassar Ather
an be identical > in documents, it's always best to specify a secondary sort > criteria. It's not referenced unless there's a tie so it's > not that expensive. People often use whatever field > is defined for since that's _guaranteed_ to > never be the same

Re: Search results differs with sorting on pagination.

2015-09-10 Thread Modassar Ather
at 12:52 PM, Upayavira wrote: > Add fl=id,score,[shard] to your query, and show us the results of two > differing executions. > > Perhaps we will be able to see the cause of the difference. > > Upayavira > > On Thu, Sep 10, 2015, at 05:35 AM, Modassar Ather wrote: > &

Re: Search results differs with sorting on pagination.

2015-09-10 Thread Modassar Ather
from all shard and then based on their score it should be sorted. But here I see that every time I hit the sort query I am getting results from different shard which has different scores. Thanks, Modassar On Thu, Sep 10, 2015 at 2:59 PM, Modassar Ather wrote: > Upayavira! I add the fl=id,sc

Re: Search results differs with sorting on pagination.

2015-09-10 Thread Modassar Ather
th the same score, the order would not be predictable - > probably down to which shard responds first. > > Fix it with something like sort=score,timestamp or some other time > related field. > > Upayavira > > On Thu, Sep 10, 2015, at 11:01 AM, Modassar Ather wrote: > > To

Re: Search results differs with sorting on pagination.

2015-09-10 Thread Modassar Ather
varies > due to a zillion possible causes, network latency, a minor GC pause on one > of the shards, whether all the caches are loaded, whatever. So subsequent > calls will happen to get some _other_ shards docs in the list first. > > Does that make sense? > > On Thu, Sep 10,

Re: [Help]Solr_Not_Responding

2015-10-30 Thread Modassar Ather
The information given is not sufficient to conclude a cause. You can check the solr logs for details for any exception. Regards, Modassar On Fri, Oct 30, 2015 at 10:12 AM, Franky Parulian Silalahi < fra...@telunjuk.com> wrote: > I have problem with my solr and i run in centos 7. > sometime my s

Very high memory and CPU utilization.

2015-11-01 Thread Modassar Ather
Hi, I have a setup of 12 shard cluster started with 28gb memory each on a single server. There are no replica. The size of index is around 90gb on each shard. The Solr version is 5.2.1. When I query "network se*", the memory utilization goes upto 24-26 gb and the query takes around 3+ minutes to e

Re: Very high memory and CPU utilization.

2015-11-02 Thread Modassar Ather
The rest is still a good for other system activities. Thanks, Modassar On Mon, Nov 2, 2015 at 1:30 PM, Toke Eskildsen wrote: > On Mon, 2015-11-02 at 12:00 +0530, Modassar Ather wrote: > > I have a setup of 12 shard cluster started with 28gb memory each on a > > single server. Ther

Re: Very high memory and CPU utilization.

2015-11-02 Thread Modassar Ather
Just to add one more point that one external Zookeeper instance is also running on this particular machine. Regards, Modassar On Mon, Nov 2, 2015 at 2:34 PM, Modassar Ather wrote: > Hi Toke, > Thanks for your response. My comments in-line. > > That is 12 machines, running a shar

Re: Very high memory and CPU utilization.

2015-11-02 Thread Modassar Ather
his seems impossible if you are sure that only one query is played at a > > time and no indexing is performed. Best thing to do is to dump stack > trace > > of the solr nodes during the query and to check what the threads are > doing. > > > > Jim > > > > > >

Re: Very high memory and CPU utilization.

2015-11-02 Thread Modassar Ather
On Mon, 2015-11-02 at 16:25 +0530, Modassar Ather wrote: > > The remaining size after you removed the heap usage should be reserved > for > > the index (not only the other system activities). > > I am not able to get the above point. So when I start Solr with 28g RAM, > &

Re: Very high memory and CPU utilization.

2015-11-02 Thread Modassar Ather
gb RAM and 140 gb of index on each node. Regards, Modassar On Mon, Nov 2, 2015 at 5:27 PM, Modassar Ather wrote: > Okay. I guess your observation of 400% for a single core is with top and > looking at that core's entry? If so, the 400% can be explained by > excessive garbage c

Re: warning

2015-11-02 Thread Modassar Ather
Normally tlog is replayed in case if solr server crashes for some reason and when restarted it tries to recover from the crash gracefully. You can look into following documentation which explains about transaction logs and related stuff of Solr. http://lucidworks.com/blog/2013/08/23/understanding-

Re: Very high memory and CPU utilization.

2015-11-02 Thread Modassar Ather
your disk, if you have SSDs > > it's better but reads are still significantly slower with SSDs than with > > direct RAM access. Another thing to keep in mind is that mmap will always > > tries to put things in RAM, this is why I suspect that you swap activity > is > >

Re: Very high memory and CPU utilization.

2015-11-02 Thread Modassar Ather
od > wun...@wunderwood.org > http://observer.wunderwood.org/ (my blog) > > > > On Nov 2, 2015, at 5:17 AM, Toke Eskildsen > wrote: > > > > On Mon, 2015-11-02 at 17:27 +0530, Modassar Ather wrote: > > > >> The query q=network se* is quick enough

Re: warning

2015-11-02 Thread Modassar Ather
for replying , > > could u please elaborate ..what wuld have happened when we were getting > this kind of warning ds > > Regards, > Abhishek Tiwari > > On Mon, Nov 2, 2015 at 6:00 PM, Modassar Ather > wrote: > > > Normally tlog is replayed in case if solr server crashes

Re: Solr Cloud and Multiple Indexes

2015-11-05 Thread Modassar Ather
What is your index size? How much memory is used? What type of queries are slow? Are there GC pauses as they can be a cause of slowness? Are document updates/additions happening in parallel? The queries are very slow to run so I was thinking to distribute the indexes into multiple indexes and cons

Re: Solr Cloud and Multiple Indexes

2015-11-05 Thread Modassar Ather
g/solr/DistributedSearch. What I was looking > for how this is handled in Solr Cloud? > > > Regards, > Salman > > > > > > On Thu, Nov 5, 2015 at 12:06 PM, Modassar Ather > wrote: > > > What is your index size? How much memory is used? What type of queries >

Re: Solr Cloud and Multiple Indexes

2015-11-05 Thread Modassar Ather
t; > How many segments are there in the index? The more the segment the slower > is > the search. > How do I check how many segments are there in the index? > > Is this after you moved to solrcloud? > I have been using SolrCloud from the beginning. > > Regards, > Salman

Exception in grouping with docValues enable field.

2015-11-05 Thread Modassar Ather
Hi, I have following docValues enabled field. *Field : * *Type: * When I am grouping on this field I am getting following exception. Kindly let me know if I am missing something or it is an issue. org.apache.solr.common.SolrException; java.lang.NullPointerException at org.apache.

Re: Exception in grouping with docValues enable field.

2015-11-08 Thread Modassar Ather
Hi, Any input will be really helpful. Regards, Modassar On Fri, Nov 6, 2015 at 11:20 AM, Modassar Ather wrote: > Hi, > > I have following docValues enabled field. > > *Field : * > *Type: * sortMissingLast="true" stored="false" indexed="false" d

Re: Exception in grouping with docValues enable field.

2015-11-08 Thread Modassar Ather
mention the version of Solr. > > Regards, >Alex. > > Solr Analyzers, Tokenizers, Filters, URPs and even a newsletter: > http://www.solr-start.com/ > > > On 8 November 2015 at 22:59, Modassar Ather > wrote: > > Hi, > > > > Any input will be

Re: Solr Cloud and Multiple Indexes

2015-11-08 Thread Modassar Ather
uch as performance? > > Which version of solr are you using? > Currently, I am using Solr 5.3. btw, I could not find segment info link. Is > it under Core Admin? > > Regards, > Salman > > > On Fri, Nov 6, 2015 at 7:26 AM, Modassar Ather > wrote: > > > Thanks fo

Difference in query behavior.

2015-11-30 Thread Modassar Ather
Hi, I have a query title:(solr lucene api). The mm is set to 100% using q.op as AND. When the query is executed it returns documnets having all the terms. It parses to following: +(title:solr title:faceting title:api)~3 Similarlly I have another query like this topic:facet AND title:(solr lucene

Re: Difference in query behavior.

2015-11-30 Thread Modassar Ather
:14 AM, Modassar Ather wrote: > Thanks for your response. > > Upayavira : The missing bracket is a copy paste error. Correct parsed > query : +(+topic:facet +(title:solr title:lucene title:api)). Use of fq is > not an option as these are user queries. > Alexandre : That is jus

Regarding behavior of docValues.

2015-02-24 Thread Modassar Ather
Hi, Kindly help me understand the behavior of following field. For a field like above where indexed="true" and docValues="true", is it that: 1) For sorting/faceting on *manu_exact* the docValues will be used. 2) For querying on *manu_exact* the inverted index will be used. Thanks, Modassar

Re: Regarding behavior of docValues.

2015-02-24 Thread Modassar Ather
Thanks for your response Mikhail. On Tue, Feb 24, 2015 at 5:35 PM, Mikhail Khludnev < mkhlud...@griddynamics.com> wrote: > Both statements seem true to me. > > On Tue, Feb 24, 2015 at 2:49 PM, Modassar Ather > wrote: > > > Hi, > > > > Kindly help me und

Re: Regarding behavior of docValues.

2015-02-24 Thread Modassar Ather
loading of the field from > disk, essentially > putting the uninverted field value in a conveniently-loadable form. > > So AFAIK, the field is stored only once and used for all three, > sorting, faceting and > searching. > > Best, > Erick > > On Tue, Feb 24, 2015 at 4

Re: Regarding behavior of docValues.

2015-02-24 Thread Modassar Ather
r not. > So if you want a "rule of thumb", make it a docValues field > if you're updating your index rapidly. Otherwise whether a field is > docValues or not is largely irrelevant. > > Best, > Erick > > On Tue, Feb 24, 2015 at 9:09 PM, Modassar Ather > wrot

  1   2   >