We are using SolrCloud and trying to configure it for testing purposes, we
are seeing that the average query time is increasing if we have more than
one node in the SolrCloud cluster. We have a single shard 12 gigs
index.Example:1 node, average query time *~28 msec* , load 140
queries/second3 nodes
We measured for just 3 nodes the overhead is around 100ms. We also noticed is
that CPU spikes to 100% and some queries get blocked, this happens only when
cloud has multiple nodes but does not happen on single node. All the nodes
has the exact same configuration and JVM setting and hardware configu
round 30-50ms for a 100 machines, each with 10 million docs a few years
ago.
So…that doesn't help you much…but FYI…
- Mark
On Dec 5, 2012, at 5:35 PM, sausarkar <[hidden email]> wrote:
> We are using SolrCloud and trying to configure it for testing purposes, we
> are seeing
bug?
Re: SolrCloud - Query performance degrades with multiple servers
Dec 06, 2012; 3:13pm — by sausarkar
I also did a test running a load directed to one single server in the cloud
and checked the CPU usage of other servers. It seems that even if there are
no load directed to those servers there
8880447&wt=javabin&version=2
Re: SolrCloud - Query performance degrades with multiple servers
Dec 06, 2012; 6:29pm — by Mark Miller-3
On Dec 6, 2012, at 5:08 PM, sausarkar <[hidden email]> wrote:
> We solved the issue by explicitly adding numShards=1 argument to the solr
&g
Query performance degrades with multiple servers
If that's true, we will fix it for 4.1. I can look closer tomorrow.
Mark
Sent from my iPhone
On Dec 9, 2012, at 2:04 AM, sausarkar <[hidden
email]> wrote:
> Spoke too early it seems that SolrCloud is still distributing queries t
Do you know when will 4.1 be released or will there be a 4.0.1 release with
bug fixes from 4.0?
Thanks
--
View this message in context:
http://lucene.472066.n3.nabble.com/SolrCloud-Query-performance-degrades-with-multiple-servers-tp4024660p4026139.html
Sent from the Solr - User mailing list ar
We still could replicate the issue in 4.1 branch i.e. queries going to one
server (numShards=1) is being distributed among all the servers which is
creating CPU spikes in all the servers in the cloud. Do you think this
behavior is as expected or will be fixed in the 4.1 release?
--
View this mes
Hi Yonik,
Could you merger this feature with 4.0 branch, We tried to use 4.1 it did
solve the CPU spike but we did get other issues. As we are very tight on
schedule so it would very beneficial if you could merge this feature with
4.0 branch.
Let me know.
Thanks
--
View this message in contex
we are experiencing performance issues with date range queries. We have
configured the date fields as following:
Our queries are rounded every minute:
qt=ads&debugQuery=false&fl=id,StartDt_t110,...&fq=Status_i110:2&fq=StartDt_t110:{
NOW/MINUTE-150DAYS TO NOW/MINUTE-90DAYS }&start=0&rows=20
When the query time jump to more than 10 seconds the linux load average
spikes up to more than 100 in a 16 CPU machine. Any one has any suggestions?
--
View this message in context:
http://lucene.472066.n3.nabble.com/date-query-performance-TrieDate-tp4038419p4038422.html
Sent from the Solr - Us
Unfortunately we need data by minute we cannot go hour, is there an option
for 3 minutes or 5 minutes? something is like NOW/3MIN?
I am also noticing when I generating around 110 queries per second (date
range ones) after sometime solr does not respond and just freezes. Is there
a way to cure this
We have a 96GB ram machine with 16 processors. the JVM is set to use 60 GB.
The test that we are running are purely query there is no indexing going on.
I dont see garbage collection when I attach visualVM but see frequent CPU
spikes ~once every minute.
--
View this message in context:
http://l
Hi Mark,
I am am also facing the same issue when trying to index in SolrCloud using
DIH running on a non-leader server. The DIH server is creating around 10k
threads and then OOM cannot create thread error.
Do you know when or which version this issue will be solved. I think a
workaround for thi
If I try to run DIH on the SolrCloud it can hit any one of the servers and
start the import process, but if we try to get the import status from any
other server it returns no import is running. Only the server that is
running the DIH gives back the correct import status. So if we run DIH
behind a
Do anyone know if query using CommonsHttpSolrServer on SolrCloud is
automatically load balanced? I am trying to load test using solrmeter on one
if the node I am seeing all the nodes seems to be hit. Any clues
--
View this message in context:
http://lucene.472066.n3.nabble.com/SolrCloud-load-ba
actually I noticing that the CommonsHttpSolrServer seems to load balancing by
hitting all servers in the cluster, just wanted to confirm if that is the
case.
--
View this message in context:
http://lucene.472066.n3.nabble.com/SolrCloud-load-balancing-tp3999143p3999145.html
Sent from the Solr -
Hi Mark,
You are referring to the CloudSolrServer not CommonsHttpSolrServer right?
does the CommonsHttpSolrServer also round robin?
Do you recommend any tool for load testing SolrCloud?
Thanks,
Sauvik
--
View this message in context:
http://lucene.472066.n3.nabble.com/SolrCloud-load-balanc
anyone has any clue when will the beta version of Solr 4.0 be released also
is their any timeframe when the first GA release for Solr4.0?
--
View this message in context:
http://lucene.472066.n3.nabble.com/Solr-4-0-schedule-tp4000561.html
Sent from the Solr - User mailing list archive at Nabble
Hello Mark,
Has this issue been fixed in the BETA release?
- Sauvik
--
View this message in context:
http://lucene.472066.n3.nabble.com/SOLR-4-Alpha-Out-Of-Mem-Err-tp3995033p4001266.html
Sent from the Solr - User mailing list archive at Nabble.com.
I just upgrade to Solr 4.0.0-BETA and it seems there is a problem with the
StempelPolishStemFilterFactory it cannot find a resource, it seems that the
bug was introduced in the new beta release, this works fine in the alpha
release.
Here is the exception I am seeing in the logs:
SEVERE: null:java
No I tried that, Solr is finding and loading all the other contrib jars but
only for the Polish one it is complaining, it seems like this is a bug.
--
View this message in context:
http://lucene.472066.n3.nabble.com/Solr4-0-BETA-Error-when-StempelPolishStemFilterFactory-is-used-tp4001724p400173
oduce - I agree, this seems like a bug.
I've opened an issue: https://issues.apache.org/jira/browse/SOLR-3737
Thanks for reporting!
Steve
-Original Message-
From: sausarkar [mailto:[hidden
email]]
Sent: Thursday, August 16, 2012 6:42 PM
To: [hidden email]
S
We noticed that when we use SolrCloud the accents are not getting removed
when we use the
filter. We are using the -Dbootstrap_conf=true to load the conf folder.
This filter however is working fine in the standalone solr startup scenario.
Did anyone notice the same issue? Do we need to d
Just found out that this was not an SolrCloud issue but an issue with the
Tomcat configuration basically the URIEncoding was missing added it and it
fixed the problem.
--
View this message in context:
http://lucene.472066.n3.nabble.com/SolrCloud-issue-accents-are-not-getting-removed-tp4
can someone let me know how to configure DIH in a cloud environment, should
it point to one specific server or to the load balancer for distributing dih
on all the servers.
One problem with the load balancer approach is that there is no good way to
tell whether a dih is already running in the clou
26 matches
Mail list logo
