m
> -XX:MaxGCPauseMillis=250
> -XX:InitiatingHeapOccupancyPercent=75
> -XX:+UseLargePages
> -XX:+AggressiveOpts
> -Xmx32G
> -Xms32G
> -Xss256k
>
>
> Thanks & Regards
> Yasufumi.
>
> 2019年9月30日(月) 16:12 Deepak Goel :
>
> > Hello
> >
>
Hello
Can you please share the JVM heap settings in detail?
Deepak
On Mon, 30 Sep 2019, 11:15 Yasufumi Mizoguchi,
wrote:
> Hi,
>
> I am trying some tests to confirm if single Solr instance can perform over
> 1000 queries per second(!).
>
> But now, although CPU usage is 40% or so and iowait is
Document is not being passed. It has zero content.
It could be due to no memory in heap. For this please check GC logs
On Tue, 29 Jan 2019, 08:54 Schaum Mallik I am seeing this error in our logs. Our Solr heap is set to more than 10G.
> Any clues which anyone can provide will be very helpful.
>
You might have to use a APM tool (AppDynamics) to debug the busy solr
instance
Deepak
"The greatness of a nation can be judged by the way its animals are
treated. Please consider stopping the cruelty by becoming a Vegan"
+91 73500 12833
deic...@gmail.com
Facebook: https://www.facebook.com/deico
I would start by monitoring the hardware (CPU, Memory, Disk) & software
(heap, threads) utilization's and seeing where the bottlenecks are. Or what
is getting utilized the most. And then tune that parameter.
I would also look at profiling the software.
Deepak
"The greatness of a nation can be ju
Please see inline for my thoughts
Deepak
"The greatness of a nation can be judged by the way its animals are
treated. Please consider stopping the cruelty by becoming a Vegan"
+91 73500 12833
deic...@gmail.com
Facebook: https://www.facebook.com/deicool
LinkedIn: www.linkedin.com/in/deicool
"Pl
ind of delay...
>
> **
Can you provide graphs for cpu iowait too? (For large timeframes)
**
> On 30.10.18 10:21, Deepak Goel wrote:
>
> Yes. Swapping from disk to memory & vice versa
>
>
> Deepak
> "The greatness of a nation can be judged by the way its
ory, or something else?
>
> On 29.10.18 17:20, Deepak Goel wrote:
>
> I would then suspect performance is choking in memory disk layer. can you
> please check the performance?
>
> On Mon, 29 Oct 2018, 20:30 Sofiya Strochyk, wrote:
>
>> Hi Deepak and thanks for your repl
I would then suspect performance is choking in memory disk layer. can you
please check the performance?
On Mon, 29 Oct 2018, 20:30 Sofiya Strochyk, wrote:
> Hi Deepak and thanks for your reply,
>
> On 27.10.18 10:35, Deepak Goel wrote:
>
>
> Last, what is the nature of you
What are your hardware utilisations (cpu, memory, disk, network)?
I think you might have to tune lucene too
On Wed, 26 Sep 2018, 14:33 Mugeesh Husain, wrote:
> Hi,
>
> We are running 3 node solr cloud(4.4) in our production infrastructure, We
> recently moved our SOLR server host softlayer to d
On Fri, Oct 26, 2018 at 9:25 PM Sofiya Strochyk
wrote:
> Hi everyone,
>
> We have a SolrCloud setup with the following configuration:
>
>- 4 nodes (3x128GB RAM Intel Xeon E5-1650v2, 1x64GB RAM Intel Xeon
>E5-1650v2, 12 cores, with SSDs)
>- One collection, 4 shards, each has only a sin
Are you getting errors in Jmeter?
On Wed, 24 Oct 2018, 21:49 Amjad Khan, wrote:
> Hi,
>
> We recently moved to Solr Cloud (Google) with 4 nodes and have very
> limited number of data.
>
> We are facing very weird issue here, solr cluster response time for query
> is high when we have less number
Please check if there is a deadlock happening by taking heap dumps
Deepak
"The greatness of a nation can be judged by the way its animals are
treated. Please consider stopping the cruelty by becoming a Vegan"
+91 73500 12833
deic...@gmail.com
Facebook: https://www.facebook.com/deicool
LinkedIn:
What does your base hardware configuration look like?
You could have several VM's on machines with higher configuration.
Deepak
"The greatness of a nation can be judged by the way its animals are
treated. Please consider stopping the cruelty by becoming a Vegan"
+91 73500 12833
deic...@gmail.c
Do these machines have a firewall in-between?
On Fri, 8 Jun 2018, 20:29 Markus Jelsma, wrote:
> Hello Shawn,
>
> The logs appear useless, they are littered with these:
>
> 2018-06-08 14:02:47.382 ERROR (qtp1458849419-1263) [ ]
> o.a.s.s.HttpSolrCall null:org.apache.solr.common.SolrException: E
It would be a bit extensive, but would be interesting to know if a similar
error/situation occurs in Linux too (there are kernel level debugging tools
available for this open source OS)
On Wed, 6 Jun 2018, 10:59 Shawn Heisey, wrote:
> On 6/5/2018 10:26 PM, TK Solr wrote:
> > I visualized the GC
Is it possible to profile the code to find the exact points which are
taking more time comparatively?
On Sun, 27 May 2018, 06:02 Will Currie, wrote:
> I raised https://issues.apache.org/jira/browse/SOLR-12407. In case anybody
> else sees a similar slowdown with boosts.
>
> On Sat, May 26, 2018 a
On Mon, May 21, 2018 at 7:55 PM, Kelly, Frank wrote:
> Using Solr 5.3.1 - index
>
> We have an indexing heavy workload (we do more indexing than searching)
> and for those searches we do perform we have very few cache hits (25% of
> our index is in memory and the hit rate is < 0.1%)
>
> We are cu
If you can find out how Solr evolved over the years, you can perhaps follow
that same path
On Mon, 21 May 2018, 18:35 Erick Erickson, wrote:
> Another useful trick is the class hierarchy displays most modern IDE's
> have available to get a sense of what class is where. And I second
> Emir's comm
I wonder if in-memory-filesystem would help...
On Sat, 19 May 2018, 01:03 Erick Erickson, wrote:
> If you only return fields that are docValue=true that'll largely
> eliminate the disk seeks. 30 seconds does seem kind of excessive even
> with disk seeks though.
>
> Here'r a reference:
> https://
id> wrote:
>
> Master/slave are working on single computer with Intel Core i5 3.2GHz (it
> is 4 cores).
>
> It is standard visualVm ui with CPU usage. I think that it show overall
> CPU usage (for all cores).
> >Среда, 16 мая 2018, 17:42 +03:00 от Deepak Goel :
> &
How many CPU's do you have in master/slave?
The graphs shown by you are for 'a single CPU' or 'All the CPU'?
Deepak
"The greatness of a nation can be judged by the way its animals are
treated. Please stop cruelty to Animals, become a Vegan"
+91 73500 12833
deic...@gmail.com
Facebook: https://
Make In India : http://www.makeinindia.com/home
On Fri, May 11, 2018 at 8:15 PM, Shawn Heisey wrote:
> On 5/10/2018 2:22 PM, Deepak Goel wrote:
>
>> Are there any benchmarks for this approach? If not, I can give it a spin.
>> Also wondering if there are any alternative approach
On Fri, 11 May 2018, 01:15 Shawn Heisey, wrote:
> On 5/10/2018 11:49 AM, Deepak Goel wrote:
> > Sorry but I am unclear about - "What if there is no default value and the
> > field does not contain anything"? What does Solr pass on to Lucene? Or is
> > the field i
Make In India : http://www.makeinindia.com/home
On Thu, May 10, 2018 at 10:50 PM, Shawn Heisey wrote:
> On 5/10/2018 10:58 AM, Deepak Goel wrote:
>
>> I wonder what does Solr stores in the document for fields which are not
>> being used. And if the queries have a performance d
I wonder what does Solr stores in the document for fields which are not
being used. And if the queries have a performance difference
https://lucene.apache.org/solr/guide/6_6/defining-fields.html
(A default value that will be added automatically to any document that does
not have a value in this fie
I had a similar problem some time back. Although it might not be the best
way, but I used cron to move data from a high-end-spec to a lower-end-spec.
It worked beautifully
Deepak
"The greatness of a nation can be judged by the way its animals are
treated. Please stop cruelty to Animals, become a
Could you please also give the machine details of the two clouds you are
running?
Deepak
"The greatness of a nation can be judged by the way its animals are
treated. Please stop cruelty to Animals, become a Vegan"
+91 73500 12833
deic...@gmail.com
Facebook: https://www.facebook.com/deicool
Lin
> 6.2.1
> and re-indexed all the data, and it is working very well, even with the
> settings I had initially used. /
>
> Is anyone else facing this issue or any fixes got released in future build
> for this ?
>
> Keep us posted
>
>
> Deepak Goel wrote
> &
Please post the exact results. Many a times the high cpu utilisation may be
a boon as it improves query response times
On Tue, 17 Apr 2018, 13:55 mganeshs, wrote:
> Regarding query times, we couldn't see big improvements. Both are more or
> less same.
>
> Our main worry is that, why CPU usage is
Do you see a performance improvement in your 'Query Times' (6.2.1
vis-a-vis 6.5.1)?
Deepak
"Please stop cruelty to Animals, help by becoming a Vegan"
+91 73500 12833
deic...@gmail.com
Facebook: https://www.facebook.com/deicool
LinkedIn: www.linkedin.com/in/deicool
"Plant a Tree, Go Green"
On
A few observations:
1. The Old Gen Heap on 9th April is about 6GB occupied which then runs up
to 9+GB on 10th April (It steadily increases throughout the day)
2. The Old Gen GC is never able to reclaim any free memory
Deepak
"Please stop cruelty to Animals, help by becoming a Vegan"
+91 73500 1
, 2018 at 9:45 PM, Shawn Heisey wrote:
> On 3/25/2018 7:15 AM, Deepak Goel wrote:
>
>> $ Why is the 'qps' not increasing with increase in threads? (If I
>> understand the qps parameter right?)
>>
>
> Likely because I sent all these queries to a single copy of th
Deepak
"Please stop cruelty to Animals, help by becoming a Vegan"
+91 73500 12833
deic...@gmail.com
Facebook: https://www.facebook.com/deicool
LinkedIn: www.linkedin.com/in/deicool
"Plant a Tree, Go Green"
On Sun, Mar 25, 2018 at 2:24 PM, Shawn Heisey wrote:
> On 3/25/2018 1:45 AM, Shawn Heise
On 25 Mar 2018 6:49 am, "Shawn Heisey" wrote:
On 3/24/2018 6:21 PM, Deepak Goel wrote:
> Do you have any documented proof of the same (1 to 5ms)? Or is it an
> educated guess
>
Just now, I did a test. I did a "*:*" query (all docs), the QTime was 194
millise
Deepak
"Please stop cruelty to Animals, help by becoming a Vegan"
+91 73500 12833
deic...@gmail.com
Facebook: https://www.facebook.com/deicool
LinkedIn: www.linkedin.com/in/deicool
"Plant a Tree, Go Green"
On Sun, Mar 25, 2018 at 4:00 AM, Shawn Heisey wrote:
> On 3/
Deepak
"Please stop cruelty to Animals, help by becoming a Vegan"
+91 73500 12833
deic...@gmail.com
Facebook: https://www.facebook.com/deicool
LinkedIn: www.linkedin.com/in/deicool
"Plant a Tree, Go Green"
On Sat, Mar 24, 2018 at 6:03 AM, Rick Leir wrote:
>
>
> Deep,
> What is the test so I ca
Deepak
"Please stop cruelty to Animals, help by becoming a Vegan"
+91 73500 12833
deic...@gmail.com
Facebook: https://www.facebook.com/deicool
LinkedIn: www.linkedin.com/in/deicool
"Plant a Tree, Go Green"
On Sat, Mar 24, 2018 at 5:16 AM, Shawn Heisey wrote:
> On 3/2
Deepak
"Please stop cruelty to Animals, help by becoming a Vegan"
+91 73500 12833
deic...@gmail.com
Facebook: https://www.facebook.com/deicool
LinkedIn: www.linkedin.com/in/deicool
"Plant a Tree, Go Green"
On Sat, Mar 24, 2018 at 6:18 AM, Shawn Heisey wrote:
> On 3/
Deepak
"Please stop cruelty to Animals, help by becoming a Vegan"
+91 73500 12833
deic...@gmail.com
Facebook: https://www.facebook.com/deicool
LinkedIn: www.linkedin.com/in/deicool
"Plant a Tree, Go Green"
On Fri, Mar 23, 2018 at 11:38 PM, Shawn Heisey wrote:
> On 3/2
Deepak
"Please stop cruelty to Animals, help by becoming a Vegan"
+91 73500 12833
deic...@gmail.com
Facebook: https://www.facebook.com/deicool
LinkedIn: www.linkedin.com/in/deicool
"Plant a Tree, Go Green"
On Tue, Mar 20, 2018 at 3:32 AM, Shawn Heisey wrote:
> On 3/
Deepak
"Please stop cruelty to Animals, help by becoming a Vegan"
+91 73500 12833
deic...@gmail.com
Facebook: https://www.facebook.com/deicool
LinkedIn: www.linkedin.com/in/deicool
"Plant a Tree, Go Green"
On Thu, Mar 22, 2018 at 1:25 AM, Deepak Goel wrote:
>
>
&
; On Mar 17, 2018, at 3:23 AM, Deepak Goel wrote:
> >
> > Sorry for being rude. But the ' results ' please, not the ' road to the
> > results '
>
> We have 15 different search collections, all different sizes and all with
> different kinds of queries
Deepak
"Please stop cruelty to Animals, help by becoming a Vegan"
+91 73500 12833
deic...@gmail.com
Facebook: https://www.facebook.com/deicool
LinkedIn: www.linkedin.com/in/deicool
"Plant a Tree, Go Green"
On Sat, Mar 17, 2018 at 2:56 AM, Shawn Heisey wrote:
> On 3/
On 17 Mar 2018 05:19, "Walter Underwood" wrote:
> On Mar 16, 2018, at 3:26 PM, Deepak Goel wrote:
>
> Can you please post results of your test?
>
> Please tell us the tps at 25%, 50%, 75%, 100% of your CPU resource
I could, but it probably would not be useful f
On Sat, Mar 17, 2018 at 3:11 AM, Walter Underwood
wrote:
> > On Mar 16, 2018, at 1:21 PM, Deepak Goel wrote:
> >
> > However a single client object with thousands of queries coming in would
> > surely become a bottleneck. I can test this scenario too.
>
> No it i
On Sat, Mar 17, 2018 at 2:56 AM, Shawn Heisey wrote:
> On 3/16/2018 2:21 PM, Deepak Goel wrote:
> > I wanted to test how many max connections can Solr handle concurrently.
> > Also I would have to implement an 'connection pooling' of the
> client-object
> >
On Sat, Mar 17, 2018 at 1:06 AM, Shawn Heisey wrote:
> On 3/16/2018 7:38 AM, Deepak Goel wrote:
> > I did a performance study of Solr a while back. And I found that it does
> > not scale beyond a particular point on a single machine (could be due to
> > the way its c
> >caching hint.
Deepak
"Please stop cruelty to Animals, help by becoming a Vegan"
+91 73500 12833
deic...@gmail.com
Facebook: https://www.facebook.com/deicool
LinkedIn: www.linkedin.com/in/deicool
"Plant a Tree, Go Green"
On Fri, Mar 16, 2018 at 9:43 PM, Walter Underwo
> On Mar 16, 2018, at 6:26 AM, Deepak Goel wrote:
>
> I would try multiple Solr instances rather a single Solr instance (it
> definitely will give a performance boost)
> I would avoid multiple Solr instances on single machine. I can use all 36
cores on our servers with one Solr pr
On Fri, Mar 16, 2018 at 6:03 PM, Shawn Heisey wrote:
> On 3/15/2018 6:34 AM, BlackIce wrote:
>
>> However the main app that will be
>> running is more or less a single threated app which takes advantage when
>> run under several instances, ie: parallelism, so I thought, since I'm at
>> it
>> I ma
>I think there is no benefit in having multiple Solr instances on a single
>server, unless the heap memory required by the JVM is too big.
Deepak***
I would try multiple Solr instances rather a single Solr instance (it
definitely will give a performance boost)
Deepak***
>And remember that t
Please see inline...
Deepak
"Please stop cruelty to Animals, help by becoming a Vegan"
+91 73500 12833
deic...@gmail.com
Facebook: https://www.facebook.com/deicool
LinkedIn: www.linkedin.com/in/deicool
"Plant a Tree, Go Green"
On Thu, Mar 15, 2018 at 6:04 PM, BlackIce wrote:
> Shawn:
> well
Have you measured the overhead of VM anytime? Or have you read it somewhere?
On 14 Mar 2018 18:10, "BlackIce" wrote:
> but it should be possible, without the overhead of VM's
>
> On Wed, Mar 14, 2018 at 1:30 PM, Deepak Goel wrote:
>
> > The OS resources would
en do some testing further down the
> road.
> > For now just get the sucker up and running.
> >
> > Thanks all
> >
> > On Mon, Mar 12, 2018 at 7:23 PM, Deepak Goel wrote:
> >
> >> I am not sure if I understand your question
> >>
> >>
;
> > OK, so we're gone nowhere, since I've already lost lots of time... A
> few
> > days more or less won't make a difference I'd be willing to
> benchmark
> > if some tells me how to.
> >
> >
> > Greetz
> >
> > On Mar
solrconfig.xml
> > and I'm just diving into a bit more deeper stuff!
> >
> > Greetz
> >
> > RRK
> >
> > On Sun, Mar 11, 2018 at 8:58 PM, Deepak Goel wrote:
> >
> >> To rephrase your Question
> >>
> >> "Does Solr do
found this for running multiple apache servers on multiple VMs as
compared to a single instance (not Solr). But i am pretty sure it would be
same for Solr too
On 12 Mar 2018 12:42, "Shawn Heisey" wrote:
> On 3/11/2018 7:39 PM, Deepak Goel wrote:
>
>> I doubt this. It would b
On 12 Mar 2018 05:51, "Shawn Heisey" wrote:
On 3/11/2018 11:35 AM, BlackIce wrote:
> I have some questions regarding performance.
>
> Lets says I have a dual CPU with a total of 8 cores and 24 GB RAM for my
> Solr and some other stuff.
>
> Would it be more beneficial to only run 1 instance of So
To rephrase your Question
"Does Solr do well with Scale-up or Scale-out?"
Are there any Performance Benchmarks for the same out there supporting the
claim?
On 11 Mar 2018 23:05, "BlackIce" wrote:
> Hi,
>
> I have some questions regarding performance.
>
> Lets says I have a dual CPU with a tota
gt; On Feb 23, 2018, at 4:15 PM, Deepak Goel wrote:
>
> Can you please post all the errors? The current error is only for the node
> 'solr-2d'
>
> On 23 Feb 2018 09:42, "Tom Peters" wrote:
>
> I'm trying to debug why indexing in SolrCloud 7.1 is
Can you please post all the errors? The current error is only for the node
'solr-2d'
On 23 Feb 2018 09:42, "Tom Peters" wrote:
I'm trying to debug why indexing in SolrCloud 7.1 is having so many issues.
It will hang most of the time, and timeout the rest.
Here's an example:
time curl -s 'm
One more idea could be is to have multiple vm's (8 cpu each) on your server
and load balance them. That would help Solr6 scale nicely
On 12 Feb 2018 23:05, "Deepak Goel" wrote:
> If the community cannot help, the only way i can think is either to
> profile Solr (java) unde
If the community cannot help, the only way i can think is either to profile
Solr (java) under a load test to find the problem. You could also use an
APM.
On 12 Feb 2018 23:00, "~$alpha`" wrote:
> Yes, but how to move ahead now.
> Its strange solr4 is better behaving than solr6
>
>
>
> --
> Sent
This would then mean that solr6 is reaching some kind of saturation (number
of threads, etc) at about loads of 60 Hits which then drives the
performance of it to be very bad !
Deepak
"Please stop cruelty to Animals, help by becoming a Vegan"
+91 73500 12833
deic...@gmail.com
Facebook: https://w
Please test for higher number of hits till cpu load reaches 100%
On 12 Feb 2018 19:44, "~$alpha`" wrote:
> Hits 41 :
> Avg response time470ms vs 380ms
> CPU Load reaches6 vs 10
>
> Hits 82:
> Avg response time 500ms vs 620ms (solr6 performing bad on peak
I would suggest to keep the load same both for solr4 and solr6. And then
test. Also please post exact concurrent hits
On 12 Feb 2018 12:48, "~$alpha`" wrote:
When both solr4 and solr6 have concurrent hits:
1. 30 to 40 :
Avg response time 470ms vs 380ms
Load 6 vs 10
1. 80 to
Also can you please post the throughputs for both of your tests
On 12 Feb 2018 00:35, "Deepak Goel" wrote:
> Yup. Improvement of response time would hurt the cpu usage. The other
> thing is more memory usage (cache) which gets included into the cpu usage.
>
>
>
> D
Yup. Improvement of response time would hurt the cpu usage. The other thing
is more memory usage (cache) which gets included into the cpu usage.
Deepak
"Please stop cruelty to Animals, help by becoming a Vegan"
+91 73500 12833
deic...@gmail.com
Facebook: https://www.facebook.com/deicool
LinkedI
Two things trouble me:
1. It is a shared resource, so results are unreliable
2. Since cache results have increased, memory access will increase and it
will result in an increase in cpu usage. However response times will also
improve
To support more load you will have to increase server capacity
Can you please give the configuration of your server?
On 11 Feb 2018 19:17, "~$alpha`" wrote:
> I have upgraded Solr4.0 Beta to Solr6.6. The Cache results look Awesome but
> overall the CPU load on solr6.6 is double the load on solr4.0 and hence I
> am
> not able to roll solr6.6 to 100% of my tr
FYI. I recently did a study on 'Performance of Solr'
https://www.linkedin.com/pulse/performance-comparison-solr-elasticsearch-deepak-goel/?trackingId=N2j9xWvVEQQaZYa%2BoEsy%2Bw%3D%3D
Deepak
"Please stop cruelty to Animals, help by becoming a Vegan"
+91 73500 12833
deic...
;:"13",
"line_number":"3.3.37",
"speaker":"HENRY BOLINGBROKE",
"text_entry":"Henry Bolingbroke",
"id":"9428c765-a4e8-4116-937a-9b70e8a8e2de",
"_version_":1588569205789163522,
"speaker_str":[
*Hello*
*In Solr Admin: I type the q parameter as - *
*text_entry:**
*It gives the following exception (In the schema I do see a field as
text_entry):*
{ "responseHeader":{ "zkConnected":true, "status":400, "QTime":2, "params":{
"q":"text_entry:*", "_":"1516190134181"}}, "error":{ "metadata":[
ww.avg.com/email-signature?utm_medium=email&utm_source=link&utm_campaign=sig-email&utm_content=webmail>
Virus-free.
www.avg.com
<http://www.avg.com/email-signature?utm_medium=email&utm_source=link&utm_campaign=sig-email&utm_content=webmail>
<#DAB4FAD8-2DD7-40B
Got it . Thank You for your help
Deepak
"Please stop cruelty to Animals, help by becoming a Vegan"
+91 73500 12833
deic...@gmail.com
Facebook: https://www.facebook.com/deicool
LinkedIn: www.linkedin.com/in/deicool
"Plant a Tree, Go Green"
On Mon, Jan 8, 2018 at 11:48 PM
m/in/deicool
"Plant a Tree, Go Green"
On Mon, Jan 8, 2018 at 10:55 PM, Alexandre Rafalovitch
wrote:
> I think you are missing /query handler endpoint in the URL. Plus actual
> search parameters.
>
> You may try using the admin UI to build your queries first.
>
> Regards
Hello
*I am trying to search for documents in my collection (Shakespeare). The
code is as follows:*
SolrClient client = new HttpSolrClient.Builder("
http://localhost:8983/solr/shakespeare";).build();
SolrDocument doc = client.getById("2");
*However this does not return any document. What mistake
78 matches
Mail list logo
