Re: Performance issue with Solr 8.6.1 Unified Highlighter does not occur on Solr 6.

2021-02-01 Thread Kerwin
Hi David, Thanks for filing this issue. The classic non-weightMatcher mode works well for us right now. Yes, we are using the POSTINGS mode for most of the fields although explicitly mentioning it gives an error since not all fields are indexed with offsets. So I guess the highlighter is picking

Re: Performance issue with Solr 8.6.1 Unified Highlighter does not occur on Solr 6.

2021-01-29 Thread David Smiley
https://issues.apache.org/jira/browse/SOLR-10321 -- near the end my opinion is we should just omit the field if there is no highlight, which would address your need to do this work-around. Glob or no glob. PR welcome! It's satisfying seeing that the Unified Highlighter is so much faster than the

Re: Performance issue with Solr 8.6.1 Unified Highlighter does not occur on Solr 6.

2021-01-28 Thread Kerwin
On another note, since response time is in question, I have been using a customhighlighter to just override the method encodeSnippets() in the UnifiedSolrHighlighter class since solr 6 since Solr sends back blank array (ZERO_LEN_STR_ARRAY) in the response payload for fields that do not match. Here

Re: Performance issue with Solr 8.6.1 Unified Highlighter does not occur on Solr 6.

2021-01-28 Thread Kerwin
Hi David, Thanks so much for your reply. hl.weightMatches was indeed the culprit. After setting it to false, I am now getting the same sub-second response as Solr 6. I am using Solr 8.6.1 (8.6.1) Here are the tests I carried out: hl.requireFieldMatch=true&hl.weightMatches=true (2458 ms) hl.requi

Re: Performance issue with Solr 8.6.1 Unified Highlighter does not occur on Solr 6.

2021-01-28 Thread David Smiley
to more than 4 seconds > with 76 fields in the hl.q and hl.fl parameters. So I played with > different options and found that the hl.q parameter needs to have any one > field for the performance issue to vanish. I do not know why this would be > so. Could you check if this is a bug or some

Performance issue with Solr 8.6.1 Unified Highlighter does not occur on Solr 6.

2021-01-26 Thread Kerwin
for the performance issue to vanish. I do not know why this would be so. Could you check if this is a bug or something else? This is not the case if I use the original highlighter which has same performance on Solr 6 and Solr 8 of ~ 1.5 seconds. The highlighting payload is also mostly same in all the

Re: Cursor Performance Issue

2021-01-14 Thread Ajay Sharma
> tie: "0.01", > > defType: "edismax", > > qf: "customphonetic", > > wt: "json", > >qs: "1", > >qt: "mapping", > >rows: "25", > >q: "bird toy", >

Re: Cursor Performance Issue

2021-01-13 Thread Mike Drob
", > tie: "0.01", > defType: "edismax", > qf: "customphonetic", > wt: "json", >qs: "1", >qt: "mapping", >rows: "25", > q: "bird toy", >timeAllowed: "15000

Cursor Performance Issue

2021-01-13 Thread Ajay Sharma
c", wt: "json", qs: "1", qt: "mapping", rows: "25", q: "bird toy", timeAllowed: "15000" } }, response: { numFound: 17, start: 0, maxScore: 26.616478, docs: [ { id: "22347708097", refid: "152585558"

Re: Performance issue in Query execution in Solr 8.3.0 and 8.5.1

2020-05-18 Thread vishal patel
Any one is looking my issue? Due to this issue I can not upgrade Solr 8.3.0. regards, Vishal Patel From: vishal patel Sent: Sunday, May 17, 2020 11:49 AM To: solr-user Subject: Re: Performance issue in Query execution in Solr 8.3.0 and 8.5.1 Solr 6.1.0 : 1881

Re: Performance issue in Query execution in Solr 8.3.0 and 8.5.1

2020-05-16 Thread vishal patel
From: vishal patel Sent: Sunday, May 17, 2020 11:04 AM To: solr-user Subject: Re: Performance issue in Query execution in Solr 8.3.0 and 8.5.1 Thanks for reply. I know Query field value is large. But same thing is working fine in Solr 6.1.0 and query executed within 300 milliseconds

Re: Performance issue in Query execution in Solr 8.3.0 and 8.5.1

2020-05-16 Thread vishal patel
Patel From: Mikhail Khludnev Sent: Saturday, May 16, 2020 6:55 PM To: solr-user Subject: Re: Performance issue in Query execution in Solr 8.3.0 and 8.5.1 It seems this thread is doing heavy work, mind the bottom line. 202.8013ms 124.8008ms qtp153245266-156 (156

Re: Performance issue in Query execution in Solr 8.3.0 and 8.5.1

2020-05-16 Thread Mikhail Khludnev
t; Vishal Patel > ________ > From: Mikhail Khludnev > Sent: Saturday, May 16, 2020 2:23 PM > To: solr-user > Subject: Re: Performance issue in Query execution in Solr 8.3.0 and 8.5.1 > > Can you check Thread Dump in Solr Admin while Solr 8.3 crunches

Re: Performance issue in Query execution in Solr 8.3.0 and 8.5.1

2020-05-16 Thread vishal patel
. Regards, Vishal Patel From: Mikhail Khludnev Sent: Saturday, May 16, 2020 2:23 PM To: solr-user Subject: Re: Performance issue in Query execution in Solr 8.3.0 and 8.5.1 Can you check Thread Dump in Solr Admin while Solr 8.3 crunches query for 34 seconds? Please

Re: Performance issue in Query execution in Solr 8.3.0 and 8.5.1

2020-05-16 Thread Mikhail Khludnev
t from Outlook<http://aka.ms/weboutlook> > > From: vishal patel > Sent: Friday, May 15, 2020 3:06 PM > To: solr-user@lucene.apache.org > Subject: Re: Performance issue in Query execution in Solr 8.3.0 and 8.5.1 > > I have result of query

Re: Performance issue in Query execution in Solr 8.3.0 and 8.5.1

2020-05-16 Thread vishal patel
Any one is looking my issue? Please help me. Sent from Outlook<http://aka.ms/weboutlook> From: vishal patel Sent: Friday, May 15, 2020 3:06 PM To: solr-user@lucene.apache.org Subject: Re: Performance issue in Query execution in Solr 8.3.0 and 8.5.1

Re: Performance issue in Query execution in Solr 8.3.0 and 8.5.1

2020-05-15 Thread vishal patel
: solr-user@lucene.apache.org Subject: Performance issue in Query execution in Solr 8.3.0 and 8.5.1 I am upgrading Solr 6.1.0 to Solr 8.3.0 or Solr 8.5.1. I get performance issue for query execution in Solr 8.3.0 or Solr 8.5.1 when values of one field is large in query and group field is apply

Performance issue in Query execution in Solr 8.3.0 and 8.5.1

2020-05-14 Thread vishal patel
I am upgrading Solr 6.1.0 to Solr 8.3.0 or Solr 8.5.1. I get performance issue for query execution in Solr 8.3.0 or Solr 8.5.1 when values of one field is large in query and group field is apply. My Solr URL : https://drive.google.com/file/d/1UqFE8I6M451Z1wWAu5_C1dzqYEOGjuH2/view My Solr

RE: Possible performance issue in my environment setup

2020-02-11 Thread Rudenko, Artur
: Tuesday, February 11, 2020 4:16 PM To: solr-user@lucene.apache.org Subject: Re: Possible performance issue in my environment setup My first bit of advice would be to fix your autocommit intervals. There’s not much point in having openSearcher set to true _and_ having your soft commit times also set

Re: Possible performance issue in my environment setup

2020-02-11 Thread Erick Erickson
if a particular _component_ is taking a long time, something like faceting say. - If nothing jumps out, throw a profiler at Solr to see where it’s spending it’s time. Best, Erick > On Feb 11, 2020, at 6:17 AM, Rudenko, Artur wrote: > > I'm am currently investigating a performance issue

Possible performance issue in my environment setup

2020-02-11 Thread Rudenko, Artur
I'm am currently investigating a performance issue in our environment (20M large PARENT documents and 800M nested small CHILD documents). The system inserts about 400K PARENT documents and 16M CHILD documents per day. This is a solr cloud 8.3 environment with 7 servers (64 VCPU 128 GB RAM

Re: Performance Issue since Solr 7.7 with wt=javabin

2020-01-30 Thread Karl Stoney
kef> From: Karl Stoney Sent: Thursday, January 30, 2020 3:56:31 PM To: solr-user@lucene.apache.org Subject: Re: Performance Issue since Solr 7.7 with wt=javabin I don’t have confidence in my ability to do that, I was hoping someone could help out as moving to 8.4 is too muc

Re: Performance Issue since Solr 7.7 with wt=javabin

2020-01-30 Thread Karl Stoney
ary 30, 2020 2:23:40 PM To: solr-user Subject: Re: Performance Issue since Solr 7.7 with wt=javabin No further releases are planned for 7.x, so your best bet is to patch branch_7_7 yourself and build a custom Solr version. Jan > 29. jan. 2020 kl. 20:54 skrev Karl Stoney > : > > Coul

Re: Performance Issue since Solr 7.7 with wt=javabin

2020-01-30 Thread Jan Høydahl
Sithi > Sent: 29 January 2020 14:34 > To: solr-user@lucene.apache.org > Subject: Re: Performance Issue since Solr 7.7 with wt=javabin > > yes thanks so much, fixed in 8.4.0 > > > > -- > Sent from: > https://eur03.safelinks.protection.outlook.com/?url=ht

Re: Performance Issue since Solr 7.7 with wt=javabin

2020-01-29 Thread Karl Stoney
Could anyone produce a patch for 7.7 please? From: Florent Sithi Sent: 29 January 2020 14:34 To: solr-user@lucene.apache.org Subject: Re: Performance Issue since Solr 7.7 with wt=javabin yes thanks so much, fixed in 8.4.0 -- Sent from: https://eur03

Re: Performance Issue since Solr 7.7 with wt=javabin

2020-01-29 Thread Florent Sithi
yes thanks so much, fixed in 8.4.0 -- Sent from: https://lucene.472066.n3.nabble.com/Solr-User-f472068.html

Re: Performance Issue since Solr 7.7 with wt=javabin

2020-01-29 Thread Jan Høydahl
Check out SOLR-14013 which I believe is what you are looking for Jan > 29. jan. 2020 kl. 11:46 skrev Florent Sithi : > > Hi Paras, > > Thanks for your answer and your ideas ;) > > I have the exact same issue than Andy "wt=javabin&version=2"

Re: Performance Issue since Solr 7.7 with wt=javabin

2020-01-29 Thread Florent Sithi
Hi Paras, Thanks for your answer and your ideas ;) I have the exact same issue than Andy "wt=javabin&version=2" have really poor performances comprared to wt=json I'm using : - solr 7.7.2 - OpenJDK8U-jdk_x64_linux_hotspot_8u222b10 or jdk-8u241-linux-x64 (same behaviour) The server have much R

Re: Performance Issue since Solr 7.7 with wt=javabin

2019-10-18 Thread Paras Lehana
Hi Andy, Have you run performance benchmarking for sometime and made sure that the Solr Caching and GC doesn't impact the performance? I recommend that you should rebuild the performance matrix after few warmups and requests. Have you invalidated this? On Fri, 18 Oct 2019 at 12:35, Jan Høydahl w

Re: Performance Issue since Solr 7.7 with wt=javabin

2019-10-18 Thread Jan Høydahl
Hi, Did you find a solution to your performance problem? -- Jan Høydahl, search solution architect Cominvent AS - www.cominvent.com > 17. jun. 2019 kl. 17:17 skrev Andy Reek : > > Hi Solr team, > > we are using Solr in version 7.1 as search engine in our online shop (SAP > Hybris). And as a t

Re: Performance Issue since Solr 7.7 with wt=javabin

2019-10-12 Thread Noble Paul
How are you consuming the output? Are you using solrj? On Tue, Jun 18, 2019, 1:27 AM Andy Reek wrote: > Hi Solr team, > > > we are using Solr in version 7.1 as search engine in our online shop (SAP > Hybris). And as a task I needed to migrate to the most recent Solr in > version 7 (7.7). Doing t

Re: Solr 7.2.1 Collection Backup Performance issue

2018-09-21 Thread Walter Underwood
I don’t know how well it worked, but for a while, I did this to warm up the file buffers. It should be OK if RAM is bigger than data. Though “cat” probably opens the files with the hint that it will never re-read the data. find /solr-data-dir -type f | xargs cat > /dev/null Basically, read ever

Re: Solr 7.2.1 Collection Backup Performance issue

2018-09-21 Thread Ganesh Sethuraman
We don't have all the index size fit in into memory, but we still have an acceptable performance as of now for reads/query. But with BACKUP we are seeing a increase in the OS memory usage. Given that, I am sure many of system might be running with less memory but good enough for their application.

Re: Solr 7.2.1 Collection Backup Performance issue

2018-09-18 Thread Ganesh Sethuraman
Thanks for the information. I thought backup is going to be more of the disk activity. But I understand now that RAM is involved here as well. We indeed did NOT have enough memory in this box, as it is 64GB box with index size of 72GB, being backed up. The read (real time GET) performance was bette

Re: Solr 7.2.1 Collection Backup Performance issue

2018-09-18 Thread Shawn Heisey
On 9/18/2018 11:00 AM, Ganesh Sethuraman wrote: We are using Solr 7.2.1 with SolrCloud with 35 collections with 1 node ZK ensemble (in lower environment, we will have 3 nodes ensemble) in AWS. We are testing to see if we have Async Solr Cloud backup ( https://lucene.apache.org/solr/guide/7_2/col

Solr 7.2.1 Collection Backup Performance issue

2018-09-18 Thread Ganesh Sethuraman
Hi We are using Solr 7.2.1 with SolrCloud with 35 collections with 1 node ZK ensemble (in lower environment, we will have 3 nodes ensemble) in AWS. We are testing to see if we have Async Solr Cloud backup ( https://lucene.apache.org/solr/guide/7_2/collections-api.html#backup) done every time we a

Re: Suggestions for debugging performance issue

2018-06-27 Thread Susheel Kumar
ill > >> > see response times way higher than another environment that is not > using > >> > CDCR. It doesn't seem to matter if CDCR is enabled or disabled, just > >> that > >> > we are using the CDCRUpdateLog. The problem started happening even

Re: Suggestions for debugging performance issue

2018-06-25 Thread Chris Troullis
nse times way higher than another environment that is not using >> > CDCR. It doesn't seem to matter if CDCR is enabled or disabled, just >> that >> > we are using the CDCRUpdateLog. The problem started happening even >> before >> > we enabled CDCR. >>

Re: Suggestions for debugging performance issue

2018-06-15 Thread Chris Troullis
isabled, just that > > we are using the CDCRUpdateLog. The problem started happening even before > > we enabled CDCR. > > > > In a lower environment we noticed that the transaction logs were huge > > (multiple gigs), so we tried stopping solr and deleting the tlogs th

Re: Suggestions for debugging performance issue

2018-06-14 Thread Shawn Heisey
transaction logs were huge > (multiple gigs), so we tried stopping solr and deleting the tlogs then > restarting, and that seemed to fix the performance issue. We tried the same > thing in production the other day but it had no effect, so now I don't know > if it was a coincidence

Re: Suggestions for debugging performance issue

2018-06-13 Thread Chris Troullis
- > opensearcher-true. > > > >> > > > >> In all, though, none of the usual suspects seems to make sense here > > > >> since you say that absent configuring CDCR things seem to run fine. > So > > > >> I'd look at the tlogs and my

Re: Suggestions for debugging performance issue

2018-06-13 Thread Susheel Kumar
t; > > >> Best, > > >> Erick > > >> > > >> > > >> On Tue, Jun 12, 2018 at 11:06 AM, Chris Troullis < > cptroul...@gmail.com> > > >> wrote: > > >> > Hi all, > > >> > > > >> > Recently w

Re: Suggestions for debugging performance issue

2018-06-13 Thread Chris Troullis
ud cluster > >> > (7.2.1). From a CDCR perspective, everything seems to be working > >> > fine...collections are staying in sync across the cluster, everything > >> looks > >> > good. > >> > > >> > The issue we are seeing is wi

Re: Suggestions for debugging performance issue

2018-06-13 Thread Erick Erickson
esults is almost >> > normal, but 200 results is way slower than normal. I can run the exact >> same >> > query multiple times in a row (so everything should be cached), and I >> still >> > see response times way higher than another environment that is not using >

Re: Suggestions for debugging performance issue

2018-06-13 Thread Chris Troullis
, and I > still > > see response times way higher than another environment that is not using > > CDCR. It doesn't seem to matter if CDCR is enabled or disabled, just that > > we are using the CDCRUpdateLog. The problem started happening even before > > we enabled CDCR.

Re: Suggestions for debugging performance issue

2018-06-12 Thread Erick Erickson
ment we noticed that the transaction logs were huge > (multiple gigs), so we tried stopping solr and deleting the tlogs then > restarting, and that seemed to fix the performance issue. We tried the same > thing in production the other day but it had no effect, so now I don't know > if i

Suggestions for debugging performance issue

2018-06-12 Thread Chris Troullis
g the CDCRUpdateLog. The problem started happening even before we enabled CDCR. In a lower environment we noticed that the transaction logs were huge (multiple gigs), so we tried stopping solr and deleting the tlogs then restarting, and that seemed to fix the performance issue. We tried the same thi

Re: Solr performance issue

2018-02-15 Thread Shawn Heisey
On 2/15/2018 2:00 AM, Srinivas Kashyap wrote: > I have implemented 'SortedMapBackedCache' in my SqlEntityProcessor for the > child entities in data-config.xml. And i'm using the same for full-import > only. And in the beginning of my implementation, i had written delta-import > query to index th

Re: Solr performance issue

2018-02-15 Thread Erick Erickson
Srinivas: Not an answer to your question, but when DIH starts getting this complicated, I start to seriously think about SolrJ, see: https://lucidworks.com/2012/02/14/indexing-with-solrj/ IN particular, it moves the heavy lifting of acquiring the data from a Solr node (which I'm assuming also has

Solr performance issue

2018-02-15 Thread Srinivas Kashyap
Hi, I have implemented 'SortedMapBackedCache' in my SqlEntityProcessor for the child entities in data-config.xml. And i'm using the same for full-import only. And in the beginning of my implementation, i had written delta-import query to index the modified changes. But my requirement grew and i

Re: Solr performance issue on querying --> Solr 6.5.1

2017-09-30 Thread sasarun
Hi Erick, As suggested, I did try nonHDFS solr cloud instance and it response looks to be really better. From the configuration side to, I am mostly using default configurations and with block.cache.direct.memory.allocation as false. On analysis of hdfs cache, evictions seems to be on higher sid

Re: Solr performance issue on querying --> Solr 6.5.1

2017-09-27 Thread Emir Arnautović
Hi Arun, It is hard to measure something without affecting it, but we could use debug results and combine with QTime without debug: If we ignore merging results, it seems that majority of time is spent for retrieving docs (~500ms). You should consider reducing number of rows if you want better r

Re: Solr performance issue on querying --> Solr 6.5.1

2017-09-27 Thread sasarun
Hi Emir, Please find the response without bq parameter and debugQuery set to true. Also it was noted that Qtime comes down drastically without the debug parameter to about 700-800. true 0 3446 ("hybrid electric powerplant" "hybrid electric powerplants" "Electric" "Electrical" "Electricity"

Re: Solr performance issue on querying --> Solr 6.5.1

2017-09-27 Thread sasarun
Hi Erick, Qtime comes down with rows set as 1. Also it was noted that qtime comes down when debug parameter is not added with the query. It comes to about 900. Thanks, Arun -- Sent from: http://lucene.472066.n3.nabble.com/Solr-User-f472068.html

Re: Solr performance issue on querying --> Solr 6.5.1

2017-09-27 Thread Toke Eskildsen
On Tue, 2017-09-26 at 07:43 -0700, sasarun wrote: > Allocated heap size for young generation is about 8 gb and old  > generation is about 24 gb. And gc analysis showed peak > size utlisation is really low compared to these values. That does not come as a surprise. Your collections would normally b

Re: Solr performance issue on querying --> Solr 6.5.1

2017-09-27 Thread Emir Arnautović
Hi Arun, This is not the most simple query either - a dozen of phrase queries on several fields + the same query as bq. Can you provide debugQuery info. I did not look much into debug times and what includes what, but one thing that is strange to me is that QTime is 4s while query in debug is 1.3

Re: Solr performance issue on querying --> Solr 6.5.1

2017-09-26 Thread Erick Erickson
Well, 15 second responses are not what I'd expect either. But two things (just looked again) 1> note that the time to assemble the debug information is a large majority of your total time (14 of 15.3 seconds). 2> you're specifying 600 rows which is quite a lot as each one requires that a 16K block

Re: Solr performance issue on querying --> Solr 6.5.1

2017-09-26 Thread sasarun
Hi Erick, Thank you for the quick response. Query time was relatively faster once it is read from memory. But personally I always felt response time could be far better. As suggested, We will try and set up in a non HDFS environment and update on the results. Thanks, Arun -- Sent from: http

Re: Solr performance issue on querying --> Solr 6.5.1

2017-09-26 Thread Erick Erickson
Does the query time _stay_ low? Once the data is read from HDFS it should pretty much stay in memory. So my question is whether, once Solr warms up you see this kind of query response time. Have you tried this on a non HDFS system? That would be useful to help figure out where to look. And given

Solr performance issue on querying --> Solr 6.5.1

2017-09-26 Thread sasarun
Hi All, I have been using Solr for some time now but mostly in standalone mode. Now my current project is using Solr 6.5.1 hosted on hadoop. My solrconfig.xml has the following configuration. In the prod environment the performance on querying seems to really slow. Can anyone help me with few poin

Re: Performance Issue in Streaming Expressions

2017-06-02 Thread Joel Bernstein
Once you've scaled up the export from collection4 you can test the performance of the join by moving the NullStream around the join. parallel(null(innerJoin(collection 3, collection4))) Again you'll want to test with different numbers of workers and replicas to see where you max out performance o

Re: Performance Issue in Streaming Expressions

2017-06-02 Thread Joel Bernstein
innerJoin(intersect(innerJoin(collection1, collection2), innerJoin(collection 3, collection4)), collection5) Let's focus on: innerJoin(collection 3, collection4)) The first thing to focus on is how fast is the export from collection4. You can test t

Re: Performance Issue in Streaming Expressions

2017-06-01 Thread Susmit Shukla
Hi, Which version of solr are you on? Increasing memory may not be useful as streaming API does not keep stuff in memory (except may be hash joins). Increasing replicas (not sharding) and pushing the join computation on worker solr cluster with #workers > 1 would definitely make things faster. Are

Performance Issue in Streaming Expressions

2017-06-01 Thread thiaga rajan
We are working on a proposal and feeling streaming API along with export handler will best fit for our usecases. We are already of having a structure in solr in which we are using graph queries to produce hierarchical structure. Now from the structure we need to join couple of more collections.

RE: Solr performance issue on indexing

2017-04-04 Thread Allison, Timothy B.
> Also we will try to decouple tika to solr. +1 -Original Message- From: tstusr [mailto:ulfrhe...@gmail.com] Sent: Friday, March 31, 2017 4:31 PM To: solr-user@lucene.apache.org Subject: Re: Solr performance issue on indexing Hi, thanks for the feedback. Yes, it is about OOM, ind

Re: Solr performance issue on indexing

2017-03-31 Thread Erick Erickson
decouple tika to > solr. > > By the way, make it available with solr cloud will improve performance? Or > there will be no perceptible improvement? > > > > > -- > View this message in context: > http://lucene.472066.n3.nabble.com/Solr-performance-issue-on-indexing-tp4327886p4327914.html > Sent from the Solr - User mailing list archive at Nabble.com.

Re: Solr performance issue on indexing

2017-03-31 Thread tstusr
ble improvement? -- View this message in context: http://lucene.472066.n3.nabble.com/Solr-performance-issue-on-indexing-tp4327886p4327914.html Sent from the Solr - User mailing list archive at Nabble.com.

Re: Solr performance issue on indexing

2017-03-31 Thread Erick Erickson
with 4gb of JVM > Memory and ~50gb of physical memory (reported through dashboard) we are > using a single instance. > > I don't think is a normal behaviour that handler crashes. So, what are some > general tips about improving performance for this scenario? > > > > --

Solr performance issue on indexing

2017-03-31 Thread tstusr
andler crashes. So, what are some general tips about improving performance for this scenario? -- View this message in context: http://lucene.472066.n3.nabble.com/Solr-performance-issue-on-indexing-tp4327886.html Sent from the Solr - User mailing list archive at Nabble.com.

Re: Heads up: SOLR-10130, Performance issue in Solr 6.4.1

2017-02-13 Thread Andrzej Białecki
> On 13 Feb 2017, at 13:46, Ere Maijala wrote: > > Hi all, > > this is just a quick heads-up that we've stumbled on serious performance > issues after upgrading to Solr 6.4.1 apparently due to the new metrics > collection causing a major slowdown. I've filed an issue > (https://issues.apache

Re: Heads up: SOLR-10130, Performance issue in Solr 6.4.1

2017-02-13 Thread Walter Underwood
I’m seeing similar problems here. With 6.4.0, we were handling 6000 requests/minute. With 6.4.1 it is 1000 rpm with median response times around 2.5 seconds. I also switched to the G1 collector. I’m going to back that out and retest today to see if the performance comes back. wunder Walter Unde

Heads up: SOLR-10130, Performance issue in Solr 6.4.1

2017-02-13 Thread Ere Maijala
Hi all, this is just a quick heads-up that we've stumbled on serious performance issues after upgrading to Solr 6.4.1 apparently due to the new metrics collection causing a major slowdown. I've filed an issue (https://issues.apache.org/jira/browse/SOLR-10130) about it, but decided to post thi

Re: Performance Issue when querying Multivalued fields [SOLR 6.1.0]

2016-09-24 Thread Alexandre Rafalovitch
http://lucene.472066.n3. nabble.com/Performance-Issue-when-querying-Multivalued-fields-SOLR-6-1-0- tp4297255p4297821.html Sent from the Solr - User mailing list archive at Nabble.com.

Re: Performance Issue when querying Multivalued fields [SOLR 6.1.0]

2016-09-23 Thread slee
n context: http://lucene.472066.n3.nabble.com/Performance-Issue-when-querying-Multivalued-fields-SOLR-6-1-0-tp4297255p4297821.html Sent from the Solr - User mailing list archive at Nabble.com.

Re: Performance Issue when querying Multivalued fields [SOLR 6.1.0]

2016-09-23 Thread Alexandre Rafalovitch
But if "SEF" and "OFF" are known to be searched for and especially if they are well-delimited, they could just be pulled-out into a separate field and just checked with an FQ. In the end, there may be no need for either EdgeNGram or wildcards. Just twisting the data during _indexing_ to represent

Re: Performance Issue when querying Multivalued fields [SOLR 6.1.0]

2016-09-22 Thread Erick Erickson
x27;s an exact match. But my use-case dictates that it > should retrieve if it's a partial match. > > So what's my best bet for analyzer in such cases ? > > > > -- > View this message in context: > http://lucene.472066.n3.nabble.com/Performance-Issue-when-querying-Multivalued-fields-SOLR-6-1-0-tp4297255p4297542.html > Sent from the Solr - User mailing list archive at Nabble.com.

Re: Performance Issue when querying Multivalued fields [SOLR 6.1.0]

2016-09-22 Thread Alexandre Rafalovitch
ard, then it's an exact match. But my use-case dictates that it > should retrieve if it's a partial match. > > So what's my best bet for analyzer in such cases ? > > > > -- > View this message in context: http://lucene.472066.n3. > nabble.com/Performance-Issue-when-querying-Multivalued-fields-SOLR-6-1-0- > tp4297255p4297542.html > Sent from the Solr - User mailing list archive at Nabble.com. >

Re: Performance Issue when querying Multivalued fields [SOLR 6.1.0]

2016-09-22 Thread slee
y contains Guid, and some financial terms (eg: Bonds, swaps, etc..). If I don't use any non-wildcard, then it's an exact match. But my use-case dictates that it should retrieve if it's a partial match. So what's my best bet for analyzer in such cases ? -- View this messag

Re: Performance Issue when querying Multivalued fields [SOLR 6.1.0]

2016-09-22 Thread Erick Erickson
t;> >> >> >> >> >> > required="true" stored="true"/> >> >> This is what I send in the query (2 values): >> q=global_Value:*mas+AND+global_Value:*sef&df=text&rows=5&version=2.2&ech

Re: Performance Issue when querying Multivalued fields [SOLR 6.1.0]

2016-09-22 Thread Alexandre Rafalovitch
mp;fl=global_Value > > In addition, memory is taking way over 90%, given the heap space set at 5g. > > > > > -- > View this message in context: > http://lucene.472066.n3.nabble.com/Performance-Issue-when-querying-Multivalued-fields-SOLR-6-1-0-tp4297255p4297474.html > Sent from the Solr - User mailing list archive at Nabble.com.

Re: Performance Issue when querying Multivalued fields [SOLR 6.1.0]

2016-09-22 Thread Erick Erickson
p;fl=global_Value > > In addition, memory is taking way over 90%, given the heap space set at 5g. > > > > > -- > View this message in context: > http://lucene.472066.n3.nabble.com/Performance-Issue-when-querying-Multivalued-fields-SOLR-6-1-0-tp4297255p4297474.html > Sent from the Solr - User mailing list archive at Nabble.com.

Re: Performance Issue when querying Multivalued fields [SOLR 6.1.0]

2016-09-22 Thread slee
ddition, memory is taking way over 90%, given the heap space set at 5g. -- View this message in context: http://lucene.472066.n3.nabble.com/Performance-Issue-when-querying-Multivalued-fields-SOLR-6-1-0-tp4297255p4297474.html Sent from the Solr - User mailing list archive at Nabble.com.

Re: Performance Issue when querying Multivalued fields [SOLR 6.1.0]

2016-09-21 Thread Alexandre Rafalovitch
ield you search against. I'm > experiencing the same issue described here: > > http://stackoverflow.com/questions/29745135/performance-issue-with- > multivalued-field-in-lucene > > This individual ended up using elasticsearch which doesn't help me. I'm > wondering

Re: Performance Issue when querying Multivalued fields [SOLR 6.1.0]

2016-09-21 Thread Stan Lee
tions/29745135/performance-issue-with-multivalued-field-in-lucene This individual ended up using elasticsearch which doesn't help me. I'm wondering if multivalue fields cannot exceed certain terms? I only have 54 to 60 terms.   Original Message   From: arafa...@gmail.com Sent: September 2

Re: Performance Issue when querying Multivalued fields [SOLR 6.1.0]

2016-09-21 Thread Alexandre Rafalovitch
ny advise would be appreciated. > Thanks. > > > > > -- > View this message in context: http://lucene.472066.n3. > nabble.com/Performance-Issue-when-querying-Multivalued- > fields-SOLR-6-1-0-tp4297255.html > Sent from the Solr - User mailing list archive at Nabble.com. >

Performance Issue when querying Multivalued fields [SOLR 6.1.0]

2016-09-21 Thread slee
Any advise would be appreciated. Thanks. -- View this message in context: http://lucene.472066.n3.nabble.com/Performance-Issue-when-querying-Multivalued-fields-SOLR-6-1-0-tp4297255.html Sent from the Solr - User mailing list archive at Nabble.com.

Re: solr performance issue

2016-02-09 Thread Zheng Lin Edwin Yeo
1 million document isn't considered big for Solr. How much RAM does your machine have? Regards, Edwin On 8 February 2016 at 23:45, Susheel Kumar wrote: > 1 million document shouldn't have any issues at all. Something else is > wrong with your hw/system configuration. > > Thanks, > Susheel > >

Re: solr performance issue

2016-02-08 Thread Susheel Kumar
1 million document shouldn't have any issues at all. Something else is wrong with your hw/system configuration. Thanks, Susheel On Mon, Feb 8, 2016 at 6:45 AM, sara hajili wrote: > On Mon, Feb 8, 2016 at 3:04 AM, sara hajili wrote: > > > sorry i made a mistake i have a bout 1000 K doc. > > i

Re: solr performance issue

2016-02-08 Thread sara hajili
On Mon, Feb 8, 2016 at 3:04 AM, sara hajili wrote: > sorry i made a mistake i have a bout 1000 K doc. > i mean about 100 doc. > > On Mon, Feb 8, 2016 at 1:35 AM, Emir Arnautovic < > emir.arnauto...@sematext.com> wrote: > >> Hi Sara, >> Not sure if I am reading this right, but I read it as you

Re: solr performance issue

2016-02-08 Thread Emir Arnautovic
Hi Sara, It is still considered to be small index. Can you give us bit details about your setup? Thanks, Emir On 08.02.2016 12:04, sara hajili wrote: sorry i made a mistake i have a bout 1000 K doc. i mean about 100 doc. On Mon, Feb 8, 2016 at 1:35 AM, Emir Arnautovic < emir.arnauto...@s

Re: solr performance issue

2016-02-08 Thread sara hajili
sorry i made a mistake i have a bout 1000 K doc. i mean about 100 doc. On Mon, Feb 8, 2016 at 1:35 AM, Emir Arnautovic < emir.arnauto...@sematext.com> wrote: > Hi Sara, > Not sure if I am reading this right, but I read it as you have 1000 doc > index and issues? Can you tell us bit more about

Re: solr performance issue

2016-02-08 Thread Emir Arnautovic
Hi Sara, Not sure if I am reading this right, but I read it as you have 1000 doc index and issues? Can you tell us bit more about your setup: number of servers, hw, index size, number of shards, queries that you run, do you index at the same time... It seems to me that you are running Solr on

solr performance issue

2016-02-08 Thread sara hajili
hi all. i have a problem with my solr performance and usage hardware like a ram,cup... i have a lot of document and so indexed file about 1000 doc in solr that every doc has about 8 field in average. and each field has about 60 char. i set my field as a storedfield = "false" except of 1 field. //

Re: Jetty Vs Tomcat (Performance issue)

2015-11-16 Thread Behzad Qureshi
Upayavira:: Just to be sure, are you installing Solr inside a different Jetty, or using the Jetty that comes with Solr? *Behzad:: *Jetty that comes with solr. Jetty-8.1.10.v20130312 Embedded Solr 4.10.3 Also used Jetty9 but not embedded. Tried solr 4.10.3 with Jetty 9 but still facing same issue.

Re: Jetty Vs Tomcat (Performance issue)

2015-11-16 Thread Timothy Potter
I hope 256MB of Xss is a typo and you really meant 256k right? On Mon, Nov 16, 2015 at 4:58 AM, Behzad Qureshi wrote: > Hi All, > > I am using Tomcat server with solr 4.10.3. I want to shift to Jetty as > replacement of Tomcat server but I am not getting any good results with > respect to perfor

Re: Jetty Vs Tomcat (Performance issue)

2015-11-16 Thread Ishan Chattopadhyaya
Also, what are the specific performance issues you are observing? On Mon, Nov 16, 2015 at 6:41 PM, Upayavira wrote: > Just to be sure, are you installing Solr inside a different Jetty, or > using the Jetty that comes with Solr? > > You would be expected to use the one installed and managed by So

Re: Jetty Vs Tomcat (Performance issue)

2015-11-16 Thread Upayavira
Just to be sure, are you installing Solr inside a different Jetty, or using the Jetty that comes with Solr? You would be expected to use the one installed and managed by Solr. Upayavira On Mon, Nov 16, 2015, at 11:58 AM, Behzad Qureshi wrote: > Hi All, > > I am using Tomcat server with solr 4.1

Jetty Vs Tomcat (Performance issue)

2015-11-16 Thread Behzad Qureshi
Hi All, I am using Tomcat server with solr 4.10.3. I want to shift to Jetty as replacement of Tomcat server but I am not getting any good results with respect to performance. I have tried solr 4.10.3 on both Jetty 8 and Jetty 9 with java 8. Below are configurations I have used. Can anyone please

RE: Performance issue with FILTER QUERY

2015-08-20 Thread Maulin Rathod
[mailto:erickerick...@gmail.com] Sent: 20 August 2015 00:44 To: solr-user@lucene.apache.org Subject: Re: Performance issue with FILTER QUERY If you're committing that rapidly then you're correct, filter caching may not be a good fit. The entire _point_ of filter caching is to increase perfo

Re: Performance issue with FILTER QUERY

2015-08-19 Thread Erick Erickson
fectively >> uses cache and hence it slow every time in our case. >> >> -Original Message- >> From: Toke Eskildsen [mailto:t...@statsbiblioteket.dk] >> Sent: 19 August 2015 12:16 >> To: solr-user@lucene.apache.org >> Subject: Re: Performance issue with FILTER Q

  1   2   3   >