Re: Solr wiki page update

2021-03-02 Thread Jan Høydahl
Vincent, I added you as editor, please try editing that page again. Jan > 11. feb. 2021 kl. 17:43 skrev Vincent Brehin : > > Hi community members, > I work for Adelean https://www.adelean.com/ , we are offering services > around everything Search related, and especially Solr consulting and > s

Re: Solr Cloud Autoscaling Basics

2021-02-24 Thread yasoobhaider
Any pointers here would be appreciated :) -- Sent from: https://lucene.472066.n3.nabble.com/Solr-User-f472068.html

Re: Solr 8.0 query length limit

2021-02-18 Thread Anuj Bhargava
Thanks Alex and Shawn. Regards, Anuj On Thu, 18 Feb 2021 at 18:57, Shawn Heisey wrote: > On 2/18/2021 3:38 AM, Anuj Bhargava wrote: > > Solr 8.0 query length limit > > > > We are having an issue where queries are too big, we get no result. And > if > > we remove a few keywords we get the resul

Re: Solr 8.0 query length limit

2021-02-18 Thread Shawn Heisey
On 2/18/2021 3:38 AM, Anuj Bhargava wrote: Solr 8.0 query length limit We are having an issue where queries are too big, we get no result. And if we remove a few keywords we get the result. The best option is to convert the request to POST, as Thomas suggested. With that, the query parameter

Re: Solr 8.0 query length limit

2021-02-18 Thread Alexandre Rafalovitch
Also, investigate if you have repeating conditions and push those into defaults in custom request handler endpoints (in solrconfig.xml). Also, Solr supports parameter substitutions, if you have repeated subconditions. Regards, Alex On Thu., Feb. 18, 2021, 7:08 a.m. Thomas Corthals, wrote:

Re: Solr 8.0 query length limit

2021-02-18 Thread Thomas Corthals
You can send big queries as a POST request instead of a GET request. Op do 18 feb. 2021 om 11:38 schreef Anuj Bhargava : > Solr 8.0 query length limit > > We are having an issue where queries are too big, we get no result. And if > we remove a few keywords we get the result. > > Error we get - er

Re: SOLR upgrade

2021-02-12 Thread David Hastings
i generally will only upgrade every other release. since i started with 1.4, went to 3->5->7.X, and never EVER a .0 or an even .X release, On Fri, Feb 12, 2021 at 12:01 PM Ishan Chattopadhyaya < ichattopadhy...@gmail.com> wrote: > Just avoid 8.8.0 for the moment, until 8.8.1 is released. 8.7.x s

Re: SOLR upgrade

2021-02-12 Thread Ishan Chattopadhyaya
Just avoid 8.8.0 for the moment, until 8.8.1 is released. 8.7.x should be fine. On Fri, Feb 12, 2021 at 10:28 PM Alessandro Benedetti wrote: > Hi, > following up on Charlie's detailed response I would recommend carefully > assess the code you are using to interact with Apache Solr (on top of the

Re: SOLR upgrade

2021-02-12 Thread Alessandro Benedetti
Hi, following up on Charlie's detailed response I would recommend carefully assess the code you are using to interact with Apache Solr (on top of the Solr changes themselves). Assuming you are using some sort of client, it's extremely important to fully understand both the syntax and semantic of ea

Re: SOLR upgrade

2021-02-09 Thread Charlie Hull
Hi Lulu, I'm afraid you're going to have to recognise that Solr 5.2.1 is very out-of-date and the changes between this version and the current 8.x releases are significant. A direct jump is I think the only sensible option. Although you could take the current configuration and attempt to upg

Re: Solr Slack Workspace

2021-02-06 Thread Ishan Chattopadhyaya
t; > > > join and start using. > > > > > > > > On Tue, Jan 26, 2021 at 5:38 AM Ishan Chattopadhyaya < > > > > ichattopadhy...@gmail.com> wrote: > > > > > > > > > Thanks ufuk. I'll take a look. > > > >

Re: Solr Slack Workspace

2021-02-05 Thread Anshum Gupta
gt; > On Tue, Jan 26, 2021 at 5:38 AM Ishan Chattopadhyaya < > > > ichattopadhy...@gmail.com> wrote: > > > > > > > Thanks ufuk. I'll take a look. > > > > > > > > On Tue, 26 Jan, 2021, 4:05 pm ufuk yılmaz, > > > >

Re: Solr Slack Workspace

2021-02-05 Thread Justin Sweeney
6, 2021 at 5:38 AM Ishan Chattopadhyaya < > > > ichattopadhy...@gmail.com> wrote: > > > > > > > Thanks ufuk. I'll take a look. > > > > > > > > On Tue, 26 Jan, 2021, 4:05 pm ufuk yılmaz, > > > > > > > wrote: > > >

Re: Solr Cloud freezes during scheduled backup

2021-02-02 Thread Jason Gerlowski
Hi Pawel, This definitely sounds like garbage collection biting you. Backups themselves aren't usually memory intensive, but if indexing is going on at the same time you should expect elevated memory usage. Essentially this is because for each core being backed up, Solr needs to hold pieces of tw

Re: Solr Slack Workspace

2021-02-02 Thread Ishan Chattopadhyaya
attopadhy...@gmail.com> wrote: > > > > > Thanks ufuk. I'll take a look. > > > > > > On Tue, 26 Jan, 2021, 4:05 pm ufuk yılmaz, > > > > wrote: > > > > > > > It’s asking for a searchscale.com email address? > >

Re: Solr 8.7.0 memory leak?

2021-01-29 Thread Chris Hostetter
: there are not many OOM stack details printed in the solr log file, it's : just saying No enough memory, and it's killed by oom.sh(solr's script). not many isn't the same as none ... can you tell us *ANYTHING* about what the logs look like? ... as i said: it's not just the details of the O

Re: Solr 8.7.0 memory leak?

2021-01-28 Thread Luke
Thanks Hoss and Shawn for helping. there are not many OOM stack details printed in the solr log file, it's just saying No enough memory, and it's killed by oom.sh(solr's script). My question(issue) is not it's OOM or not, the issue is why JVM memory usage keeps growing up but never going down

Re: Solr 8.7.0 memory leak?

2021-01-28 Thread Chris Hostetter
: Is the matter to use the config file ? I am using custom config instead : of _default, my config is from solr 8.6.2 with custom solrconfig.xml Well, it depends on what's *IN* the custom config ... maybe you are using some built in functionality that has a bug but didn't get triggered by my

Re: Solr 8.7.0 memory leak?

2021-01-28 Thread Shawn Heisey
On 1/27/2021 9:00 PM, Luke wrote: it's killed by OOME exception. The problem is that I just created empty collections and the Solr JVM keeps growing and never goes down. there is no data at all. at the beginning, I set Xxm=6G, then 10G, now 15G, Solr 8.7 always use all of them and it will be kill

Re: Solr 8.7.0 memory leak?

2021-01-28 Thread Luke Oak
Thanks Chris, Is the matter to use the config file ? I am using custom config instead of _default, my config is from solr 8.6.2 with custom solrconfig.xml Derrick Sent from my iPhone > On Jan 28, 2021, at 2:48 PM, Chris Hostetter wrote: > >  > FWIW, I just tried using 8.7.0 to run: >b

Re: Solr 8.7.0 memory leak?

2021-01-28 Thread Chris Hostetter
FWIW, I just tried using 8.7.0 to run: bin/solr -m 200m -e cloud -noprompt And then setup the following bash one liner to poll the heap metrics... while : ; do date; echo "node 8989" && (curl -sS http://localhost:8983/solr/admin/metrics | grep memory.heap); echo "node 7574" && (curl -

Re: Solr 8.7.0 memory leak?

2021-01-28 Thread Chris Hostetter
: Hi, I am using solr 8.7.0, centos 7, java 8. : : I just created a few collections and no data, memory keeps growing but : never go down, until I got OOM and solr is killed Are you usinga custom config set, or just the _default configs? if you start up this single node with something like -X

Re: Solr 8.7.0 memory leak?

2021-01-28 Thread Luke
and here is GC log when I create collection(just create collection, nothing else) {Heap before GC invocations=1530 (full 412): garbage-first heap total 10485760K, used 10483431K [0x00054000, 0x000540405000, 0x0007c000) region size 4096K, 0 young (0K), 0 survivors (0K) Met

Re: Solr 8.7.0 memory leak?

2021-01-28 Thread Luke
Mike, No, it's not docker. it is just one solr node(service) which connects to external zookeeper, the below is a JVM setting and memory usage. There are 25 collections which have a few 2000 documents totally. I am wondering why solr uses so much memory. -XX:+AlwaysPreTouch-XX:+ExplicitGCInvoke

Re: Solr 8.7.0 memory leak?

2021-01-27 Thread Mike Drob
Are you running these in docker containers? Also, I’m assuming this is a typo but just in case the setting is Xmx :) Can you share the OOM stack trace? It’s not always running out of memory, sometimes Java throws OOM for file handles or threads. Mike On Wed, Jan 27, 2021 at 10:00 PM Luke wrote

Re: Solr 8.7.0 memory leak?

2021-01-27 Thread Luke
Shawn, it's killed by OOME exception. The problem is that I just created empty collections and the Solr JVM keeps growing and never goes down. there is no data at all. at the beginning, I set Xxm=6G, then 10G, now 15G, Solr 8.7 always use all of them and it will be killed by oom.sh once jvm usage

Re: Solr 8.7.0 memory leak?

2021-01-27 Thread Shawn Heisey
On 1/27/2021 5:08 PM, Luke Oak wrote: I just created a few collections and no data, memory keeps growing but never go down, until I got OOM and solr is killed Any reason? Was Solr killed by the operating system's oom killer or did the death start with a Java OutOfMemoryError exception? If

Re: Solr Slack Workspace

2021-01-27 Thread Justin Sweeney
. > > > > On Tue, 26 Jan, 2021, 4:05 pm ufuk yılmaz, > > wrote: > > > > > It’s asking for a searchscale.com email address? > > > > > > Sent from Mail for Windows 10 > > > > > > From: Ishan Chattopadhyaya > > > Sent: 26 J

Re: Solr Slack Workspace

2021-01-26 Thread Houston Putman
ue, 26 Jan, 2021, 4:05 pm ufuk yılmaz, > wrote: > > > It’s asking for a searchscale.com email address? > > > > Sent from Mail for Windows 10 > > > > From: Ishan Chattopadhyaya > > Sent: 26 January 2021 13:33 > > To: solr-user > > Subject: Re: Solr

Re: Solr Slack Workspace

2021-01-26 Thread Ishan Chattopadhyaya
Thanks ufuk. I'll take a look. On Tue, 26 Jan, 2021, 4:05 pm ufuk yılmaz, wrote: > It’s asking for a searchscale.com email address? > > Sent from Mail for Windows 10 > > From: Ishan Chattopadhyaya > Sent: 26 January 2021 13:33 > To: solr-user > Subject: Re: Solr S

Re: Solr Slack Workspace

2021-01-26 Thread Ishan Chattopadhyaya
We should update the official documentation for community page to include this Slack org. If someone would like to volunteer to submit a patch against lucene-site repo, would be great. On Tue, 26 Jan, 2021, 4:02 pm Ishan Chattopadhyaya, < ichattopadhy...@gmail.com> wrote: > There is a Slack backe

RE: Solr Slack Workspace

2021-01-26 Thread ufuk yılmaz
It’s asking for a searchscale.com email address? Sent from Mail for Windows 10 From: Ishan Chattopadhyaya Sent: 26 January 2021 13:33 To: solr-user Subject: Re: Solr Slack Workspace There is a Slack backed by official IRC support. Please see https://lucene.472066.n3.nabble.com/Solr-Users-Slack

Re: Solr Slack Workspace

2021-01-26 Thread Ishan Chattopadhyaya
There is a Slack backed by official IRC support. Please see https://lucene.472066.n3.nabble.com/Solr-Users-Slack-td4466856.html for details on how to join it. On Tue, 19 Jan, 2021, 2:54 pm Charlie Hull, wrote: > Relevance Slack is open to anyone working on search & relevance - #solr is > only on

Re: SOLR 8.6 Synonyms search and out of context results

2021-01-22 Thread Colvin Cowie
Hello, Do you mean that you want searches for "gain" to match documents with "revenue" on them, but do *not* want searches for "revenue" to match documents with "gain" on them? If that's what you mean, how have you defined your synonyms? If you're using the SynonymGraphFilterFactory https://lucen

Re: Solr Slack Workspace

2021-01-19 Thread Charlie Hull
Relevance Slack is open to anyone working on search & relevance - #solr is only one of the channels, there's lots more! Hope to see you there. Cheers Charlie https://opensourceconnections.com/slack On 16/01/2021 02:18, matthew sporleder wrote: IRC has kind of died off, https://lucene.apache.

Re: Solr Slack Workspace

2021-01-15 Thread matthew sporleder
IRC has kind of died off, https://lucene.apache.org/solr/community.html has a slack mentioned, I'm on https://opensourceconnections.com/slack after taking their solr training class and assume it's mostly open to solr community. On Fri, Jan 15, 2021 at 8:10 PM Justin Sweeney wrote: > > Hi all, > >

Re: Solr using all available CPU and becoming unresponsive

2021-01-12 Thread Charlie Hull
__ From: Michael Gibney Sent: Monday, January 11, 2021 8:30 PM To: solr-user@lucene.apache.org Subject: Re: Solr using all available CPU and becoming unresponsive Hi Jeremy, Can you share your analysis chain configs? (SOLR-13336 can manifest in a similar way, and w

Re: Solr using all available CPU and becoming unresponsive

2021-01-12 Thread Michael Gibney
nd SynonymGraphFilterFactory from the query section > (and maybe the StopFilterFactory from the index section as well)? > > Thanks again, > Jeremy > > > From: Michael Gibney > Sent: Monday, January 11, 2021 8:30 PM > To: solr-user@lucene.apache.o

Re: Solr using all available CPU and becoming unresponsive

2021-01-12 Thread Jeremy Smith
e query section (and maybe the StopFilterFactory from the index section as well)? Thanks again, Jeremy From: Michael Gibney Sent: Monday, January 11, 2021 8:30 PM To: solr-user@lucene.apache.org Subject: Re: Solr using all available CPU and becoming unresponsive

Re: Solr using all available CPU and becoming unresponsive

2021-01-11 Thread Michael Gibney
Hi Jeremy, Can you share your analysis chain configs? (SOLR-13336 can manifest in a similar way, and would affect 7.3.1 with a susceptible config, given the right (wrong?) input ...) Michael On Mon, Jan 11, 2021 at 5:27 PM Jeremy Smith wrote: > Hello all, > We have been struggling with an i

Re: Solr query with space (only) gives error

2021-01-09 Thread vstuart
Cross-posted / addressed (both me), here. https://stackoverflow.com/questions/65620642/solr-query-with-space-only-q-20-stalls/65638561#65638561 -- Sent from: https://lucene.472066.n3.nabble.com/Solr-User-f472068.html

Re: Solr query with space (only) gives error

2021-01-09 Thread vstuart
Cross-posted / addressed (both me), here. https://stackoverflow.com/questions/65620642/solr-query-with-space-only-q-20-stalls/65638561#65638561 -- Sent from: https://lucene.472066.n3.nabble.com/Solr-User-f472068.html

Re: Solr background merge in case of pull replicas

2021-01-07 Thread Abhishek Mishra
Hi Kshitij What I can guess over here. Pull replicas replicate segments from tlog, so whenever merge happens on tlog it will decrease the number of segments which is more than ideal case(i.e. adding a new segment). Afaik adding/deleting the segment is kind of a stop the world moment. This can be t

Re: Solr background merge in case of pull replicas

2021-01-06 Thread kshitij tyagi
Hi, I am not querying on tlog replicas, solr version is 8.6 and 2 tlogs and 4 pull replica setup. why should pull replicas be affected during background segment merges? Regards, kshitij On Wed, Jan 6, 2021 at 9:48 PM Ritvik Sharma wrote: > Hi > It may be the cause of rebalancing and querying

Re: Solr background merge in case of pull replicas

2021-01-06 Thread Ritvik Sharma
Hi It may be the cause of rebalancing and querying is not available not on tlog at that moment. You can check tlog logs and pull log when u are facing this issue. May i know which version of solr you are using? and what is the ration of tlog and pull nodes. On Wed, 6 Jan 2021 at 2:46 PM, kshitij

Re: Solr cloud facet query returning incorrect results

2020-12-21 Thread Erick Erickson
This should work as you expect, so the first thing I’d do is add &debug=query and see the parsed query in both cases. If that doesn’t show anything, please post the full debug response in both cases. Best, Erick > On Dec 21, 2020, at 4:31 AM, Alok Bhandari wrote: > > Hello All , > > we are

Re: Solr Collection Reload

2020-12-16 Thread Moulay Hicham
Thanks Erick - The logs did NOT provide any errors. Thanks for the thread dump suggestion. The issue was resolved when we restarted all the nodes. Also, I am wondering if restarting the leaders would have been sufficient. I will try this next time this happens. On Tue, Dec 15, 2020 at 5:21 AM

Re: Solr Collection Reload

2020-12-15 Thread Erick Erickson
Well, there’s no information here to help. The first thing I’d check is what the Solr logs are saying. Especially if you’ve changed any of your configuration files. If that doesn’t show anything, I'd take a thread dump and look at that, perhaps there’s some deadlock. But that said, a reload sho

Re: [SOLR-8.5.2] Commit through curl command is causing delay in issuing commit

2020-12-15 Thread raj.yadav
Hi All, For further investigation, I have raised a JIRA ticket. https://issues.apache.org/jira/browse/SOLR-15045 In case, anyone has any information to share, feel free to mention it here. Regards, Raj -- Sent from: https://lucene.472066.n3.nabble.com/Solr-User-f472068.html

Re: [SOLR-8.5.2] Commit through curl command is causing delay in issuing commit

2020-12-14 Thread raj.yadav
Hi All, As I mentioned in my previous post that reloading/refreshing of the external file is consuming most of the time during a commit operation. In order to nullify the impact of external files, I had deleted external files from all the shards and issued commit through the curl command. Commit

Re: [SOLR-8.5.2] Commit through curl command is causing delay in issuing commit

2020-12-12 Thread raj.yadav
Hi All, Till we investigate further about this issue. Can anyone please share what other ways we can issue a commit or point me to existing documents that have a relevant example. Regards, Raj -- Sent from: https://lucene.472066.n3.nabble.com/Solr-User-f472068.html

Re: Solr Collection reload task has been in running state for a very long time

2020-12-11 Thread Moulay Hicham
Hi, I will really appreciate if someone can help me with this. Thank you, Moulay On Thu, Dec 10, 2020, 8:28 AM Moulay Hicham wrote: > Hi, > > We have a solr cluster of 30 nodes with a Replication Factor =3. > Each index size is about 80GB. > Solr version is 8.1 > The cluster has high TPS both

Re: Solr cloud issuse: Async exception during distributed update

2020-12-10 Thread Colvin Cowie
Hi, sounds like https://issues.apache.org/jira/browse/SOLR-13963 which was fixed in Solr 8.3.1 On Thu, 10 Dec 2020 at 06:20, Ritvik Sharma wrote: > Hi Houston, > Thanks for reply > > We dont have this kind of field. It's a field value and it is coming > randomly, not all the time. > We are index

Re: Solr cloud issuse: Async exception during distributed update

2020-12-09 Thread Ritvik Sharma
Hi Houston, Thanks for reply We dont have this kind of field. It's a field value and it is coming randomly, not all the time. We are indexing using cloudsolrclient + spring data . It is coming on any value, I am trying to do indexing of ~30 million records. And it is coming on Solr cloud mode n

Re: Solr cloud issuse: Async exception during distributed update

2020-12-09 Thread Houston Putman
Do you have a field named "314257s_seourls" in your schema? Is there a dynamic field you are trying to match with that name? - Houston On Thu, Dec 10, 2020 at 2:53 PM ritvik wrote: > Hi , > Please suggest, why it is happening. > > > > -- > Sent from: https://lucene.472066.n3.nabble.com/Solr-U

Re: Solr cloud issuse: Async exception during distributed update

2020-12-09 Thread ritvik
Hi , Please suggest, why it is happening. -- Sent from: https://lucene.472066.n3.nabble.com/Solr-User-f472068.html

Re: Solr cloud issuse: Async exception during distributed update

2020-12-09 Thread Ritvik Sharma
Hi Furkan I have added the mail. Please check. On Wed, 9 Dec 2020 at 12:52, Furkan KAMACI wrote: > Hi Ritwik, > > Could you send your e-mail to solr user list? > > Kind Regards, > Furkan KAMACI > > On 9 Dec 2020 Wed at 10:18 Ritvik Sharma wrote: > >> >> Hi Solr Owner , >> >> Please check th

Re: Solr collapse & expand queries.

2020-11-30 Thread Joel Bernstein
Both collapse and grouping are used quite often so I'm not sure I would agree with the preference for collapse. There is a very specific use case where collapse performs better and in these scenarios collapse might be the only option that would work. The use case where collapse works better is: 1

Re: Solr Highlighting not working

2020-11-30 Thread Ajay Sharma
Hi All, pushing the query to the top. Does anyone have any idea about it? On Fri, Nov 27, 2020 at 11:49 AM Ajay Sharma wrote: > Hi Community, > > This is the first time, I am implementing a solr *highlighting *feature. > I have read the concept via solr documentation > Link- https://lucene.apa

Re: Solr 8.4.1, NOT NULL query not working on plong & pint type fields (fieldname:* )

2020-11-26 Thread Deepu
Hi Shawn, Thanks for taking time and replay. Thanks, Deepu On Thu, Nov 26, 2020 at 10:53 PM Shawn Heisey wrote: > On 11/25/2020 10:42 AM, Deepu wrote: > > We are in the process of migrating from Solr 5 to Solr 8, during testing > > identified that "Not null" queries on plong & pint field types

Re: Solr 8.4.1, NOT NULL query not working on plong & pint type fields (fieldname:* )

2020-11-26 Thread Shawn Heisey
On 11/25/2020 10:42 AM, Deepu wrote: We are in the process of migrating from Solr 5 to Solr 8, during testing identified that "Not null" queries on plong & pint field types are not giving any results, it is working fine with solr 5.4 version. could you please let me know if you have suggestions

Re: solr 8.6.3 and noggit

2020-11-20 Thread Susmit Shukla
Thanks Mike That explains it, just removing the noggit-0.6 jar should fix it. This error depended on classloading order and didn't show up on mac but was a problem on linux. On Fri, Nov 20, 2020 at 2:54 PM Mike Drob wrote: > Noggit code was forked into Solr, see SOLR-13427 > > https://github.c

Re: solr 8.6.3 and noggit

2020-11-20 Thread Mike Drob
Noggit code was forked into Solr, see SOLR-13427 https://github.com/apache/lucene-solr/blob/releases/lucene-solr/8.6.3/solr/solrj/src/java/org/noggit/ObjectBuilder.java It looks like that particular method was added in 8.4 via https://issues.apache.org/jira/browse/SOLR-13824 Is it possible you're

Re: SOLR 8.6.0 date Indexing Issues.

2020-11-20 Thread Jörn Franke
Your should format the date according to the ISO Standard: https://lucene.apache.org/solr/guide/6_6/working-with-dates.html Eg. 2018-07-12T00:00:00Z You can either transform the date that you have in Solr or in your client pushing the doc to Solr. All major programming language have date util

Re: Solr migration related issues.

2020-11-05 Thread Modassar Ather
Thanks Erick. I am going through the recommendations given in this email chain. Best, Modassar On Thu, Nov 5, 2020 at 7:17 PM Erick Erickson wrote: > Oh dear. > > You made me look at the reference guide. Ouch. > > We have this nice page “Defining core.properties” that talks about > defining co

Re: Solr 8.1.1 installation in Azure App service

2020-11-05 Thread Erick Erickson
I _strongly_ recommend you use the collections API CREATE command rather than try what you’re describing. You’re trying to mix manually creating core.properties files, which was the process for stand-alone Solr, with SolrCloud and hoping that it somehow gets propagated to Zookeeper. This has some

Re: Solr migration related issues.

2020-11-05 Thread Erick Erickson
Oh dear. You made me look at the reference guide. Ouch. We have this nice page “Defining core.properties” that talks about defining core.properties. Unfortunately it has _no_ warning about the fact that trying to use this in SolrCloud is a really bad idea. As in “don’t do it”. To make matters

Re: Solr migration related issues.

2020-11-05 Thread Modassar Ather
Hi Shawn, I understand that we do not need to modify the core.properties and use the APIs to create core and collection and that is what I am doing now. This question of naming the core as per the choice comes from our older setup where we have 12 shards, a collection and core both named the same

Re: Solr 8.1.1 installation in Azure App service

2020-11-04 Thread Shawn Heisey
On 11/3/2020 11:49 PM, Narayanan, Bhagyasree wrote: Steps we followed for creating Solr App service: 1. Created a blank sitecore 9.3 solution from Azure market place and created a Web app for Solr. 2. Unzipped the Solr 8.1.1 package and copied all the contents to wwwroot folder of the

Re: Solr migration related issues.

2020-11-04 Thread Shawn Heisey
On 11/4/2020 9:32 PM, Modassar Ather wrote: Another thing: how can I control the core naming? I want the core name to be *mycore* instead of *mycore**_shard1_replica_n1*/*mycore* *_shard2_replica_n2*. I tried setting it using property.name=*mycore* but it did not work. What can I do to achieve th

Re: Solr migration related issues.

2020-11-04 Thread Modassar Ather
Hi Erick, I have put solr configs in Zookeeper. I have created a collection using the following API. admin/collections?action=CREATE&name=mycore&numShards=2&replicationFactor=1&collection.configName=mycore& property.name=mycore The collection got created and I can see *mycore**_shard1_replica_n1*

Re: Solr migration related issues.

2020-11-04 Thread Erick Erickson
inline > On Nov 4, 2020, at 2:17 AM, Modassar Ather wrote: > > Thanks Erick and Ilan. > > I am using APIs to create core and collection and have removed all the > entries from core.properties. Currently I am facing init failure and > debugging it. > Will write back if I am facing any issues. >

Re: Solr migration related issues.

2020-11-03 Thread Modassar Ather
Thanks Erick and Ilan. I am using APIs to create core and collection and have removed all the entries from core.properties. Currently I am facing init failure and debugging it. Will write back if I am facing any issues. Best, Modassar On Wed, Nov 4, 2020 at 3:20 AM Erick Erickson wrote: > Do n

Re: Solr migration related issues.

2020-11-03 Thread Erick Erickson
Do note, though, that the default value for legacyCloud changed from true to false so even though you can get it to work by setting this cluster prop I wouldn’t… The change in the default value is why it’s failing for you. > On Nov 3, 2020, at 11:20 AM, Ilan Ginzburg wrote: > > I second Erick'

Re: Solr tag cloud - words and counts

2020-11-03 Thread Walter Underwood
For a tag cloud, the anomalous words are what you want. If you choose the most common words, then every tag cloud will have the same words. It will look like: the, be, to, it, of, and, a, in, that, have, I, it, for, not, on, with, ... wunder Walter Underwood wun...@wunderwood.org http://observer

Re: Solr migration related issues.

2020-11-03 Thread Ilan Ginzburg
I second Erick's recommendation, but just for the record legacyCloud was removed in (upcoming) Solr 9 and is still available in Solr 8.x. Most likely this explains Modassar why you found it in the documentation. Ilan On Tue, Nov 3, 2020 at 5:11 PM Erick Erickson wrote: > You absolutely need co

Re: Solr migration related issues.

2020-11-03 Thread Erick Erickson
You absolutely need core.properties files. It’s just that they should be considered an “implementation detail” that you should rarely, if ever need to be aware of. Scripting manual creation of core.properties files in order to define your collections has never been officially supported, it just ha

Re: Solr migration related issues.

2020-11-03 Thread Modassar Ather
Thanks Erick for your response. I will certainly use the APIs and not rely on the core.properties. I was going through the documentation on core.properties and found it to be still there. I have all the solr install scripts based on older Solr versions and wanted to re-use the same as the core.pro

Re: Solr migration related issues.

2020-11-03 Thread Erick Erickson
You’re relying on legacyMode, which is no longer supported. In older versions of Solr, if a core.properties file was found on disk Solr attempted to create the replica (and collection) on the fly. This is no longer true. Why are you doing it this manually instead of using the collections API? You

Re: SOLR uses too much CPU and GC is also weird on Windows server

2020-11-02 Thread Erick Erickson
>> but I dont like the CPU usage even over night, when nobody uses it. We will >> try to figure out the issue here and I hope I can ask more questions when in >> doubt or out of ideas. Also I must admit, solr is really new for me >> personally. >> >> Jaan &g

RE: SOLR uses too much CPU and GC is also weird on Windows server

2020-11-02 Thread Jaan Arjasepp
observe this and try to improve our code as well. Best regards, Jaan -Original Message- From: Erick Erickson Sent: 28 October 2020 17:18 To: solr-user@lucene.apache.org Subject: Re: SOLR uses too much CPU and GC is also weird on Windows server DocValues=true are usually only used for

Re: Solr dependency update at Apache Beam - which versions should be supported

2020-10-30 Thread Piotr Szuberski
Well, it would require to maintain tests for all of the versions Beam wants to support. For all the time Beam had SolrJ 5.5.4 as compile dependency so it's not likely a needed feature. On Fri, Oct 30, 2020 at 1:30 PM matthew sporleder wrote: > Is there a reason you can't use a bunch of solr vers

Re: Solr dependency update at Apache Beam - which versions should be supported

2020-10-30 Thread matthew sporleder
Is there a reason you can't use a bunch of solr versions and let beam users choose at runtime? > On Oct 30, 2020, at 4:58 AM, Piotr Szuberski > wrote: > > Thank you very much for your answer! > > Beam has a compile time dependency on Solr so the user doesn't have to > provide his own. The pr

Re: Solr dependency update at Apache Beam - which versions should be supported

2020-10-30 Thread Piotr Szuberski
Thank you very much for your answer! Beam has a compile time dependency on Solr so the user doesn't have to provide his own. The problem would happen when a user wants to use both Solr X version and Beam SolrIO in the same project. As I understood it'd be the best choice to use the 8.x.y version

Re: Solr LockObtainFailedException and NPEs for CoreAdmin STATUS

2020-10-29 Thread ahubold
I've created a JIRA ticket now: https://issues.apache.org/jira/browse/SOLR-14969 I'd be really glad, if a Solr developer could help or comment on the issue. Thank you, Andreas -- Sent from: https://lucene.472066.n3.nabble.com/Solr-User-f472068.html

Re: Solr with HDFS configuration example running in production/dev

2020-10-29 Thread Gézapeti
Cloudera's default configuration for the HDFSDirectoryFactory is very similar to yours in solrconfig.xml. The solr.hdfs.home property is provided as a java property during Solr startup and we haven't seen the ":"

Re: Solr LockObtainFailedException and NPEs for CoreAdmin STATUS

2020-10-28 Thread ahubold
Hi, after reading some Solr source code, I might have found the cause: There was indeed a change in Solr 8.6 that leads to the NullPointerException for the CoreAdmin STATUS request in CoreAdminOperation#getCoreStatus. The instancePath is not retrieved from the ResourceLoader anymore, but from the

Re: SOLR uses too much CPU and GC is also weird on Windows server

2020-10-28 Thread Erick Erickson
in > doubt or out of ideas. Also I must admit, solr is really new for me > personally. > > Jaan > > -Original Message----- > From: Walter Underwood > Sent: 27 October 2020 18:44 > To: solr-user@lucene.apache.org > Subject: Re: SOLR uses too much CPU and GC is also weir

Re: SOLR uses too much CPU and GC is also weird on Windows server

2020-10-28 Thread Walter Underwood
ubt or out of ideas. Also I must admit, solr is really new for me > personally. > > Jaan > > -Original Message----- > From: Walter Underwood > Sent: 27 October 2020 18:44 > To: solr-user@lucene.apache.org > Subject: Re: SOLR uses too much CPU and GC is also weird on Wind

RE: SOLR uses too much CPU and GC is also weird on Windows server

2020-10-28 Thread Jaan Arjasepp
personally. Jaan -Original Message- From: Walter Underwood Sent: 27 October 2020 18:44 To: solr-user@lucene.apache.org Subject: Re: SOLR uses too much CPU and GC is also weird on Windows server That first graph shows a JVM that does not have enough heap for the program it is running. Look

Re: Solr dependency update at Apache Beam - which versions should be supported

2020-10-27 Thread Mike Drob
Piotr, Based on the questions that we've seen over the past month on this list, there are still users with Solr on 6, 7, and 8. I suspect there are still Solr 5 users out there too, although they don't appear to be asking for help - likely they are in set it and forget it mode. Solr 7 may not be

Re: SOLR uses too much CPU and GC is also weird on Windows server

2020-10-27 Thread Walter Underwood
That first graph shows a JVM that does not have enough heap for the program it is running. Look at the bottom of the dips. That is the amount of memory still in use after a full GC. You want those dips to drop to about half of the available heap, so I’d immediately increase that heap to 4G. That

Re: SOLR uses too much CPU and GC is also weird on Windows server

2020-10-27 Thread Emir Arnautović
change about requestParser was not it. > > > -Original Message- > From: Erick Erickson <mailto:erickerick...@gmail.com>> > Sent: 27 October 2020 15:03 > To: solr-user@lucene.apache.org <mailto:solr-user@lucene.apache.org> > Subject: Re: SOLR uses too much CPU and GC

RE: SOLR uses too much CPU and GC is also weird on Windows server

2020-10-27 Thread Jaan Arjasepp
15:03 To: solr-user@lucene.apache.org Subject: Re: SOLR uses too much CPU and GC is also weird on Windows server Jean: The basic search uses an “inverted index”, which is basically a list of terms and the documents they appear in, e.g. my - 1, 4, 9, 12 dog - 4, 8, 10 So the word “my” appears in

Re: SOLR uses too much CPU and GC is also weird on Windows server

2020-10-27 Thread Erick Erickson
Jean: The basic search uses an “inverted index”, which is basically a list of terms and the documents they appear in, e.g. my - 1, 4, 9, 12 dog - 4, 8, 10 So the word “my” appears in docs 1, 4, 9 and 12, and “dog” appears in 4, 8, 10. Makes it easy to search for my AND dog for instance, obviou

RE: SOLR uses too much CPU and GC is also weird on Windows server

2020-10-27 Thread Jaan Arjasepp
@lucene.apache.org Subject: RE: SOLR uses too much CPU and GC is also weird on Windows server Hi Emir, I checked the solrconfig.xml file and we dont even use fieldValueCache. Also are you saying, I should check the schema and all the fields in the old solr and the new one to see if they match or contain

RE: SOLR uses too much CPU and GC is also weird on Windows server

2020-10-27 Thread Jaan Arjasepp
Sent: 27 October 2020 10:42 To: solr-user@lucene.apache.org Subject: Re: SOLR uses too much CPU and GC is also weird on Windows server Hi Jaan, It can be several things: caches fieldCache/fieldValueCache - it can be that you you are missing doc values on some fields that are used for facet

Re: SOLR uses too much CPU and GC is also weird on Windows server

2020-10-27 Thread Emir Arnautović
Hi Jaan, It can be several things: caches fieldCache/fieldValueCache - it can be that you you are missing doc values on some fields that are used for faceting/sorting/functions and that uninverted field structures are eating your memory. filterCache - you’ve changed setting for filter caches and

Re: solr performance with >1 NUMAs

2020-10-22 Thread matthew sporleder
Great updates. Thanks for keeping us all in the loop! On Thu, Oct 22, 2020 at 7:43 PM Wei wrote: > > Hi Shawn, > > I.m circling back with some new findings with our 2 NUMA issue. After a > few iterations, we do see improvement with the useNUMA flag and other JVM > setting changes. Here are the

Re: solr performance with >1 NUMAs

2020-10-22 Thread Wei
Hi Shawn, I.m circling back with some new findings with our 2 NUMA issue. After a few iterations, we do see improvement with the useNUMA flag and other JVM setting changes. Here are the current settings, with Java 11: -XX:+UseNUMA -XX:+UseG1GC -XX:+AlwaysPreTouch -XX:+UseTLAB -XX:G1MaxNewSiz

  1   2   3   4   5   6   7   8   9   10   >