Can I create 1000 cores in SOLR CLOUD

2020-01-27 Thread Vignan Malyala
Hi all, We are currently using solr without cloud with 500 cores. It works good. Now we are planning to expand it using solr cloud with 1000 cores, (2 cores for each of my client with different domain data). I'm planning to put all fields as "stored". Is it the right thought? Will it have any i

Re: Can I create 1000 cores in SOLR CLOUD

2020-01-29 Thread Vignan Malyala
Guys, Did anyone work on this type of thing? Can you please help with this? For real time deployment and issues? On Mon, Jan 27, 2020 at 5:29 PM Vignan Malyala wrote: > Hi all, > > We are currently using solr without cloud with 500 cores. It works good. > > Now we are planni

SolrCloud - Underlying core creation failed while creating collection with new configset

2020-03-04 Thread Vignan Malyala
Hi I created a new config set as mentioned in Solr Cloud documentation using upload zip. I get this error when I try to create a collection using my new configset. Error from shard: http://X.X.X.X:8983/solr OverseerCollectionMessageHandler Cleaning up collection [test5]. Collection: test5 operat

Re: SolrCloud - Underlying core creation failed while creating collection with new configset

2020-03-04 Thread Vignan Malyala
gt; Best, > Erick > > > On Mar 4, 2020, at 03:24, Vignan Malyala wrote: > > > > Hi > > I created a new config set as mentioned in Solr Cloud documentation using > > upload zip. > > I get this error when I try to create a collection using my new >

Creating 100000 dynamic fields in solr

2020-05-10 Thread Vignan Malyala
Hi Is it good idea to create 10 dynamic fields of time pint in solr? I have that many fields to search on actually which come upon based on users. Thanks in advance! And I'm using Solr Cloud in real-time. Regards, Sai Vignan M

Re: Creating 100000 dynamic fields in solr

2020-05-11 Thread Vignan Malyala
ique fields? > > Jan Høydahl > > > 11. mai 2020 kl. 07:51 skrev Vignan Malyala : > > > > Hi > > Is it good idea to create 10 dynamic fields of time pint in solr? > > I have that many fields to search on actually which come upon based on > > users. > &g

Re: Creating 100000 dynamic fields in solr

2020-05-11 Thread Vignan Malyala
users that have > productA. Then you could do a search like: > > user:User1 AND Product_A_cost:[5 TO 10] > user:(User1 User5...) AND Product_B_cost[0 TO 40] > > -Joe > > On 5/11/2020 5:35 AM, Vignan Malyala wrote: > > I have around 1M products used by my clients. > > Clie

Re: Creating 100000 dynamic fields in solr

2020-05-11 Thread Vignan Malyala
Thanks Jan! This helps a lot! Sai Vignan Malyala On Mon, May 11, 2020 at 5:07 PM Jan Høydahl wrote: > Sounds like you are looking for parent/child docs here, see > https://lucene.apache.org/solr/guide/8_5/indexing-nested-documents.html > > { > "type": "u

How to add MoreLikeThis MLT handler in Solr Cloud

2020-05-12 Thread Vignan Malyala
How to add mlt handler in Solr Cloud? There is very limited documentation on this. Using search component with mlt=true doesn't include all configurations like boosting and mlt filters. Also the results with filters don't seem to work. Adding mlt handler seem better, but how to add in solr cloud.

Re: How to add MoreLikeThis MLT handler in Solr Cloud

2020-05-12 Thread Vignan Malyala
Anyone knows how to add mlt handler in solr cloud? On Tue, May 12, 2020 at 2:21 PM Vignan Malyala wrote: > How to add mlt handler in Solr Cloud? > > There is very limited documentation on this. Using search component with > mlt=true doesn't include all configurations like

Re: How to add MoreLikeThis MLT handler in Solr Cloud

2020-05-12 Thread Vignan Malyala
Any reference on this Is it possible actually? On Tue, May 12, 2020 at 2:21 PM Vignan Malyala wrote: > How to add mlt handler in Solr Cloud? > > There is very limited documentation on this. Using search component with > mlt=true doesn't include all configurations like boostin

Solr is very slow with term vectors

2019-08-11 Thread Vignan Malyala
Hi guys, I made my custom qparser plugin in Solr for scoring. The plugin only does cosine similarity of vectors for each record. I use term vectors here. Results are fine! BUT, Solr response is very slow with term vectors. It takes around 55 seconds for each request for 100 records. How do I

Solr is very slow with term vectors

2019-08-11 Thread Vignan Malyala
as its lil urgent.* Note: All my values are stored and indexed. I am not using Solr Cloud. Regards, Sai Vignan Malyala

Re: Solr is very slow with term vectors

2019-08-12 Thread Vignan Malyala
more details. > > Is it open source? Can you share a minimal example that recreates the > > problem? > > > > On Sun, Aug 11, 2019 at 1:19 PM Vignan Malyala > wrote: > > > >> Hi guys, > >> > >> I made my custom qparser plugin in Solr for s

Re: Solr is very slow with term vectors

2019-08-15 Thread Vignan Malyala
Hi Any solution for this? Taking around 50 seconds to get response. On Mon 12 Aug, 2019, 3:28 PM Vignan Malyala, wrote: > Hi Doug / Walter, > > I'm just using this methodology. > PFB link of my sample code. > https://github.com/saaay71/solr-vector-scoring > > The only

Re: Solr is very slow with term vectors

2019-08-16 Thread Vignan Malyala
he issue in your code by introducing higher > parallelism during calculation and potentially more cores. > > Maybe you can also precalculate what you do, cache it and use during > request the precalculated values. > > > Am 16.08.2019 um 05:08 schrieb Vignan Malyala : > > >

Re: Solr is very slow with term vectors

2019-08-16 Thread Vignan Malyala
How do I check that in solr? Can anyone share link on implementation of threads in solr? On Fri 16 Aug, 2019, 4:52 PM Jörn Franke, wrote: > Is your custom query parser multithreaded and leverages all cores? > > > Am 16.08.2019 um 13:12 schrieb Vignan Malyala : > > > > I

Max number of cores in solr

2019-08-27 Thread Vignan Malyala
Hi Im planning to create separate core for each of my client in solr. Can I create around 500 cores in solr. Is it a good idea? For each client i have around 10 records on average currently. How much physical memory it might consume. Plz help with this. Thank you

Solr Prod stopped yesterday - saya "insufficient memory for the Java Runtime Environment"

2019-10-23 Thread Vignan Malyala
*Solr prod stopped yesterday. How to prevent this.* Solr heap info is : -Xms20g -Xmx20g JVM Heap info. : -Xms528m -Xmx8g Physical Ram - 32GB Solr version - 6.6.1 Swap memory - 8g *hc_err_pid.log got created with following info in it:* # # There is insufficient memory for the Java Runtime Environ

Re: Solr Prod stopped yesterday - saya "insufficient memory for the Java Runtime Environment"

2019-10-23 Thread Vignan Malyala
On 10/23/2019 4:09 AM, Vignan Malyala wrote: > > *Solr prod stopped yesterday. How to prevent this.* > > > > Solr heap info is : -Xms20g -Xmx20g > > JVM Heap info. : -Xms528m -Xmx8g > > There is no such thing as a Solr heap separate from the JVM heap. There > ar

Production Issue: cannot connect to solr server suddenly

2019-11-25 Thread Vignan Malyala
I don't get this error always. At certain times, I get this error with my Solr suddenly. However, If I check my Solr url, it will be working but. When I want to update via code, it will not work. Please help me out with this. ERROR: *Failed to connect to server at 'http://127.0.0.1:8983/solr/my_co

Re: Production Issue: cannot connect to solr server suddenly

2019-11-27 Thread Vignan Malyala
solradmin in case you have DoS or related policy > preventing this. > > On Mon, 25 Nov 2019 at 16:39, Vignan Malyala wrote: > > > I don't get this error always. At certain times, I get this error with my > > Solr suddenly. > > However, If I check my Solr url, it

How to add a new field to already an existing index in Solr 6.6 ?

2019-12-03 Thread Vignan Malyala
How to add a new field to already an existing index in Solr 6.6 ? I tried to use set for this, but it shows error as undefined field. But however I could create a new index with set. But, how to add new filed to already indexed data? Is it possible? Thank you! Regards, Sai

From solr to solr cloud

2019-12-05 Thread Vignan Malyala
Hi I currently have 500 collections in my stand alone solr. Bcoz of day by day increase in Data, I want to convert it into solr cloud. Can you suggest me how to do it successfully. How many shards should be there? How many nodes should be there? Are so called nodes different machines i should take?

Re: From solr to solr cloud

2019-12-06 Thread Vignan Malyala
01:01, David Hastings > wrote: > > > are you noticing performance decreases in stand alone solr as of now? > > > > On Thu, Dec 5, 2019 at 2:29 PM Vignan Malyala > > wrote: > > > > > Hi > > > I currently have 500 collections in my stand al

Re: From solr to solr cloud

2019-12-06 Thread Vignan Malyala
keeping in mind 500 collections?* Thanks in advance! On Fri, Dec 6, 2019 at 11:44 AM Shawn Heisey wrote: > On 12/5/2019 12:28 PM, Vignan Malyala wrote: > > I currently have 500 collections in my stand alone solr. Bcoz of day by > day > > increase in Data, I want to convert

Re: How to add a new field to already an existing index in Solr 6.6 ?

2019-12-07 Thread Vignan Malyala
How do I update my schema with new field? On Tue, Dec 3, 2019 at 6:51 PM Erick Erickson wrote: > Update your schema to include the new field and reload your collection. > > Then updating your field should work. > > Best, > Erick > > > On Dec 3, 2019, at 4:4