Query on changing FieldType

Hello Community I have indexed some documents for which solr has taken its type="plongs" by auto guessing but i am trying to change its type="pint" and re-indexing the same data with the same id and indexing the data with different id where id is unique key but it is showing error. Can somebody p

Re: Document Update performances Improvement

Hi Nicolas, Have you tried playing with values of *IndexConfig* (merge factor, segment size, maxBufferedDocs, Merge Policies)? We, at Auto-Suggest, also do atomic updates daily and specifically changing merge factor gave us

Re: Query on changing FieldType

Hi Shubham, Changing type is not allowed without full reindexing. If you do something like that, Solr will end up with segments with different types for the same field. Remember that segments are immutable and that reindexing some document will be in new segment, but old segment will still be th

Re: Help to learn synonymQueryStyle and FieldTypeSimilarity

Please care to explain more about what you need to understand, what you had understood and what are your requirements. On Fri, 18 Oct 2019 at 12:19, Shubham Goswami wrote: > Hi Community > > I am a beginner in solr and i am trying to understand the working of > synonymQueryStyle and FieldTypeSim

Re: Query on changing FieldType

Hi Emir Thanks for the reply, i got your point. But is there any other way to do like one field could have two or more different types defined ? or if i talk about my previous query, can we index some data for the same field with different unique id after replacing the type ? Thanks again Shubha

Re: Query on changing FieldType

Hi Shubham, No you cannot. What you can do is to use copy field or update request processor to store is as some other field and use that in your query and ignore the old one that will eventually disappear as the result of segment merges. HTH, Emir -- Monitoring - Log Management - Alerting - Anom

Re: investigating high heap memory usage particularly on overseer / collection leaders

Since you say that it could be related to client usage patterns, have you tried analyzing queries taking the maximum times? Refer this . On Tue, 8 Oct 2019 at 02:42, dshih wrote: > 3-node SOLR 7.4.0 > 24gb m

Re: Query on changing FieldType

Hi Emir As you have mentioned above we cannot change field type after indexing once and we have to do dull re-indexing again, I tried to change field type from plong to pint which has implemented class solr.LongPointField and solr.IntPointField respectively and it was showing error as expected.

Re: Solr enabled kerberos and create collection failed

Hi, You posted this same question in a different thread and Jorn Franke replied to say that you likely need to run "kinit" before invoking "bin/solr". That seems like a likely possible explanation to me. But, since you've given us very little information on how you've setup Kerberos and what you'

Behavior of a Solr suggester using spellchecker

Dear Solr community, I am facing a behavior with a suggest request handler that does not look normal to me, and I would like to understand. * Here is the configuration of the suggest component : suggest org.apa

Re: Solr enabled kerberos and create collection failed

I _think_ this is the third time you've submitted this exact question as a different email thread. Both of your other threads have responses on them, but maybe you're not seeing that for some reason. Maybe you won't be able to see this response either, but in case you can: I think you'll have bet

Re: Solr enabled kerberos and create collection failed

I _think_ this is the fourth time you've submitted this exact question as a different email thread. Most of your other threads have responses on them, but maybe you're not seeing that for some reason. Maybe you won't be able to see this response either, but in case you can: I think you'll have be

Re: Query on changing FieldType

Hi Shubbham, Emir gave you accurate advice - you cannot (safely) change field types without reindexing. You may avoid errors for a time, and searches may even return the results you expect. But the type-change is still a ticking time bomb...Solr might try to merge segments down the road or do so

Solr 7.2.1 - Performance recommendation needed

Hi, We have a solrCloud with 2 solr servers with 3 zookeepers. We have around 90 collections. Each having shard size of 8 and replication factor of 2. Some collections have shard size of 16 as well. Atleast 10 collections will have 200M records. Some has 100M records with ~400 fields. We are curre

Inaccuracies sorting by payload value

I have a problem when sorting by payload value ... the resulting sort order is correct for some documents, but not all. The field type and field definitions are as follows: The request parameters are the following: _exact_utag_primary_id:utag77n5840c6h5v0g9b9ww _id,

Re: Solr 7.2.1 - Performance recommendation needed

Impossible to say, see: https://lucidworks.com/post/sizing-hardware-in-the-abstract-why-we-dont-have-a-definitive-answer/ Lucene uses MMapDirectory, see: https://dzone.com/articles/use-lucene%E2%80%99s-mmapdirectory, so the size of the searchable portions of your index relative to physical memo

Re: Solr Paryload example

Hi all, thanks for supporting. And many thanks whom have implemented the integration of the github Solr repository with the intellij IDE. To configure the environment and run the debugger I spent less than one hour, (and most of the time I had to wait the compilation). Solr and you guys really roc

using the df parameter to set a default to search all fields

How do I make Solr search on all fields in a document? I read the documentation about the df field, and added the following to my solrconfig.xml: explicit 10 _text_ in my managed-schema file i have the following: I have deleted the documents, and re-indexed the c

Re: using the df parameter to set a default to search all fields

On 10/22/2019 10:26 AM, rhys J wrote: How do I make Solr search on all fields in a document? Solr does not have a way to ask for all fields on a search. If you use the edismax query parser, you can specify multiple fields with the qf parameter, but there is nothing you can put in that parame

Re: using the df parameter to set a default to search all fields

> Solr does not have a way to ask for all fields on a search. If you use > the edismax query parser, you can specify multiple fields with the qf > parameter, but there is nothing you can put in that parameter as a > shortcut for "all fields." Using qf with multiple fields is the > cleanest way to

Re: Re: using the df parameter to set a default to search all fields

I think you actually can search over all fields, but not in the df parameter. We have a big list of fields we want to search over. So, we just put a dummy one in the df param field, and then we use the fl parameter. With the edismax parser, this works. It looks something like this:

Re: using the df parameter to set a default to search all fields

On 10/22/2019 11:17 AM, rhys J wrote: How would I enter qf parameters in the solrconfig.xml? In the handler definition you would simply add the parameter like you did when you added df. edismax field1 field2 field3 I included the parameter in the above example that sw

Re: using the df parameter to set a default to search all fields

On 10/22/2019 11:42 AM, Audrey Lorberfeld - audrey.lorberf...@ibm.com wrote: I think you actually can search over all fields, but not in the df parameter. We have a big list of fields we want to search over. So, we just put a dummy one in the df param field, and then we use the fl parameter. Wi

Re: Re: using the df parameter to set a default to search all fields

Eek, Shawn, you're right -- I'm sorry, all! I meant to say the the QF (!) parameter. And pasted the wrong thing too ☹ This is what ours looks like with the qf parameter (and the edismax parser) title_en^1.5 description_en^0.5 content_en^0.5 headings_en^1.3 keywords_en^1.5 url^0

Re: Document Update performances Improvement

> We, at Auto-Suggest, also do atomic updates daily and specifically > changing merge factor gave us a boost of ~4x Interesting. What kind of change exactly on the merge factor side ? > At current configuration, our core atomically updates ~423 documents > per second. Would you say atomical upd

Re: solr 8.1.1 many time slower returning query results than solr 4.10.4 or solr 6.5.1

Hi, Is there anyone that would be able to assist with the issue that I am seeing? I am seeing the same slowness with solr 8.1.1 using java11 as I am seeing with java12, over queries that are run from solr4.10.4 with java8 and solr6.5.1 with java8. Queries that return in less than half a second on s

Re: Solr Paryload example

Hi all, this evening I had some spare hour to spend in order to put everything together in a repository. https://github.com/freedev/solr-payload-string-function-query On Tue, Oct 22, 2019 at 5:54 PM Vincenzo D'Amore wrote: > Hi all, > > thanks for supporting. And many thanks whom have implem

tlogs are not deleted

Hi, We are using solr 7.7 cloud with CDCR(every collection has 3 replicas, 1 shard). In solrconfig.xml, tlog configuration is super simple like : There is also daily data import and commit is called after data import every time. Indexing works fine, but the problem is that the number of tlogs

tlogs are not deleted

Hi, We are using solr 7.7 cloud with CDCR(every collection has 3 replicas, 1 shard). In solrconfig.xml, tlog configuration is super simple like : There is also daily data import and commit is called after data import every time. Indexing works fine, but the problem is that the number of tlog

答复: Solr enabled kerberos and create collection failed

My kerberos is set as below in solr.in.sh SOLR_AUTH_TYPE="kerberos" SOLR_AUTHENTICATION_OPTS="-Djava.security.auth.login.config=/etc/solr/conf/solr_server_jaas.conf \ -DauthenticationPlugin=org.apache.solr.security.KerberosPlugin \ -Dsolr.kerbero

Re: Solr 7.2.1 - Performance recommendation needed

Thanks Erick, Below is the link for our GC report when the incident happened. https://nam03.safelinks.protection.outlook.com/?url=https%3A%2F%2Fgceasy.io%2Fmy-gc-report.jsp%3Fp%3DYXJjaGl2ZWQvMjAxOS8xMC83Ly0tMDJfc29scl9nYy5sb2cuNi5jdXJyZW50LS0xNC00My01OA%3D%3D%26channel%3DWEB&data=02%7C01%7CSethur

Re: Document Update performances Improvement

Hi Nicolas, What kind of change exactly on the merge factor side ? We increased maxMergeAtOnce and segmentsPerTier from 5 to 50. This will make Solr to merge segments less frequently after many index updates. Yes, you need to find the sweet spot here but do try increasing these values from the d

Re: Query on changing FieldType

Hi Jason Thanks for the response. You are right that re-indexing is required after making any changes to Schema even i am re-indexing the docs in which i have changed the fieldtypes, but here Emir is talking about full re-indexing i.e. deleting the existing/core and creating new one that is time c