Re: Incorrect Guava version in maven repository

On 3/19/2019 6:17 PM, Amber Liu wrote: When I try to upgrade Guava that SOLR depends on, I notice the Guava version listed in maven repository for SOLR is 14.0.1 ( https://mvnrepository.com/artifact/org.apache.solr/solr-core/8.0.0). I also noticed that there is a Jira issue resolved in SOLR

Re: Need help on LTR

one more thing i noticed is your feature params values doesn't wrap in q or qf field. check that as well On Wed, 20 Mar 2019 at 01:34, Amjad Khan wrote: > Did, but same error > > { > "responseHeader":{ > "status":400, > "QTime":5}, > "error":{ > "metadata":[ > "error-class"

Incorrect Guava version in maven repository

Hi, When I try to upgrade Guava that SOLR depends on, I notice the Guava version listed in maven repository for SOLR is 14.0.1 ( https://mvnrepository.com/artifact/org.apache.solr/solr-core/8.0.0). I also noticed that there is a Jira issue resolved in SOLR that upgraded Guava dependency to 25.

Re: Solr Suggester component not returning any results

Hi, Will you be able to post your configurations for your /suggest requestHandler in solrconfig.xml? Regards, Edwin On Wed, 20 Mar 2019 at 02:40, Deoxyribonucleic_DNA ... < deoxyribonucleic_...@hotmail.com> wrote: > Hi, I'm trying to implement the suggester component in Solr, based off > the t

Re: Problem understanding why QPS is so low

The thing that jumps out at me are: 1> your filterCache. The autowarm count is very, very high. I usually start with about 16. This will be especially important if you open new searchers often, i.e. your soft commit interval or hard-commit-with-opensearcher-true. Esentially you’re executing 900

Re: is df needed for SolrCloud replication?

On 3/19/2019 4:48 PM, Oakley, Craig (NIH/NLM/NCBI) [C] wrote: I recently noticed that my solr.log files have been getting the following error message: o.a.s.h.RequestHandlerBase org.apache.solr.common.SolrException: no field name specified in query and no default specified via 'df' param The t

is df needed for SolrCloud replication?

I recently noticed that my solr.log files have been getting the following error message: o.a.s.h.RequestHandlerBase org.apache.solr.common.SolrException: no field name specified in query and no default specified via 'df' param The timing of these messages coincide with pings to leader node of th

Re: Need help on LTR

In model file replace original_score with originalScore Roopa Sent from my iPhone > On Mar 19, 2019, at 2:44 PM, Amjad Khan wrote: > > Roopa, > > Yes > >> On Mar 19, 2019, at 11:51 AM, Roopa Rao wrote: >> >> Does your feature definitions and the feature names used in the model match? >> >

Problem understanding why QPS is so low

Hi everybody, My team run a solr cluster which has very low QPS throughput. I have been going through the different configurations in our setup, and think that it's probably the way we have defined our request handlers that is causing the slowness. Details of our cluster are below the fold. *Que

Re: Need information on EofExceptions in solr 4.8.1

On 3/19/2019 10:39 AM, Vijay Rawlani wrote: We are using solr 4.8.1 in our project. We are observing following EofExceptions in solr. It would be helpful for us to know in what situations we might land up with this. Can we get rid of this with any solr configuration or is there any way forward at

RE: Upgrading tika

As per Erick advice, I would strongly recommend that you do anything tika in a separate solrj programme. You do not want to have your solr instance processing via tika. -Original Message- From: Tannen, Lev (USAEO) [Contractor] Sent: Wednesday, 20 March 2019 08:17 To: solr-user@lucene.a

Re: Behavior of Function Query

Ok. ValueSourceAugmenter.transform(SolrDocument, int) omits null values coming from QueryDocValues.objectVal(int) on non-matching docs. It might seems odd, but that's it. On Tue, Mar 19, 2019 at 1:21 PM Erik Hatcher wrote: > Try adding fl=* into the request. There’s an oddity with fl, iirc, wh

Re: Need help on LTR

Did, but same error { "responseHeader":{ "status":400, "QTime":5}, "error":{ "metadata":[ "error-class","org.apache.solr.common.SolrException", "root-error-class","java.lang.NullPointerException"], "msg":"org.apache.solr.ltr.model.ModelException: Model type does not

Re: Need help on LTR

Please update the weights values to greater than 0 and less than 1. On Wed, 20 Mar 2019 at 00:13, Amjad Khan wrote: > Feature File > === > > [ > { > "store" : "exampleFeatureStore", > "name" : "isCityName", > "class" : "org.apache.solr.ltr.feature.FieldValueFeature", >

RE: Upgrading tika

Sorry Erick, Please disregard my previous message. Somehow I downloaded the version without those two files. I am going to download the latest version solr 8.0.0 and try it. Best Lev Tannen -Original Message- From: Erick Erickson Sent: Tuesday, March 19, 2019 2:48 PM To: solr-user S

RE: Upgrading tika

Thank you Erick, The problem is that the solr7.7.1 distribution does not contain files tika-core and tika-parsers in the contrib/extraction/lib folder. It contains only(instead) tika-java7-1.19.1.jar and tika-xmp-1.19.1.jar. Have I lost some files while downloading? Best, Lev Tannen -Origina

Re: Upgrading tika

Yes, Solr is distributed with Tika. Look in: ./solr/contrib/extraction/lib Tika is upgraded when new versions come out, so the underlying files are whatever are current at the time. The integration is a fairly loose coupling, if you're using some external program (say a SolrJ program) to parse th

Re: Need help on LTR

Roopa, Yes > On Mar 19, 2019, at 11:51 AM, Roopa Rao wrote: > > Does your feature definitions and the feature names used in the model match? > > On Tue, Mar 19, 2019 at 10:17 AM Amjad Khan wrote: > >> Yes, I did. >> >> I can see the feature that I created by this >> schema/feature-store/exa

Re: Need help on LTR

Feature File === [ { "store" : "exampleFeatureStore", "name" : "isCityName", "class" : "org.apache.solr.ltr.feature.FieldValueFeature", "params" : { "field" : "CITY_NAME" } }, { "store" : "exampleFeatureStore", "name" : "originalScore", "class" : "org.apac

Solr Suggester component not returning any results

Hi, I'm trying to implement the suggester component in Solr, based off the tutorial: https://lucene.apache.org/solr/guide/7_7/suggester.html#suggester-search-component-parameters I'm not getting any errors about how the suggester is set up or anything, but when I try to use it I get 0 results

Re: Need information on EofExceptions in solr 4.8.1

Precisely, socketTimeout ms if it's your indexing pipeline code. We faced this when our docs were unusually bigger. On Tue, Mar 19, 2019 at 7:08 PM Saurabh Sharma wrote: > Hi, > > Seems like it is not a problem with solr. It is happening due to stream > termination at the jetty. > Please make su

Re: Need information on EofExceptions in solr 4.8.1

Hi, Seems like it is not a problem with solr. It is happening due to stream termination at the jetty. Please make sure your client is not setting very low read timeout. You can also increase max sessions timeout and idleTimeout at jetty level. Thanks Saurabh Sharma On Tue, Mar 19, 2019 at 11:19

Re: Need help on LTR

Can you share the feature file and the model file, 1. I had few instances where invalid values for parameters (ie weights set to more than 1 , with minmaxnormalizer) resulted the above error, 2, Check all the features added to the model has a weight under params -> weights in the model On Tue, 19

Need information on EofExceptions in solr 4.8.1

Dear Concerned, We are using solr 4.8.1 in our project. We are observing following EofExceptions in solr. It would be helpful for us to know in what situations we might land up with this. Can we get rid of this with any solr configuration or is there any way forward at all? Kindly let us know

RE: Upgrading tika

Thank you Shawn. I assumed that tika has been integrated with solr. I the project written before me they used two tika files taken from solr distribution. I am trying to do the same with solr 7.7.1. However this version contains a different set of tika related files. So I am confused. Does sol

Re: Upgrading tika

On 3/19/2019 9:03 AM, levtannen wrote: Could anybody suggest me what files do I need to use the latest version of Tika and where to find them? This mailing list is solr-user. Tika is an entirely separate project from Solr within the Apache Foundation. To get help with Tika, you'll need to a

Re: Solr index slow response

A sharded index will go faster, because the indexing workload is split among the machines. A 5 Mbyte batch for indexing seems a little large, but it may be OK. Increase the client threads until you get CPU around 80%. wunder Walter Underwood wun...@wunderwood.org http://observer.wunderwood.org

Re: Solr index slow response

Hello, Walter, Thanks for the hint. it looks like the size matters, our documents size are not fixed, there are many small documents, such as 59KB perl 10 documents, the response time is around 10ms which is pretty good, there I could let it send bigger batch still I get reasonable response tim

Re: Need help on LTR

Does your feature definitions and the feature names used in the model match? On Tue, Mar 19, 2019 at 10:17 AM Amjad Khan wrote: > Yes, I did. > > I can see the feature that I created by this > schema/feature-store/exampleFeatureStore and it return me the features I > created. But issue is when I

RE: Upgrading tika

Thank you Jeremy, I am not using Maven, but I took both jars from the same distribution of cxf so they supposed to be compatible. -Original Message- From: Branham, Jeremy (Experis) Sent: Tuesday, March 19, 2019 11:10 AM To: solr-user@lucene.apache.org Subject: Re: Upgrading tika I’m no

Re: Solr index slow response

The fact that it is happening with a single client suggests that it is not about concurrency. If it is happening equally frequent, I would assume it is about bulks - they might appear the same but might be significantly different from Solr’s POV. Is it update or append always? If it is append, m

Re: Upgrading tika

I’m not positive – But I think you should match the CXF jar versions. "cxf-core-3.2.8.jar" org.apache.cxf cxf-rt-frontend-jaxrs 3.2.8 Jeremy Branham jb...@allstate.com On 3/19/19, 10:03 AM, "levtannen" wrote: "cxf-core-3.2.8.jar" and "cxf-rt-fromtend-jaxrs-2.6.3.jar"

Upgrading tika

Hello community, I am using Tika to extract the text content from pdf files before indexing them. I used version 1.7 and it worked OK except it produced a lot warnings like "Font not found". Now I am trying to move to the newer version 1.19.1 and I have problems finding all necessary dependencies.

Re: Solr index slow response

I'll second Emir's suggestion to try disabling swap. "I doubt swap would affect it since there is such huge free memory." -- sounds reasonable, but has not been my experience, and the stats you sent indicate that swap is in fact being used. Also, note that in many cases setting vm.swappiness=0 is n

Re: Solr index slow response

Indexing is CPU bound. If you have enough RAM, SSD disks, and enough client threads, you should be able to drive CPU to over 90%. Start with two client threads per CPU. That allows one thread to be sending data over the network while another is waiting for Solr to process the batch. A couple of

Re: Need help on LTR

Yes, I did. I can see the feature that I created by this schema/feature-store/exampleFeatureStore and it return me the features I created. But issue is when I try to put store-model. > On Mar 19, 2019, at 12:18 AM, Mohomed Rimash wrote: > > Hi Amjad, After adding the libraries into the path,

Re: Need help on LTR

Hi, Yes, I did restarted the solr server with this JVM param. > On Mar 19, 2019, at 3:35 AM, Jörn Franke wrote: > > Did you add the option -Dsolr.ltr.enabled=true ? > >> Am 19.03.2019 um 04:15 schrieb Amjad Khan : >> >> I followed the Solr LTR Documentation >> >> https://lucene.apache.org/s

Re: Solr index slow response

Isn't there somthing about largePageTables which must be enabled in JAVA and also supported by OS for such huge heaps? Just a guess. Am 19.03.19 um 15:01 schrieb Jörn Franke: It could be an issue with jdk 8 that may not be suitable for such large heaps. Have more nodes with smaller heaps (eg 3

Re: Re: obfuscated password error

Hi Jeremy, Thanks for the points. Yes, agreed that there is some conflicting property somewhere that is not letting it work. So I basically restored solr-6.3.0 directory from another environment and replace the host name appropriately for this environment. And I used the original keystore that has

Re: Solr index slow response

It could be an issue with jdk 8 that may not be suitable for such large heaps. Have more nodes with smaller heaps (eg 31 gb) > Am 18.03.2019 um 11:47 schrieb Aaron Yingcai Sun : > > Hello, Solr! > > > We are having some performance issue when try to send documents for solr to > index. The rep

Re: Spellchecker -File based vs Index based

Spellcheck configuration is default one.. solr.FileBasedSpellChecker file spellings.txt UTF-8 ./spellcheckerFile default jkdefault file on true 10 5 5 true 10 true 10 5 Also the words are p

Re: Spellchecker -File based vs Index based

Spellcheck configuration is default one.. solr.FileBasedSpellChecker file spellings.txt UTF-8 ./spellcheckerFile default jkdefault file on true 10 5 5 true 10 true 10 5 Also the words are

Re: Re: obfuscated password error

It has been generated with plain password. Same in other environments too, but it works in other environments. Thanks, Satya On Mon, Mar 18, 2019, 10:42 PM Zheng Lin Edwin Yeo wrote: > Hi, > > Did you generate your keystore with the obfuscated password or the plain > text password? > > Regards,

Re: Solr index slow response

Do you know what is causing the 30% CPU usage? The seems awfully high for solr when only indexing (unless it is iowait), but could be expected based on custom update processors and analyzers you may have. Are you putting all of the documents into a single core or multiple? Also are you using SATA

Connect to multiple Solr Servers via Spring boot

Hi, I have multitenant Application on Spring Boot, where we want search data from different solr deployments for different tenants. I have referrred many sites on internet, they provide solution to take server url from properties file. So if we want to take from property file then it will be alway

Re: Solr index slow response

Yes, the same behavior even with a single thread client. The following page says "In general, adding many documents per update request is faster than one per update request." but in reality, add many documents per request result in much longer response time, it's not liner, response time of 100

Re: Solr index slow response

If you start indexing with just a single thread/client, do you still see slow bulks? Emir -- Monitoring - Log Management - Alerting - Anomaly Detection Solr & Elasticsearch Consulting Support Training - http://sematext.com/ > On 19 Mar 2019, at 12:54, Aaron Yingcai Sun wrote: > > "QTime" val

Re: Solr index slow response

"QTime" value is from the solr rest api response, extracted from the http/json payload. The "Request time" is what I measured from client side, it's almost the same value as QTime, just some milliseconds difference. I could provide tcpdump to prove that it is really solr slow response. Those

Re: Solr index slow response

Just to add different perspective here: how do you send documents to Solr? Are those log lines from your client? Maybe it is not Solr that is slow. Could it be network or client itself. If you have some dry run on client, maybe try running it without Solr to eliminate client from the suspects.

RE: Update handler and atomic update

Hi Thierry, Thanks for your help. I think I will try to make my own handler instead. Best regards Martin Internal - KMD A/S -Original Message- From: THIERRY BOUCHENY Sent: 19. marts 2019 10:38 To: solr-user@lucene.apache.org Subject: Re: Update handler and atomic update Hi Martin,

Re: Behavior of Function Query

Try adding fl=* into the request. There’s an oddity with fl, iirc, where it can skip functions if * isn’t there (or maybe a concrete non-score field?) Erik > On Mar 18, 2019, at 10:19, Ashish Bisht wrote: > > Please see the below requests and response > > http://Sol:8983/solr/SCSpell/sel

How to use custom analyzer for solr from janusgraph

Hi, I have new field type "str_rev" in schema.xml which contains pattern replacement factory and keyword tokenizer. How to use this feild type in janusgraph so that my index will get replaced with pattern. I will really appreciate any ideas and suggestions. thanks,Ahemad Sent from Yahoo Mail on

Re: Update handler and atomic update

Hi Martin, I read after answering your email that you don’t want to use curl, that might be a problem. I might be wrong but I don’t think you can make an atomic update with a GET request having the params in the url. I think you need to make a POST request and embed [{"id":"docid","clicks":{“in

RE: Update handler and atomic update

Hi Thierry, Do you mean something like this? http://localhost:8983/solr/.../update? [{"id":"docid","clicks":{“inc”:"1"}}]commit=true I do not get an error, but it does not increase the value of clicks (unfortunately). Best regards Martin Internal - KMD A/S -Original Message- From:

Re: Update handler and atomic update

Hi Martin, Have you tried doing a POST with some JSON or XML Body. I would POST some json like the following [{"id":"docid","clicks":{“inc”:"1"}}] In an /update?commit=true Best regards Thierry See documentation here https://lucene.apache.org/solr/guide/6_6/updating-parts-of-documents.html

Re: Solr index slow response

We have around 80 million documents to index, total index size around 3TB, I guess I'm not the first one to work with this big amount of data. with such slow response time, the index process would take around 2 weeks. While the system resource is not very loaded, there must be a way to speed it

Update handler and atomic update

Hi, Hope someone can help me, I am trying to make an incremental update for one document using the API, but cannot make it work. I have tried a lot of things and all I actually want is to increment the value of the field “clicks” by one. I have something like this: http://localhost:8983/solr/..

Re: Need help on LTR

Did you add the option -Dsolr.ltr.enabled=true ? > Am 19.03.2019 um 04:15 schrieb Amjad Khan : > > I followed the Solr LTR Documentation > > https://lucene.apache.org/solr/guide/7_4/learning-to-rank.html > > > 1. Added library i