Re: Need help to configure automated deletion of shard in solr

2020-12-08 Thread Pushkar Mishra
Hi Erick, COLSTATUS does not work with Implicit router type collection . Is there any way to get the replica detail ? Regards On Mon, Nov 30, 2020 at 8:48 PM Erick Erickson wrote: > Are you using the implicit router? Otherwise you cannot delete a shard. > And you won’t have any shards that ha

Re: Need help to configure automated deletion of shard in solr

2020-12-02 Thread Erick Erickson
You can certainly use the TTL logic. Note the TimeRoutedAlias, but the DocExpirationUpdateFactory. DocExpirationUpdateFactory operates on each document individually so you can mix-n-match if you want. As for knowing when a shard is empty, I suggested a method for that in one of the earlier e-mails

Re: Need help to configure automated deletion of shard in solr

2020-12-01 Thread Pushkar Mishra
Hi Erick, It is implicit. TTL thing I have explored but due to some complications we can't use. that . Let me explain the actual use case . We have limited space ,we can't keep storing the document for infinite time . So based on the customer's retention policy ,I need to delete the documents. An

Re: Need help to configure automated deletion of shard in solr

2020-12-01 Thread Erick Erickson
This is still confusing. You haven’t told us what router you are using, compositeId or implicit? If you’re using compositeId (the default), you will never have empty shards because docs get assigned to shards via a hashing algorithm that distributes them very evenly across all available shards. Y

Re: Need help to configure automated deletion of shard in solr

2020-12-01 Thread Pushkar Mishra
Hi Team, As I explained the use case , can someone help me out to find out the configuration way to delete the shard here ? A quick response will be greatly appreciated. Regards Pushkar On Mon, Nov 30, 2020 at 11:32 PM Pushkar Mishra wrote: > > > On Mon, Nov 30, 2020, 9:15 PM Pushkar Mishra

Re: Need help to configure automated deletion of shard in solr

2020-11-30 Thread Pushkar Mishra
On Mon, Nov 30, 2020, 9:15 PM Pushkar Mishra wrote: > Hi Erick, > First of all thanks for your response . I will check the possibility . > Let me explain my problem in detail : > > 1. We have other use cases where we are making use of listener on > postCommit to delete/shift/split the shards .

Re: Need help to configure automated deletion of shard in solr

2020-11-30 Thread Pushkar Mishra
Hi Erick, First of all thanks for your response . I will check the possibility . Let me explain my problem in detail : 1. We have other use cases where we are making use of listener on postCommit to delete/shift/split the shards . So we have capability to delete the shards . 2. The current use c

Re: Need help to configure automated deletion of shard in solr

2020-11-30 Thread Erick Erickson
Are you using the implicit router? Otherwise you cannot delete a shard. And you won’t have any shards that have zero documents anyway. It’d be a little convoluted, but you could use the collections COLSTATUS Api to find the names of all your replicas. Then query _one_ replica of each shard with so

Re: Need help to resolve Apache Solr vulnerability

2020-11-12 Thread Dave
Solr isn’t meant to be public facing. Not sure how anyone would send these commands since it can’t be reached from the outside world > On Nov 12, 2020, at 7:12 AM, Sheikh, Wasim A. > wrote: > > Hi Team, > > Currently we are facing the below vulnerability for Apache Solr tool. So can > you

Re: Need help in understanding the below error message when running solr-exporter

2020-10-19 Thread yaswanth kumar
Can someone help on the above pls?? On Sat, Oct 17, 2020 at 6:22 AM yaswanth kumar wrote: > Using Solr 8.2; Zoo 3.4; Solr mode: Cloud with multiple collections; Basic > Authentication: Enabled > > I am trying to run the > > export JAVA_OPTS="-Djavax.net.ssl.trustStore=etc/solr-keystore.jks > -Dj

Re: Need help on handling large size of index.

2020-05-22 Thread Phill Campbell
Maybe your problems are in AWS land. > On May 22, 2020, at 3:45 AM, Modassar Ather wrote: > > Thanks Erick and Phill. > > We index data weekly once and that is why we do the optimisation and it has > helped in faster query result. I will experiment with a fewer segments with > the current hard

Re: Need help on handling large size of index.

2020-05-22 Thread Modassar Ather
Thanks Erick and Phill. We index data weekly once and that is why we do the optimisation and it has helped in faster query result. I will experiment with a fewer segments with the current hardware. The thing I am not clear about is although there is no constant high usage of extra IOPs other than

Re: Need help on handling large size of index.

2020-05-21 Thread Phill Campbell
The optimal size for a shard of the index is be definition what works best on the hardware with the JVM heap that is in use. More shards mean smaller sizes of the index for the shard as you already know. I spent months changing the sharing, the JVM heap, the GC values before taking the system l

Re: Need help on handling large size of index.

2020-05-21 Thread Erick Erickson
Please consider _not_ optimizing. It’s kind of a misleading name anyway, and the version of solr you’re using may have unintended consequences, see: https://lucidworks.com/post/segment-merging-deleted-documents-optimize-may-bad/ and https://lucidworks.com/post/solr-and-optimizing-your-index-take-i

Re: Need help on handling large size of index.

2020-05-21 Thread Modassar Ather
Thanks Shawn for your response. We have seen a performance increase in optimisation with a bigger number of IOPs. Without the IOPs we saw the optimisation took around 15-20 hours whereas the same index took 5-6 hours to optimise with higher IOPs. Yes the entire extra IOPs were never used to full o

Re: Need help on handling large size of index.

2020-05-21 Thread Modassar Ather
Thanks Phill for your response. Optimal Index size: Depends on what you are optimizing for. Query Speed? Hardware utilization? We are optimising it for query speed. What I understand even if we set the merge policy to any number the amount of hard disk will still be required for the bigger segment

Re: Need help on handling large size of index.

2020-05-20 Thread Shawn Heisey
On 5/20/2020 11:43 AM, Modassar Ather wrote: Can you please help me with following few questions? - What is the ideal index size per shard? We have no way of knowing that. A size that works well for one index use case may not work well for another, even if the index size in both cases i

Re: Need help on handling large size of index.

2020-05-20 Thread Phill Campbell
In my world your index size is common. Optimal Index size: Depends on what you are optimizing for. Query Speed? Hardware utilization? Optimizing the index is something I never do. We live with about 28% deletes. You should check your configuration for your merge policy. I run 120 shards, and I

Re: Need help on handling large size of index.

2020-05-20 Thread Phill Campbell
In my world your index size is common. Optimal Index size: Depends on what you are optimizing for. Query Speed? Hardware utilization? Optimizing the index is something I never do. We live with about 28% deletes. You should check your configuration for your merge policy. I run 120 shards, and I

Re: Need Help in Apache SOLR scores logic

2020-02-25 Thread Jon Kjær Amundsen
Relevance scoring has indeed changed since Solr 6 from the tf/idf vector model to Okapi BM25. You will need to set the similarity to ClassicSimilarityFactory in the schema. Consult the reference guide[1] how to do it. [1] https://lucene.apache.org/solr/guide/8_4/other-schema-elements.html#similar

Re: Need help in configuring Spell check in Apache Solr 8.4

2020-02-05 Thread kumar gaurav
HI Seetesh For IndexBasedSpellchecker default distanceMeasure is LevensteinDistance itself . Thats why it is commented in the Reference Guide regards Kumar Gaurav On Tue, Jan 28, 2020 at 1:01 PM seeteshh wrote: > Hello Kumar Gaurav > > For IndexBasedSpellchecker is there a better option of us

Re: Need help in configuring Spell check in Apache Solr 8.4

2020-01-27 Thread seeteshh
My searchComponent is as follows text_general default name solr.DirectSolrSpellChecker internal 0.5 2 1 5 4 0.01 wordbreak solr.WordBreakSolrSpellChecker name

Re: Need help in configuring Spell check in Apache Solr 8.4

2020-01-27 Thread seeteshh
Hello Kumar Gaurav For IndexBasedSpellchecker is there a better option of using org.apache.lucene.search.spell.LevensteinDistance as this is not valid in Solr 8.4 This line seems to be commented in the Reference Guide Regards, Seetesh Hindlekar - Seetesh Hindlekar -- Sent from: https://l

Re: Need help in configuring Spell check in Apache Solr 8.4

2020-01-21 Thread kumar gaurav
Can you share spellcheck component and handler which you have used ? On Mon, Jan 20, 2020 at 3:35 PM seeteshh wrote: > Hello all, > > I am not able to check and test the spell check feature in Apache solr 8.4 > > Tried multiple examples including > > > https://examples.javacodegeeks.com/enterpri

Re: Need help in GeoSpatial Searching into Solr Server

2019-12-23 Thread Erick Erickson
Why are you using text field for location? You must use the proper field type. You need to follow the instructions in the “spatial search” section of the reference guide, here’s the ref guide for Solr 7: https://lucene.apache.org/solr/guide/7_7/spatial-search.html Best, Erick > On Dec 23, 201

Re: Need help with Solr Streaming query

2019-10-16 Thread Erick Erickson
The NOT operator isn’t a Boolean NOT, so it requires some care, Chris Hostetter wrote a good blog about that. Try q=*:* -(:*c* The query q=-something really isn’t valid syntax, but some query parsers help you out by silently putting the *:* in front of it. that’s not guaranteed across all pars

Re: Need help on LTR

2019-03-22 Thread Kamuela Lau
I think the issue is that you store the feature as originalScore but in your model you refer to it as original_score On Wed, Mar 20, 2019 at 1:58 PM Mohomed Rimash wrote: > one more thing i noticed is your feature params values doesn't wrap in q or > qf field. check that as well > > On Wed, 20

Re: Need help on LTR

2019-03-19 Thread Mohomed Rimash
one more thing i noticed is your feature params values doesn't wrap in q or qf field. check that as well On Wed, 20 Mar 2019 at 01:34, Amjad Khan wrote: > Did, but same error > > { > "responseHeader":{ > "status":400, > "QTime":5}, > "error":{ > "metadata":[ > "error-class"

Re: Need help on LTR

2019-03-19 Thread Roopa ML
In model file replace original_score with originalScore Roopa Sent from my iPhone > On Mar 19, 2019, at 2:44 PM, Amjad Khan wrote: > > Roopa, > > Yes > >> On Mar 19, 2019, at 11:51 AM, Roopa Rao wrote: >> >> Does your feature definitions and the feature names used in the model match? >> >

Re: Need help on LTR

2019-03-19 Thread Amjad Khan
Did, but same error { "responseHeader":{ "status":400, "QTime":5}, "error":{ "metadata":[ "error-class","org.apache.solr.common.SolrException", "root-error-class","java.lang.NullPointerException"], "msg":"org.apache.solr.ltr.model.ModelException: Model type does not

Re: Need help on LTR

2019-03-19 Thread Mohomed Rimash
Please update the weights values to greater than 0 and less than 1. On Wed, 20 Mar 2019 at 00:13, Amjad Khan wrote: > Feature File > === > > [ > { > "store" : "exampleFeatureStore", > "name" : "isCityName", > "class" : "org.apache.solr.ltr.feature.FieldValueFeature", >

Re: Need help on LTR

2019-03-19 Thread Amjad Khan
Roopa, Yes > On Mar 19, 2019, at 11:51 AM, Roopa Rao wrote: > > Does your feature definitions and the feature names used in the model match? > > On Tue, Mar 19, 2019 at 10:17 AM Amjad Khan wrote: > >> Yes, I did. >> >> I can see the feature that I created by this >> schema/feature-store/exa

Re: Need help on LTR

2019-03-19 Thread Amjad Khan
Feature File === [ { "store" : "exampleFeatureStore", "name" : "isCityName", "class" : "org.apache.solr.ltr.feature.FieldValueFeature", "params" : { "field" : "CITY_NAME" } }, { "store" : "exampleFeatureStore", "name" : "originalScore", "class" : "org.apac

Re: Need help on LTR

2019-03-19 Thread Mohomed Rimash
Can you share the feature file and the model file, 1. I had few instances where invalid values for parameters (ie weights set to more than 1 , with minmaxnormalizer) resulted the above error, 2, Check all the features added to the model has a weight under params -> weights in the model On Tue, 19

Re: Need help on LTR

2019-03-19 Thread Roopa Rao
Does your feature definitions and the feature names used in the model match? On Tue, Mar 19, 2019 at 10:17 AM Amjad Khan wrote: > Yes, I did. > > I can see the feature that I created by this > schema/feature-store/exampleFeatureStore and it return me the features I > created. But issue is when I

Re: Need help on LTR

2019-03-19 Thread Amjad Khan
Yes, I did. I can see the feature that I created by this schema/feature-store/exampleFeatureStore and it return me the features I created. But issue is when I try to put store-model. > On Mar 19, 2019, at 12:18 AM, Mohomed Rimash wrote: > > Hi Amjad, After adding the libraries into the path,

Re: Need help on LTR

2019-03-19 Thread Amjad Khan
Hi, Yes, I did restarted the solr server with this JVM param. > On Mar 19, 2019, at 3:35 AM, Jörn Franke wrote: > > Did you add the option -Dsolr.ltr.enabled=true ? > >> Am 19.03.2019 um 04:15 schrieb Amjad Khan : >> >> I followed the Solr LTR Documentation >> >> https://lucene.apache.org/s

Re: Need help on LTR

2019-03-19 Thread Jörn Franke
Did you add the option -Dsolr.ltr.enabled=true ? > Am 19.03.2019 um 04:15 schrieb Amjad Khan : > > I followed the Solr LTR Documentation > > https://lucene.apache.org/solr/guide/7_4/learning-to-rank.html > > > 1. Added library i

Re: Need help on LTR

2019-03-18 Thread Mohomed Rimash
Hi Amjad, After adding the libraries into the path, Did you restart the SOLR ? On Tue, 19 Mar 2019 at 08:45, Amjad Khan wrote: > I followed the Solr LTR Documentation > > https://lucene.apache.org/solr/guide/7_4/learning-to-rank.html < > https://lucene.apache.org/solr/guide/7_4/learning-to-rank.

Re: Need help on Solr authorization

2019-01-18 Thread Scott Stults
My guess is that you're using a self-signed cert and the certificate path can't be verified. Either that or your cert was signed by a CA that your JVM doesn't recognize. There's a good article about diagnosing SSL problems here: https://confluence.atlassian.com/kb/unable-to-connect-to-ssl-services

Re: Need help on Solr authorization

2019-01-18 Thread sathish kumar
Hi, Anyone got a chance to have a look at the issue i had posted? Please throw some inputs. -Sathish On Fri, 11 Jan 2019, 8:10 pm sathish kumar, wrote: > Hi, > > We have a two node Solr setup(version is 7.2.1) with embedded zookeeper > running in Solr Server 1. > > We have recently enabled SSL

Re: Need Help on Solr Client connection Pooling

2018-08-30 Thread Shawn Heisey
On 8/30/2018 2:13 AM, Gembali Satish kumar wrote: *SolrClient client = new HttpSolrClient.Builder(* * SolrUtil.getSolrURL(tsConfigUtil.getClusterAdvertisedAddress(), aInCollectionName)).build();* after my job search done, I am closing my client. *client.close();* but from UI getting more reques

Re: Need Help on Solr Client connection Pooling

2018-08-30 Thread Shalin Shekhar Mangar
You should create a single HttpSolrClient and re-use for all requests. It is thread safe and creates an Http connection pool internally (well Apache HttpClient does). On Thu, Aug 30, 2018 at 2:28 PM Gembali Satish kumar < gembalisatishku...@gmail.com> wrote: > Hi Team, > > Need some help on Clie

Re: need help with a complicated join query

2018-08-23 Thread damienk
I'm thinking something like this: q={!join v=id:doca_1 from=members to=id} On Fri, 24 Aug 2018 at 03:03, Steve Pruitt wrote: > At least it is complicated to me. :>) > > We are investigating how to find return a list documents whose identifier > is contained in a multi-value field in another doc

Re: need help on search on last name + middile initial

2018-04-20 Thread Wendy2
The issue was resolved. *I created a new fieldType:* *A reference:* https://opensourceconnections.com/blog/2013/08/21/name-search-in-solr/ -- Sent from: http://lucene.472066.n3.nabble.com/Solr-User-f472068.html

Re: need help on search on last name + middile initial

2018-04-20 Thread Wendy2
Hi Shawn, The issue got resolved :-) Thank you very much for your help!! *I created a new fieldType:* * A reference:* https://opensourceconnections.com/blog/2013/08/21/name-search-in-solr/ -- Sent from: http://lucene.472066.n3.nabble.com/Solr-User-f47

Re: need help on search on last name + middile initial

2018-04-19 Thread Wendy2
Hi Shawn, Thank you very much for your reply! Per your suggestion, I re-indexed the data after removing the stopword filter. It looks that Solr parsed the data correctly but didn't return any results. Anything else could I try? Thank you again! ===debugQuery Output= { "responseHe

Re: need help on search on last name + middile initial

2018-04-18 Thread Shawn Heisey
On 4/18/2018 1:12 PM, Wendy2 wrote: > "debug":{ > "debugQuery mode indicates that Solr dropped the ""A."" when parsing the > query: > ""debug"":{ > ""rawquerystring"":""\""Ellington, A.\, > ""querystring"":""\""Ellington, A.\, > > ""parsedquery"":""(+DisjunctionMaxQuery(((en

Re: Need help with migration to Solr 7 (Error instantiating class)

2018-04-13 Thread Erick Erickson
Try starting Solr with the -v option. That'll dump exactly what's loaded from where. and provide a lot more details. Also what's in the Solr logs? Perhaps that'll be more informative. Best Erick On Fri, Apr 13, 2018 at 1:36 AM, Sambhav Kothari wrote: > Hello everyone! > > I am migrating my Solr

Re: Need help to get started on Solr, searching get nothing. Thank you very much in advance

2018-04-04 Thread Raymond Xie
I have the data ready for index now, it is a json file: {"122": "20180320-08:08:35.038", "49": "VIPER", "382": "0", "151": "1.0", "9": "653", "10071": "20180320-08:08:35.088", "15": "JPY", "56": "XSVC", "54": "1", "10202": "APMKTMAKING", "10537": "XOSE", "10217": "Y", "48": "179492540", "201": "1"

Re: Need help to get started on Solr, searching get nothing. Thank you very much in advance

2018-04-03 Thread Shawn Heisey
On 4/2/2018 9:00 PM, Raymond Xie wrote: I see there is "/browse" in solrconfig.xml : explicit and name="defaults" with one item of "df" as shown below: _text_ My understanding is I can put whatever fields I want to enable index and searchin

Re: Need help to get started on Solr, searching get nothing. Thank you very much in advance

2018-04-02 Thread Raymond Xie
Thanks Rick and Adhyan I see there is "/browse" in solrconfig.xml : explicit and name="defaults" with one item of "df" as shown below: _text_ My understanding is I can put whatever fields I want to enable index and searching here in parallel with _te

Re: Need help to get started on Solr, searching get nothing. Thank you very much in advance

2018-04-02 Thread Adhyan Arizki
Raymond, You can specify the default behavior in solrconfig.xml under each handler. For instance for /browse you can specify it should look into name, and for /query you can default it to different field. On Mon, Apr 2, 2018 at 9:04 PM, Rick Leir wrote: > Raymond > There is a default field norm

Re: Need help to get started on Solr, searching get nothing. Thank you very much in advance

2018-04-02 Thread Rick Leir
Raymond There is a default field normally called df. You would normally use Copyfield to copy all searchable fields into the default field. Cheers -- Rick On April 1, 2018 11:34:07 PM EDT, Raymond Xie wrote: >Hi Rick, > >I sorted it out half: > >I should have specified the field in the search q

Re: Need help to get started on Solr, searching get nothing. Thank you very much in advance

2018-04-01 Thread Raymond Xie
Hi Rick, I sorted it out half: I should have specified the field in the search query, so, instead of http://localhost:8983/solr/films/browse?q=batman, I should use: http://localhost:8983/solr/films/browse?q=name:batman Sorry for this newbie mistake. But what about if I/user doesn't know or does

Re: Need help to get started on Solr, searching get nothing. Thank you very much in advance

2018-04-01 Thread Rick Leir
Raymond The output is not visible to me because the mailing list strips images. Please try a different way to show the output. Cheers -- Rick On March 29, 2018 10:17:13 PM EDT, Raymond Xie wrote: > I am new to Solr, following Steve Rowe's example on >https://github.com/apache/lucene-solr/tree/ma

Re: Need help with match contains query in SOLR

2018-03-01 Thread Emir Arnautović
Hi, Is the size of phrases in index arbitrary or only two words? Do you need to apply some standardisations on individual words? Depending on the answers indexing will be different, but the goal is to index phrase as a single token (might need some custom token filter). At search time, you do sh

Re: Need help with match contains query in SOLR

2018-03-01 Thread bbarani
The problem with pf2 is that it will return the document if it matches loosely too and then I need to do a comparison to see whether the match was a complete phrase match OR not before actually using the result. It would become a 2 step process.. -- Sent from: http://lucene.472066.n3.nabble.com/

Re: Need help with match contains query in SOLR

2018-03-01 Thread Rick Leir
Hi Would a pf2 boost suit your needs? You would match loosely on any term, and your results containing bigrams would be at the top. HTH -- Rick On March 1, 2018 11:54:19 AM EST, bbarani wrote: >Hi, > >I want to do a complete "phrase contain" match. > >For ex: Value is stored as below in the mu

Re: Need help with match contains query in SOLR

2018-03-01 Thread bbarani
Hi, I want to do a complete "phrase contain" match. For ex: Value is stored as below in the multivalued field 1 transfer responsibility transfer account *Positive cases: (when it should return this document)* searchTerms:how to transfer responsibility searchTerms:show me ways to transfer re

Re: Need help with match contains query in SOLR

2018-02-20 Thread Alessandro Benedetti
It was not clear at the beginning, but If I understood correctly you could : *Index Time analysis* Use whatever charFilter you need, the keyword tokenizer[1] and then token filters you like ( such as lowercase filter, synonyms ect) *Query Time Analysis* You can use a tokenizer you like ( that tok

Re: Need help with solr highlighting feature

2018-01-18 Thread Steve Rowe
Hi Aashish, Thanks for letting us know. -- Steve www.lucidworks.com > On Jan 17, 2018, at 1:41 PM, Aashish Agarwal wrote: > > Hello Steve, > > Sorry to disturb, the issue was due to custom tokenizer that I used. Since > that was not storing offset so term vector was not working. > Its resolve

Re: Need help with solr highlighting feature

2018-01-17 Thread Aashish Agarwal
Hello Steve, Sorry to disturb, the issue was due to custom tokenizer that I used. Since that was not storing offset so term vector was not working. Its resolved now. On Jan 17, 2018 11:06 PM, "Steve Rowe" wrote: > Hi Aashish, > > Which version of Solr are you using? > > Please share your config

Re: Need help with solr highlighting feature

2018-01-17 Thread Steve Rowe
Hi Aashish, Which version of Solr are you using? Please share your configuration: highlighter and schema. -- Steve www.lucidworks.com > On Jan 16, 2018, at 12:20 PM, Aashish Agarwal wrote: > > Hello, > > I am using solr highlighting feature on multivalued field containing korean > words.The

RE: Need Help Configuring Solr To Work With Nutch

2017-12-08 Thread Mukhopadhyay, Aratrika
Mukhopadhyay -Original Message- From: Erick Erickson [mailto:erickerick...@gmail.com] Sent: Friday, December 08, 2017 11:06 AM To: solr-user Subject: Re: Need Help Configuring Solr To Work With Nutch 1> do you see update messages in the Solr logs? 2> did you issue a commit? Best,

Re: Need Help Configuring Solr To Work With Nutch

2017-12-08 Thread Erick Erickson
1> do you see update messages in the Solr logs? 2> did you issue a commit? Best, Erick On Fri, Dec 8, 2017 at 7:27 AM, Mukhopadhyay, Aratrika < aratrika.mukhopadh...@mail.house.gov> wrote: > Good Morning, > >I am running nutch 2.3 , hbase 0.98 and I am integrating nutch > with solr 6

Re: Need help detecting Relatedness in documents

2017-10-26 Thread Atita Arora
Thanks for the suggestion Anshum , appreciate your response..! I tried using MLT with the field that stores the similarity index of topics this could be related to. But this wasn't really accepted as the solution, as this could not resolve my next stage of the problem where I need to get the effec

Re: Need help detecting Relatedness in documents

2017-10-26 Thread Anshum Gupta
I would suggest you look at the mlt query parser. That allows you to find documents similar to a particular documents, and also allows for specifying the field to use for similarity purposes. https://lucene.apache.org/solr/guide/7_0/other-parsers.html#more-like-this-query-parser

Re: Need help with Slow Query Logging

2017-10-17 Thread Walter Underwood
I would not do this in Solr. Post process the log file to split them out. That allows you to change the definition of “slow” later, reprocess older files, etc. Do log analysis with log analysis tools. Don’t try to push that too far up the chain into the production server. wunder Walter Underwo

Re: Need help with Slow Query Logging

2017-10-12 Thread Atita Arora
Indeed , the trouble hasn't got over yet. So we got https://issues.apache.org/jira/browse/SOLR-11453 created meantime. I'll look forward to your updates. Thanks again , Atita On Thu, Oct 12, 2017 at 2:08 PM, Emir Arnautović < emir.arnauto...@sematext.com> wrote: > Hi Atita, > I did not have ti

Re: Need help with Slow Query Logging

2017-10-12 Thread Emir Arnautović
Hi Atita, I did not have time to try it out, but will try to do it over the weekend if you are still having troubles with it. Regards, Emir -- Monitoring - Log Management - Alerting - Anomaly Detection Solr & Elasticsearch Consulting Support Training - http://sematext.com/ > On 10 Oct 2017, at

Re: Need help with Slow Query Logging

2017-10-10 Thread Atita Arora
No luck for me , did you give it a try meantime ? M not sure , if I may have missed something , my logs are completely gone after this change. Wondering whats wrong with them. -Atita On Tue, Oct 10, 2017 at 5:58 PM, Atita Arora wrote: > Sure thanks Emir, > Let me give them a quick try and I'll

Re: Need help with Slow Query Logging

2017-10-10 Thread Atita Arora
Sure thanks Emir, Let me give them a quick try and I'll update you. Thanks, Atita On Tue, Oct 10, 2017 at 5:28 PM, Emir Arnautović < emir.arnauto...@sematext.com> wrote: > Hi Atita, > I did not try it, but I think that following could work: > > > #logging queries > log4j.logger.org.apache.solr.h

Re: Need help with Slow Query Logging

2017-10-10 Thread Emir Arnautović
Hi Atita, I did not try it, but I think that following could work: #logging queries log4j.logger.org.apache.solr.handler.component.QueryComponent=WARN,slow log4j.appender.slow=org.apache.log4j.RollingFileAppender log4j.appender.slow.File=${solr.log}/slow.log log4j.appender.slow.layout=org.apach

Re: Need help with Slow Query Logging

2017-10-10 Thread Atita Arora
Hi Emir, So I made few changes to the log4j config , I am able to redirect these logs to another file as well. But as these are the WARN logs so I doubt any logs enabled at WARN level are going to be redirected here in this new log file. So precisely , I am using Solr 6.1 (in cloud mode) & I have

Re: Need help with Slow Query Logging

2017-10-10 Thread Emir Arnautović
Hi Atita, You should definetely go with log4j configuration as anything else would be redoing what log4j can do. You already have slowQueryThresholdMillies to make slow queries log with WARN and you can configure log4j to put such logs (class + level) to a separate file. This seems like frequent

Re: Need help with query syntax

2017-08-11 Thread Erick Erickson
Yep.. On Fri, Aug 11, 2017 at 6:31 AM, OTH wrote: > Hi, thanks for sharing the article. > > On Fri, Aug 11, 2017 at 4:38 AM, Erick Erickson > wrote: > >> Omer: >> >> Solr does not implement pure boolean logic, see: >> https://lucidworks.com/2011/12/28/why-not-and-or-and-not/. >> >> With appropri

Re: Need help with query syntax

2017-08-11 Thread OTH
Hi, thanks for sharing the article. On Fri, Aug 11, 2017 at 4:38 AM, Erick Erickson wrote: > Omer: > > Solr does not implement pure boolean logic, see: > https://lucidworks.com/2011/12/28/why-not-and-or-and-not/. > > With appropriate parentheses it can give the same results as you're > discoveri

Re: Need help with query syntax

2017-08-10 Thread Dave
Eric you going to vegas next month? > On Aug 10, 2017, at 7:38 PM, Erick Erickson wrote: > > Omer: > > Solr does not implement pure boolean logic, see: > https://lucidworks.com/2011/12/28/why-not-and-or-and-not/. > > With appropriate parentheses it can give the same results as you're > discov

Re: Need help with query syntax

2017-08-10 Thread Erick Erickson
Omer: Solr does not implement pure boolean logic, see: https://lucidworks.com/2011/12/28/why-not-and-or-and-not/. With appropriate parentheses it can give the same results as you're discovering. Best Erick On Thu, Aug 10, 2017 at 3:00 PM, OTH wrote: > Thanks for the help! > That's resolved

Re: Need help with query syntax

2017-08-10 Thread OTH
Thanks for the help! That's resolved the issue. On Fri, Aug 11, 2017 at 1:48 AM, David Hastings < hastings.recurs...@gmail.com> wrote: > type:value AND (name:america^1+name:state^1+name:united^1) > > but in reality what you want to do is use the fq parameter with type:value > > On Thu, Aug 10, 20

Re: Need help with query syntax

2017-08-10 Thread David Hastings
type:value AND (name:america^1+name:state^1+name:united^1) but in reality what you want to do is use the fq parameter with type:value On Thu, Aug 10, 2017 at 4:36 PM, OTH wrote: > Hello, > > I have the following use case: > > I have two fields (among others); one is 'name' and the other is 'typ

Re: Need help with Query Syntax

2017-04-17 Thread OTH
I tried that, but it returned no results. I understand now that the issue is that since the field has been tokenized - searching for "*san\ *" will try to search for individual tokens which contain the string sequence "san ", and so of course it won't find any. I think I've found another workaround

Re: Need help with Query Syntax

2017-04-17 Thread Mikhail Khludnev
This can be done with escaping space select?q=field:*san\ * Probably sow=false in new version might also helo On Mon, Apr 17, 2017 at 4:42 PM, OTH wrote: > If I submit the query: > "select?q=field:*san*" > Then it works as expected; returning all values in the field which contain > the string

Re: Need help with Query Syntax

2017-04-17 Thread OTH
Ok. What analyzer / fieldtype should I use to be able to search across tokens? Basically, I'm just trying to replicate the functionality of the AnalyzingInfixLookupFactor Suggester, but I need to do it using a regular index, because I need to utilize multiple fields using edismax bq, which seems t

Re: Need help with Query Syntax

2017-04-17 Thread Binoy Dalal
Use the analyser available in the solr admin console to find out exactly how your query is analysed. That should give you a lot more information. On Mon 17 Apr, 2017, 21:58 OTH, wrote: > Ok, I get it now, it's because the field has been indexed as tokens. So > maybe I should use a field which d

Re: Need help with Query Syntax

2017-04-17 Thread OTH
Ok, I get it now, it's because the field has been indexed as tokens. So maybe I should use a field which does not have a tokenizer index? I'll try something like that. Thanks On Mon, Apr 17, 2017 at 9:16 PM, OTH wrote: > The field type is "text_general". > > On Mon, Apr 17, 2017 at 7:15 PM, B

Re: Need help with Query Syntax

2017-04-17 Thread OTH
The field type is "text_general". On Mon, Apr 17, 2017 at 7:15 PM, Binoy Dalal wrote: > I think it returns everything because your query matches *san or " *". > What is your field type definition? > > On Mon 17 Apr, 2017, 19:12 OTH, wrote: > > > If I submit the query: > > "select?q=field:*san*

Re: Need help with Query Syntax

2017-04-17 Thread Binoy Dalal
I think it returns everything because your query matches *san or " *". What is your field type definition? On Mon 17 Apr, 2017, 19:12 OTH, wrote: > If I submit the query: > "select?q=field:*san*" > Then it works as expected; returning all values in the field which contain > the string "san". >

Re: Need help with auto-suggester

2017-04-15 Thread OTH
I see, thanks. So I"m just using a string field to store the JSON. On Sat, Apr 15, 2017 at 11:15 PM, Walter Underwood wrote: > Sorry, that was formatted. The quotes are actually escaped, like this: > > {"term":"microsoft office","weight":14,"payload":"{\"count\": > 1534255, \"id\": \"microsoft

Re: Need help with auto-suggester

2017-04-15 Thread Walter Underwood
Sorry, that was formatted. The quotes are actually escaped, like this: {"term":"microsoft office","weight":14,"payload":"{\"count\": 1534255, \"id\": \"microsoft office\"}”} wunder Walter Underwood wun...@wunderwood.org http://observer.wunderwood.org/ (my blog) > On Apr 15, 2017, at 10:40 AM,

Re: Need help with auto-suggester

2017-04-15 Thread Walter Underwood
JSON does not have a binary data type, so true BLOBs are not possible in JSON. Sorry, I wasn’t clear. The payload I use is JSON in a string. It looks like this: suggest: { skill_names_infix: { m: { numFound: 10, suggestions: [ { term: "microsoft office", weight: 14, payload: "{"count": 1534255,

Re: Need help with auto-suggester

2017-04-15 Thread OTH
Hi - just wondering, what would be the difference between using a blob / binary field to store the JSON rather than simply using a string field? Thanks On Sat, Apr 15, 2017 at 2:50 AM, Walter Underwood wrote: > We recently needed multiple values in the payload, so I put a JSON blob in > there. I

Re: Need help with auto-suggester

2017-04-14 Thread OTH
Great! That's what I was about to resort to do, but thanks for the confirmation! On Sat, Apr 15, 2017 at 2:50 AM, Walter Underwood wrote: > We recently needed multiple values in the payload, so I put a JSON blob in > there. It comes back as a string, so you have to decode that JSON > separately

Re: Need help with auto-suggester

2017-04-14 Thread Walter Underwood
We recently needed multiple values in the payload, so I put a JSON blob in there. It comes back as a string, so you have to decode that JSON separately. Otherwise, it was a pretty clean solution. wunder Walter Underwood wun...@wunderwood.org http://observer.wunderwood.org/ (my blog) > On Apr

Re: Need help with auto-suggester

2017-04-14 Thread OTH
Thanks, that works! But is it possible to have multiple payloadFields? On Sat, Apr 15, 2017 at 1:23 AM, Marek Tichy wrote: > Utilize the payload field. > > I don't need to search multiple fields; I need to search just one field > but > > get the corresponding values from another field as well.

Re: Need help with auto-suggester

2017-04-14 Thread Marek Tichy
Utilize the payload field. > I don't need to search multiple fields; I need to search just one field but > get the corresponding values from another field as well. > I.e. if a user is searching for cities, I wouldn't need the countries to > also be searched. However, when the list of cities is dis

Re: Need help with auto-suggester

2017-04-14 Thread OTH
I don't need to search multiple fields; I need to search just one field but get the corresponding values from another field as well. I.e. if a user is searching for cities, I wouldn't need the countries to also be searched. However, when the list of cities is displayed, I need their corresponding

Re: Need help with auto-suggester

2017-04-13 Thread Binoy Dalal
You can create a copy field and copy to it from all the fields you want to retrieve the suggestions from and then use that field with the suggester. On Thu 13 Apr, 2017, 23:21 OTH, wrote: > Hello, > > I've followed the steps here to set up auto-suggest: > https://lucidworks.com/2015/03/04/solr-s

Re: Need help with date boost

2017-03-14 Thread Erick Erickson
Rick: Hmmm, try this: https://cwiki.apache.org/confluence/display/solr/Function+Queries. It's not quite as explicit, but it's the latest document. Essentially that's what the function on that page does, something like: "recip(rord (creationDate),1,1000,1000)" the "recip" function is actually rec

  1   2   3   4   >