how to get current timestamp

2018-08-16 Thread Midas A
Hi, i my use case i want to get current timestamp in response of solr query. how can i do it . is it doable ? Regards, Midas

Solr core corrupted for version 7.4.0, please help!

2018-08-16 Thread Michael Hu (CMBU)
Environment: * solr 7.4.1 * all cores are vanilla cores with "loadOnStartUp" set to false, and "transient" set to true * we have about 75 cores with "transientCacheSize" set to 32 Issue: we have core corruption from time to time (2-3 core corruption a day) How to reproduce: *

Re: Multi-word Synonyms - how does sow parameter work?

2018-08-16 Thread Roy Lim
Thanks Andrea for the tip. I wasn't aware of the autoGeneratePhraseQueries option for text fields, will definitely keep it in mind. But I question if this is related to the fix on the query parser which essentially introduces sow parameter and if false (looks like that is the default in Solr 7),

Re: Metrics for a healthy Solr cluster

2018-08-16 Thread Jan Høydahl
Check out the Reference Guide chapter on monitoring with open source Prometheus and Grafana. https://lucene.apache.org/solr/guide/7_4/monitoring-solr-with-prometheus-and-grafana.html You'll get a nice da

Re: 4.10 default ranking scorer, BM25 or classic? How to change that?

2018-08-16 Thread Erick Erickson
Does debug=true show you that the scores are, indeed, computed exactly the same? It could simply be that how you index doesn't contain the data you need to see a difference. If you're searching on string fields for instance, there isn't much "there there". What I'd do is work from a stand-alone i

Re: Metrics for a healthy Solr cluster

2018-08-16 Thread Emir Arnautović
Hi, If you are up to ready-to-go Solr monitoring, you can check out Sematext’s Solr integration: https://sematext.com/integrations/solr-monitoring/ Thanks, Emir -- Monitoring - Log Management - Alerting - Anomaly Detection Solr & Elasticsearch

4.10 default ranking scorer, BM25 or classic? How to change that?

2018-08-16 Thread Wei Zhao
Hi, Does anyone know what the default scorer for 4.10 is? BM25 or classic tf-idf? I have been trying to change that, in cloud mode. I have managed to change the schema.xml in the zookeeper to add the following lines: The commented line was also tried. So I have tried different syntax, usin

RE: Searching by dates

2018-08-16 Thread Markus Jelsma
Hello Christopher, We have a library whose soul purpose it is to extract, parse and validate dates found in free text, in all major world languages (and many more) and every in thinkable format/notation. It can also deal with times, timezones (resolve them back to UTC), different eras (e.g. Bud

Re: Searching by dates

2018-08-16 Thread Shawn Heisey
On 8/16/2018 9:20 AM, Christopher Schultz wrote: > Hmm. I could have sworn the documentation I read in the past (maybe as > long as 3-4 months ago) indicated that date+timestamp was necessary. > Maybe that was just for the index, while the searches can be partial. DateRangeField was introduced fou

Re: Type ahead functionality using complex phrase query parser

2018-08-16 Thread Gus Heck
Yes, that's a common strategy, and it's also fairly common to index two (or more) versions of the field, with different tokenizations (or not tokenized) if there is a need to perform different types of search the field. This duplication can be acheived either with in the schema, CloneFieldUpdateRe

Re: Searching by dates

2018-08-16 Thread Alexandre Rafalovitch
You could have PatternReplace in your field definition either as a CharFilter or a TokenFilter. See: http://www.solr-start.com/info/analyzers/ Regards, Alex. On 16 August 2018 at 11:20, Christopher Schultz wrote: > Shawn, > > On 8/16/18 10:37 AM, Shawn Heisey wrote: >> On 8/16/2018 7:48 AM, C

Re: Solr changing the search when given many qf fields?

2018-08-16 Thread Aaron Gibbons
Thank you Emir! This was certainly the case. One field was processed with EdgeNGramTokenizerFactory and should not have been. Fixed. On Thu, Aug 16, 2018 at 4:46 AM, Emir Arnautović < emir.arnauto...@sematext.com> wrote: > Hi Aaron, > It is probably not about number of fields but related to diffe

Solr Response Post Processing Plugin info Request.

2018-08-16 Thread Vipin Dwivedi
Hi, I was going through online documentation to find if there is any way I can try to solve my use case while using solr for my document search. My Use case is like this .. 1. Loaded bunch of document in solr lets say 5Mil. 2. Client can search these documents with filters via standa

Metrics for a healthy Solr cluster

2018-08-16 Thread Greenhorn Techie
Hi, Solr provides numerous JMX metrics for monitoring the health of the cluster. We are setting up a SolrCloud cluster and hence wondering what are the important parameters / metrics to look into, to ascertain that the cluster health is good. Obvious things comes to my mind are CPU utilisation and

Re: Searching by dates

2018-08-16 Thread Christopher Schultz
Shawn, On 8/16/18 10:37 AM, Shawn Heisey wrote: > On 8/16/2018 7:48 AM, Christopher Schultz wrote: >> I haven't actually tried this, yes, but from the docs I'm guessing that >> I can't search for a DOB using e.g. 2018-08-16 but instead I need to >> search using 2018-08-16T00:00:00 plus maybe "Z" a

Re: Searching by dates

2018-08-16 Thread Alexandre Rafalovitch
However, you probably will still need to convert your dates into strings as well to match people's search expectation, as the date fields do not store _english_ month names internally. So, you will want to have a secondary field that expands 2018-02-31 into "February 2018" (and "Feb 2018"?) includ

Re: Searching by dates

2018-08-16 Thread Shawn Heisey
On 8/16/2018 7:48 AM, Christopher Schultz wrote: > I haven't actually tried this, yes, but from the docs I'm guessing that > I can't search for a DOB using e.g. 2018-08-16 but instead I need to > search using 2018-08-16T00:00:00 plus maybe "Z" at the end for the TZ. > > No user is ever going to do

Searching by dates

2018-08-16 Thread Christopher Schultz
All, My understanding is that Solr (really Lucene) only handles temporal data using full timestamps (date+time, always UTC). I have a use-case where I'd like to store and search for people by their birth dates, so the timestamp information is not relevant for me. I haven't actually tried this, ye

Re: Please subscribe me to solr -user forum

2018-08-16 Thread Steve Rowe
To subscribe, send an email to: solr-user-subscr...@lucene.apache.org -- Steve www.lucidworks.com > On Aug 16, 2018, at 7:09 AM, Arumugam, Senthil Kumar > wrote: > >

Please subscribe me to solr -user forum

2018-08-16 Thread Arumugam, Senthil Kumar

Re: Solr changing the search when given many qf fields?

2018-08-16 Thread Emir Arnautović
Hi Aaron, It is probably not about number of fields but related to different analysis of different fields. As long as all your fields analyzers produce the same tokens you should get “term centric” query. Once any of your analyzers produce different token, it’ll become “field centric”. It is lik

Re: Multi-word Synonyms - how does sow parameter work?

2018-08-16 Thread Andrea Gazzarini
Hi Roy, I think you miss the autoGeneratePhraseQueries=true in the field type definition. I was on a slightly different use case when I met your same issue (I was using synonyms expansion at query time) and honestly I didn't understand why this is not the default and implicit behavior. In other