Re: Solr config upgrade tool

2017-08-11 Thread Hrishikesh Gadre
Interesting. This is certainly useful. I was also thinking about having a tool which can setup a Solr server of intended version and test out the upgraded configuration. The validity of configuration files can be checked by creating a Solr collection (or core) and verifying that it is loaded succe

Re: Fetch a binary field

2017-08-11 Thread Dave
Why didn't you set it to be indexed? Sure it would be a small dent in an index > On Aug 11, 2017, at 5:20 PM, Barbet Alain wrote: > > Re, > I take a look on the source code where this msg happen > https://github.com/apache/lucene-solr/blob/master/solr/core/src/java/org/apache/solr/schema/SchemaF

Re: Fetch a binary field

2017-08-11 Thread Barbet Alain
Re, I take a look on the source code where this msg happen https://github.com/apache/lucene-solr/blob/master/solr/core/src/java/org/apache/solr/schema/SchemaField.java#L186 I use version 6.5 who differ from master. In 6.5: if (! (indexed() || hasDocValues()) ) { As my field is not indexed (and has

Re: How to boost entire json document on top of results

2017-08-11 Thread Abhijit Pawar
Yes...That's true for now I can sort based on that field but was wondering how index time boost really works at the document level for JSON documents indexed using an DataImportHandler. Thanks Eric! Regards, Abhijit On Fri, Aug 11, 2017 at 1:50 PM, Erick Erickson wrote: > Well, you have

RE: Solr config upgrade tool

2017-08-11 Thread Davis, Daniel (NIH/NLM) [C]
Hrishikesh Gadre, I'm interested in how that might integrate with continuous integration. I briefly worked on a tool to try a configuration out with SolrCloud, e.g. upload the config, create a collection, run some stuff, test some stuff. I got the first two working, but not the "run some stuf

Solr config upgrade tool

2017-08-11 Thread Hrishikesh Gadre
Hi, I am currently working on a tool to identify (and in some cases fix) the incompatibilities in the Solr configuration (e.g. schema.xml, solrconfig.xml etc.) between major versions of Solr. My goal is to simplify the Solr upgrade process by providing upgrade instructions tailored to your config

Re: How to boost entire json document on top of results

2017-08-11 Thread Erick Erickson
Well, you have to _do_ something with the field. And you don't particularly want to do document boosting at index time in the first place as this has been removed recently IIRC. Note this is different than just putting a _value_ in some field you _use_ for boosting.. Anyway, you state: "I woul

Re: missing documents after restart

2017-08-11 Thread Erick Erickson
Thanks for closing this out, I was breaking out in hives ;) Erick On Fri, Aug 11, 2017 at 11:31 AM, John Blythe wrote: > Looks like part of our nightly processing was restarting the solr server > before all indexing was done bc of using a blunt object approach of doing > so at designated times,

Re: missing documents after restart

2017-08-11 Thread John Blythe
Looks like part of our nightly processing was restarting the solr server before all indexing was done bc of using a blunt object approach of doing so at designated times, doh! On Tue, Aug 8, 2017 at 9:35 PM John Blythe wrote: > Thanks Erick. I don't think all of those ifs are in place. Must be >

How to boost entire json document on top of results

2017-08-11 Thread Abhijit Pawar
Hi, I am working on a scenario trying to boost certain documents while indexing over other documents. I am using a DataImportHandler to import JSON documents from a MongoDB datasource. Here's my data-source-config file :

Re: Soft commit uploading datas cant search on website

2017-08-11 Thread Erick Erickson
First, if you specify commit it's doing a hard commit with openSearcher=true by default so the softCommit isn't necessary here. I'd do one or the other, as it's possible that Solr is stopping at the first one. bq: when i do the hardcommit manually . then its shows the result on website. I don't k

Re: Need help with query syntax

2017-08-11 Thread Erick Erickson
Yep.. On Fri, Aug 11, 2017 at 6:31 AM, OTH wrote: > Hi, thanks for sharing the article. > > On Fri, Aug 11, 2017 at 4:38 AM, Erick Erickson > wrote: > >> Omer: >> >> Solr does not implement pure boolean logic, see: >> https://lucidworks.com/2011/12/28/why-not-and-or-and-not/. >> >> With appropri

RE: Token "states" not getting lemmatized by Solr?

2017-08-11 Thread Markus Jelsma
I checked our English analyzer using KStemFilter. To my surprise, both united and states are not affected by the filter. Regards, Markus -Original message- > From:Ahmet Arslan > Sent: Thursday 10th August 2017 21:57 > To: solr-user@lucene.apache.org > Subject: Re: Token "states" not

Solr Keyword search across docs?

2017-08-11 Thread Aaron Gibbons
I'm trying to produce a search that would optionally join the contents of 2 documents then allow a keyword search on them as if it were a single doc. For example I'd have Person index and a Note index. I want to search the person document combined with the notes for keywords A AND B AND C. A and

Re: Different order of docs between SOLR-4.10.4 to SOLR-6.5.1

2017-08-11 Thread Shawn Heisey
On 8/11/2017 2:52 AM, SOLR4189 wrote: > Yes, only because I'm seeing different results. > > For example, changing *WordDelimiterFilterFactory *to > *WordDelimiterGraphFilterFactory * can change order of docs? ( > http://lucene.apache.org/core//6_5_1/analyzers-common/index.html?deprecated-list.html

Re: solr commit is taking time

2017-08-11 Thread Shawn Heisey
On 8/11/2017 4:16 AM, Midas A wrote: > our solr commit is taking time > > 10.20.73.92 - - [11/Aug/2017:15:44:00 +0530] "POST > /solr/##/update?wt=javabin&version=2 HTTP/1.1" 200 - 12594 What should > i check ? https://wiki.apache.org/solr/SolrPerformanceProblems#Slow_commits Thanks, Shawn

Fetch a binary field

2017-08-11 Thread Barbet Alain
Hi ! I've a Lucene base coming from a C++ program linked with Lucene++, a port of Lucene 3.5.9. When I open this base with Luke, it show Lucene 2.9. Can see a binary field I have in Luke, with data encoded in base64. I have upgrade this base from 2.9 => 4.0 => 5.0 =>6.0 so I can use it with Sol

Re: Need help with query syntax

2017-08-11 Thread OTH
Hi, thanks for sharing the article. On Fri, Aug 11, 2017 at 4:38 AM, Erick Erickson wrote: > Omer: > > Solr does not implement pure boolean logic, see: > https://lucidworks.com/2011/12/28/why-not-and-or-and-not/. > > With appropriate parentheses it can give the same results as you're > discoveri

QueryParser changes query by itself

2017-08-11 Thread Bernd Fehling
We just noticed a very strange problem with Solr 6.4.2 QueryParser. The QueryParser changes the query by itself from time to time. This happens if doing a search request reload several times at higher rate. Good example: ... textth:waffenhandel ... textth:waffenhandel textth:waffenhandel +Syn

Soft commit uploading datas cant search on website

2017-08-11 Thread Abdul Ekfhy
I configure the softcommit in solrconfig.xml, and when i add a new entry(example : solrtest) from website and run below commit url "http://192.168.2.10:8983/solr/goods/update?softCommit=true&commit=true " when i run this and check on the query keyword:solrtest its shows the entry on xml format a

Re: Solr LTR with high rerankDocs

2017-08-11 Thread Sebastian Klemke
Hi On Do, 2017-08-10 at 08:30 -0700, Erick Erickson wrote: > I have to confess that I know very little about the mechanics of LTR, but > I can talk a little bit about compression. > > When a stored values is retrieved for a document it is read from the > *.fdt file which is a compressed, verbatim

solr commit is taking time

2017-08-11 Thread Midas A
Hi all our solr commit is taking time 10.20.73.92 - - [11/Aug/2017:15:44:00 +0530] "POST /solr/##/update?wt=javabin&version=2 HTTP/1.1" 200 - 12594 What should i check ?

Re: Different order of docs between SOLR-4.10.4 to SOLR-6.5.1

2017-08-11 Thread SOLR4189
Yes, only because I'm seeing different results. For example, changing *WordDelimiterFilterFactory *to *WordDelimiterGraphFilterFactory * can change order of docs? ( http://lucene.apache.org/core//6_5_1/analyzers-common/index.html?deprecated-list.html