Solr index clearing

2018-09-24 Thread Bineesh
Team, We use solr 7.3.1 and Nucth 1.15. I created two collections in solr and data successfully indexed from Nutch after crawling. Up on the third collection index in solr, i see that first collecion indexed data automatically clears.Pls suggest -- Sent from: http://lucene.472066.n3.nabble.com

Re: Solr Import

2018-09-24 Thread Yasufumi Mizoguchi
Hi, I do not have a good idea about No. 1, but No. 2 is clear. > 2. Delta indexing of xml file. > We would be provided with an xml file and that would be imported to Solr > using full-import during the first import. Subsequently we would be > provided with changes made to the xml file (will be pr

Re: Metrics

2018-09-24 Thread Erick Erickson
The other caches (filterCache, queryResultCache) only have meaning for the current searcher opened. Whenever a soft or hard-commit-with-opensearcher-true, those caches are all reset to 0 and stats start accumulating until the _next_ commit. So depending on when you look you might see a cache that's

Re: Metrics

2018-09-24 Thread Jean-Marc Spaggiari
It might be similar to the other cache.. Do you have any pointer the the LRUCache documentation? I want to see what kind of metrics it uses and see if it's similar or not to solr/core/src/java/org/apache/solr/core/HdfsDirectoryFactory.java,,, Le lun. 24 sept. 2018 à 18:04, Shawn Heisey a écrit :

Re: Metrics

2018-09-24 Thread Shawn Heisey
On 9/24/2018 3:43 PM, Jean-Marc Spaggiari wrote: Thanks for taking a look. My indexes are on HDFS. And I configured all the solr parameters for that. The "shard page" is when I click on a SOLR server to go to the UI, then in the dropdown on the left I select a shard (a leader one), then I click o

Re: Metrics

2018-09-24 Thread Jean-Marc Spaggiari
Hi Shawn, Thanks for taking a look. My indexes are on HDFS. And I configured all the solr parameters for that. The "shard page" is when I click on a SOLR server to go to the UI, then in the dropdown on the left I select a shard (a leader one), then I click on "plugins/stats". And then I open "Hdfs

Re: Metrics

2018-09-24 Thread Shawn Heisey
On 9/24/2018 2:05 PM, Jean-Marc Spaggiari wrote: I'm running a fairly old version of SOLR (4.x) and I found the metrics on the shard page. However, sometimes there is numbers, sometimes it's all 0. Just hitting the refresh button shows this. I'm aware of https://issues.apache.org/jira/browse/SOL

Metrics

2018-09-24 Thread Jean-Marc Spaggiari
Hi, I'm running a fairly old version of SOLR (4.x) and I found the metrics on the shard page. However, sometimes there is numbers, sometimes it's all 0. Just hitting the refresh button shows this. I'm aware of https://issues.apache.org/jira/browse/SOLR-10214

[ANNOUNCE] Solr Reference Guide for 7.5 released

2018-09-24 Thread Cassandra Targett
The Lucene PMC is pleased to announce that the Solr Reference Guide for Solr 7.5 is now available. This 1,389 page PDF is the definitive guide to Apache Solr, the search server built on Apache Lucene. The PDF can be downloaded from: https://www.apache.org/dyn/closer.cgi/lucene/solr/ref-guide/apac

Re: checksum failed (hardware problem?)

2018-09-24 Thread Susheel Kumar
Got it. I'll have first hardware folks check and if they don't see/find anything suspicious then i'll return here. Wondering if any body has seen similar error and if they were able to confirm if it was hardware fault or so. Thnx On Mon, Sep 24, 2018 at 1:01 PM Erick Erickson wrote: > Mind you

Re: checksum failed (hardware problem?)

2018-09-24 Thread Erick Erickson
Mind you it could _still_ be Solr/Lucene, but let's check the hardware first ;) On Mon, Sep 24, 2018 at 9:50 AM Susheel Kumar wrote: > > Hi Erick, > > Thanks so much for your reply. I'll now look mostly into any possible > hardware issues than Solr/Lucene. > > Thanks again. > > On Mon, Sep 24, 20

Re: checksum failed (hardware problem?)

2018-09-24 Thread Susheel Kumar
Hi Erick, Thanks so much for your reply. I'll now look mostly into any possible hardware issues than Solr/Lucene. Thanks again. On Mon, Sep 24, 2018 at 12:43 PM Erick Erickson wrote: > There are several of reasons this would "suddenly" start appearing. > 1> Your disk went bad and some sector

Re: checksum failed (hardware problem?)

2018-09-24 Thread Erick Erickson
There are several of reasons this would "suddenly" start appearing. 1> Your disk went bad and some sector is no longer faithfully recording the bits. In this case the checksum will be wrong 2> You ran out of disk space sometime and the index was corrupted. This isn't really a hardware problem. 3> Y

Re: Is there an easy way to compare schemas?

2018-09-24 Thread Shawn Heisey
On 9/24/2018 9:28 AM, Michael Joyner wrote: Is there an easy way to compare schemas? When upgrading nodes, we are wanting to compare the "core" and "automatically mapped" data types between our existing schema and the new manage-schema available as part of the upgraded distrubtion. There is

checksum failed (hardware problem?)

2018-09-24 Thread Susheel Kumar
Hello, I am still trying to understand the corrupt index exception we saw in our logs. What does the hardware problem comment indicates here? Does that mean it caused most likely due to hardware issue? We never had this problem in last couple of months. The Solr is 6.6.2 and ZK: 3.4.10. Please

Re: Is there an easy way to compare schemas?

2018-09-24 Thread Alexandre Rafalovitch
I think the easiest would be to create two instances using those schemas and then see what comes back from schema API: http://lucene.apache.org/solr/guide/7_4/schema-api.html#retrieve-schema-information That will give you the outputs in the consistent format, you can just run diff on. However, if

Is there an easy way to compare schemas?

2018-09-24 Thread Michael Joyner
Is there an easy way to compare schemas? When upgrading nodes, we are wanting to compare the "core" and "automatically mapped" data types between our existing schema and the new manage-schema available as part of the upgraded distrubtion.

Re: Query with exact number of tokens

2018-09-24 Thread Sergio García Maroto
Thanks all for your ideas. It was very useful information. On Fri, 21 Sep 2018 at 19:04, Jan Høydahl wrote: > I have made a FieldType specially for this > https://github.com/cominvent/exactmatch/ < > https://github.com/cominvent/exactmatch/> > > -- > Jan Høydahl, search solution architect > Comi

Solr Import

2018-09-24 Thread Sebastian Aswin
Hi Experts, Good Day! We are having Solr 7.4 installed in our premise and we are planning to do indexing of xml file. I am using data import handler to do the indexing, but I had few queries on the indexing. 1. Within a doc tag, there are multiple store, but the Solr response contains only one *s

[ANNOUNCE] Apache Solr 7.5.0 released

2018-09-24 Thread jim ferenczi
24 September 2018, Apache Solr™ 7.5.0 available The Lucene PMC is pleased to announce the release of Apache Solr 7.5.0 Solr is the popular, blazing fast, open source NoSQL search platform from the Apache Lucene project. Its major features include powerful full-text search, hit highlighting, facet