Solr Index Data will be delete if state.json did not exists

Hi guys, Currently I am running a 2 nodes cloud of Solr 7.5, I already have a collection named A and it worked fine with 20GB index Data, while I want to create a collection named B and want to copy index data from A. So in Solr5.5, I just copy index folder from A and renamed to B. restart solr cl

Re: [solr-index]Can I do a lot of analysis on one field at the time of indexing?

I’m heading out on vacation for about a week and half, not sure I’ll have time. Start with the discussion in this mail thread. http://lucene.472066.n3.nabble.com/Running-an-analyzer-chain-in-an-update-request-processor-td4384207.html

[solr-search] I wonder if it is possible to sort by group in the group function.

Hello The current group function is used to output each group separately. I wonder if you can sort by group differently. If the group does not have a feature, is there another way to achieve similar results? Thank you. Ex) http://local.interpark.com:8983/solr/test7/select?q=*:*

RE: [solr-index]Can I do a lot of analysis on one field at the time of indexing?

WalterUnderwood, thank you for your reply. If you can afford the time, can you give us a specific sample of the proposed method? Thank you. -Original Message- From: Walter Underwood Sent: Friday, December 14, 2018 12:11 PM To: solr-user@lucene.apache.org Subject: Re: [solr-index]Can I

Re: Soft commit and new replica types

> > > > No, I am not seeing reloads. Ah, good. > > I am trying to understand the interactions > > between hard commit, soft commit, transaction log update with a TLOG > > cluster for both leader and follower replicas. For example, after getting > > new segments from the leader the follower repli

Re: Error waiting for SolrCore to be created

So I don't know what to recommend except rebooting. Solr (actually, Lucene) would _not_ delete that file without replacing it. There is a great deal of care taken to insure that the index is consistent and I haven't heard of the segments file disappearing by itself, some external process is very l

Re: [solr-index]Can I do a lot of analysis on one field at the time of indexing?

Right, no feature that does that for you. You should be able to code that with an update request processor script. You can fetch an analyzer chain, run it, add the results to a field, then do that again. I have one that runs a chain with minhash then saves the hex values of the hashes to a field.

Re: Increasing Fault Tolerance of SOLR Cloud and Zookeeper

bq. will the leader still report that there were two followers, even if one of them bounced I really can't say, I took the ZK folks' at their word and upgraded. I should think that restarting your ZK nodes should reestablish that they are all talking to each other, you may need to restart your So

Re: [solr-index]Can I do a lot of analysis on one field at the time of indexing?

In a word, "no". A field can have exactly one tokenizer, and there are no conditional filters. You can copyField to multiple individual fields and treat each one of those differently, i.e. copy from title to title1, title2 etc. where each one has a different analysis chain. Best, Erick On Thu, Dec

[solr-index]Can I do a lot of analysis on one field at the time of indexing?

Hello I have a question about index schemas. 1) Can I do various analysis on one field? For example, you can analyze the 'title' field with multiple tokenizers, and merge the analysis into a single field. 2) You can collect multiple fields in one field using 'copyField' function. However, severa

[solr-search] I wonder if it is possible to sort by group in the group function.

Hello The current group function is used to output each group separately. I wonder if you can sort by group differently. If the group does not have a feature, is there another way to achieve similar results? Thank you. Ex) http://local.interpark.com:8983/solr/test7/select?q=*:*

Re: Increasing Fault Tolerance of SOLR Cloud and Zookeeper

Thanks for the help Erick. This is an external zookeeper, running on three separate AWS instances separate from the instances hosting SOLR. I think I have some more insight based on the bug you sent and some more log crawling. In October we had an instance retirement, wherein the instance was aut

terms not to match in a search query

Hi, If there are certain terms in the query like "pvt", "ltd" which I wouldn't want to be matched against the index, is there a way to specify the list of words that I could set in the configuration and not make it part of the query. Say, is it possible to add the terms to stopwords.txt or any o

Re: Error waiting for SolrCore to be created

@Erick Erickson Thanks for your feedback and support. segments* file is missing from /solr/solr-6.4.1/server/solr/coreStore_shard1_replica1/data/index directory. Erick: Is that directory the one you expect for that replica? This is a sanity check, as there's no reason it would change magically.

RE: Soft commit and new replica types

bq. , after getting new segments from the leader the follower replica will still apply the hard/soft commit? As was described in one of the videos below, follower tlog replica look for max docid in received new segments and purge its transaction log of older records. Than it starts new searcher

Re: Post/Get API call for Solr results differ from web query

I found the issue. The single quotes in the request params were set to empty and require to be escaped with a '\'. Python instead of throwing an error message was simply concatenating the string which is a poor design. Below payload yields the same results as the web request in the solr portal. p

Re: Post/Get API call for Solr results differ from web query

Hi I don't see what the actual problem is here. What were you expecting to see in the response, and what do you see? Please try to reproduce the issue you think you are seeing with a tool like cURL, you can issue both POST and GET requests with cURL and many other tools. The result should be ex

Post/Get API call for Solr results differ from web query

Hi, I have a python scraper to query the solr index and get the top 'n' results and process further. What I see is with the setting of the bq parameter which has a lot of special chars, the output from the python call differs from the results I get from the query issued in the web Solr portal. I

Re: Soft commit and new replica types

Hi Tomás, No, I am not seeing reloads. I am trying to understand the interactions between hard commit, soft commit, transaction log update with a TLOG cluster for both leader and follower replicas. For example, after getting new segments from the leader the follower replica will still apply the ha

Re: Solr recovery issue in 7.5

Yeah, this is weird. First of all, recovery shouldn't take much memory even if it's a full recovery, it's just file copies. And there shouldn't be any problem with the leadership changing, that should _not_ require a replication. Your autocommit max time is a bit worrisome. You have docs hanging

Re: Increasing Fault Tolerance of SOLR Cloud and Zookeeper

Updates are disabled means that at least two of your three ZK nodes are unreachable, which is worrisome. First: That error is coming from Solr, but whether it's a Solr issue or a ZK issue is ambiguous. Might be explained if the ZK nodes are under heavy load. Question: Is this an external ZK ensemb

Re: Error waiting for SolrCore to be created

Caused by: org.apache.lucene.index.IndexNotFoundException: no segments* file found in LockValidatingDirectoryWrapper(MetricsDirectory(NRTCachingDirectory(MMapDirectory@/solr/solr-6.4.1/server/solr/coreStore_shard1_replica1/data/index segments* is what's used to indicate what segments are available

Re: disable auto-commit

On 13/12/18 16:48, Mikhail Khludnev wrote: solr.log.9:2018-12-13 09:35:31.921 INFO (recoveryExecutor-9-thread-1-processing-x:COSBIBioIndex) [ x:COSBIBioIndex] o.a.s.u.DirectUpdateHandler2 start commit{flags=2,optimize=false,openSearcher=true,waitSearcher=true,expungeDeletes=false,softCommit=fal

Re: disable auto-commit

solr.log.9:2018-12-13 09:35:31.921 INFO (recoveryExecutor-9-thread-1-processing-x:COSBIBioIndex) [ x:COSBIBioIndex] o.a.s.u.DirectUpdateHandler2 start commit{flags=2,optimize=false,openSearcher=true,waitSearcher=true,expungeDeletes=false,softCommit=false,prepareCommit=false} so,recovery have been

Error waiting for SolrCore to be created

Thanks in advance. We have Apache Solr version 6.4.1 installed and configured on Red Hat Enterprise Linux Server release 7.5 and Java is 1.8.0_181. Command to start solr is bin/solr start -c -m 15g It was working till yesterday. We had to reboot server hardware maintenance activity and post rebo

Geofilt and distance measurement problems using SpatialRecursivePrefixTreeFieldType field type

I am currently using Solr 5.5.2 and implementing a GeoSpatial search that returns results within a radius in Km of a specified LatLon. Using a field of type solr.LatLonType and a geofilt query this gives good results but is much slower than our regular queries. Using a bbox query is faster but o

Re: disable auto-commit

On 13/12/18 10:29, Mikhail Khludnev wrote: Do you have any idea of why this happens? One just commit it every time, or send, append commitWithin param. Can you grep logs for 'commit' word occurrence? Also it's possible to increase log verbosity for LogUpdateProcessor. here it is solr.lo

Re: disable auto-commit

> Do you have any idea of why this happens? One just commit it every time, or send, append commitWithin param. Can you grep logs for 'commit' word occurrence? Also it's possible to increase log verbosity for LogUpdateProcessor. On Thu, Dec 13, 2018 at 10:15 AM Danilo Tomasoni wrote: > Hello I