Delay in replication between cloud servers

2016-02-16 Thread Cool Techi
We are using solr cloud with 1 shard and replication factor as 3. We are noticing that the time for data to become available across all replicas from the leader is very high. The data rate is not very high, is there anyway to control this. In master-slave setup with give a replication time. Rega

RE: Delay in replication between cloud servers

2016-02-16 Thread Cool Techi
Further we have noticed that the delay increase a couple of hours after restart. Details related to sorlconfig.xml are given below, 15000 25000 false 1000 Regards,Rohit > From: cooltec...@outlook.com > To: solr-user@lucene.apache.org > Subject: Delay in replic

RE: Delay in replication between cloud servers

2016-02-21 Thread Cool Techi
Hi, Can someone point in the right direction to check this. Regards,Rohit > From: cooltec...@outlook.com > To: solr-user@lucene.apache.org > Subject: RE: Delay in replication between cloud servers > Date: Tue, 16 Feb 2016 22:16:23 +0530 > > Further we have noticed that the delay increase a coupl

Solr Cloud leader propagates slow to other nodes

2016-03-04 Thread Cool Techi
Hi, We are using solr 4.8.1 cloud and have a single shard core and 3 replicas in total. We are noticing the following issues, 1) Master propagates slow to to the other nodes/replicas.2) This increase over a period of time, i.e the data propagation time increase as the time from which leader is

RE: Solr Cloud leader propagates slow to other nodes

2016-03-04 Thread Cool Techi
Any suggestion here would be highly appreciated, this is hampering our production performance and we are not able to pin point any reason. > From: cooltec...@outlook.com > To: solr-user@lucene.apache.org > Subject: Solr Cloud leader propagates slow to other nodes > Date: Fri, 4 Mar 2016 18:16:

Search in URL

2014-03-28 Thread Cool Techi
Hi, We have several tweets stored in our system which are of the following nature, https://twitter.com/SharFairies/status/448992742257881088 I am searching for keywords like starcinema or abs-cbn.com, but these results are not returned, how can I search in this setup. My field type is defined

Fails to index if unique field has special characters

2014-04-10 Thread Cool Techi
Hi, We are migrating from Solr 4.6 standalone to Solr 4.7 cloud version, while reindexing the document we are getting the following error. This is happening when the unique key has special character, this was not noticed in version 4.6 standalone mode, so we are not sure if this is a version pro

RE: Fails to index if unique field has special characters

2014-04-11 Thread Cool Techi
BM!12345". The exclamation mark ('!') is critical here, as it > distinguishes the prefix used to determine which shard to direct the document > to." > > https://cwiki.apache.org/confluence/display/solr/Shards+and+Indexing+Data+in+SolrCloud > > > > > O

RE: Inconsistent response from Cloud Query

2014-05-14 Thread Cool Techi
We have noticed Solr returns in-consistent results during replica recovery and not all replicas are in the same state, so when your query goes to a replica which might be recovering or still copying the index then the counts may differ. regards,Ayush > Date: Tue, 6 May 2014 16:14:36 +0530 > Subj

Storing tweets For WC2014

2014-05-15 Thread Cool Techi
Hi, We have a requirement from one of our customers to provide search and analytics on the upcoming Soccer World cup, given the sheer volume of tweet's that would be generated at such an event I cannot imagine what would be required to store this in solr. It would be great if there can be some

Inconsistant result's on solr cloud 4.8

2014-07-16 Thread Cool Techi
Hi, We are using solr cloud with solr version 4.8, we have 2 shard/2 replica servers in Solr Cloud. During two consecutive request to the solr cloud, the "total results" number varies. 1) As per my understanding this can happen when the leader and the replica have inconsistant number of results

SolrCloud Issues

2014-07-17 Thread Cool Techi
Hi, We have moved to SolrCloud (version 4.8) and are facing several issues in this setup compared to the master/slave setup we have had for a while now, 1) We have a 2 shard set-up with one replica each, we notice that most of the time the replica's are in recovering status. What could be causing

RE: SolrCloud Issues

2014-07-17 Thread Cool Techi
ons when > under pressure. > > -Original Message- > From: Shawn Heisey [mailto:s...@elyograg.org] > Sent: 17 July 2014 14:25 > To: solr-user@lucene.apache.org > Subject: Re: SolrCloud Issues > > On 7/17/2014 6:57 AM, Cool Techi wrote: > > We have moved to SolrClo

Solr Result Tagging

2013-10-25 Thread Cool Techi
Hi, My search queries to solr are of the following nature, (A OR B OR C) OR (X AND Y AND Z) OR ((ABC AND DEF) - XYZ) What I am trying to achieve is when I fire the query the results returned should be able to tagged with which part or the OR resulted in the result. In case all three parts above

Faceting within groups

2013-12-07 Thread Cool Techi
Hi, I am not sure if faceting with groups is supported, the documents do seem to suggest it works, but cant seem to get the intended results. ("Amazon Cloud" OR ("IBM Cloud")sourceIdsentimenttruetrue Also, if it work's does solr cloud support it. Regards,Ayush

RE: Faceting within groups

2013-12-08 Thread Cool Techi
Any help here? > From: cooltec...@outlook.com > To: solr-user@lucene.apache.org > Subject: Faceting within groups > Date: Sat, 7 Dec 2013 14:00:20 +0530 > > Hi, > I am not sure if faceting with groups is supported, the documents do seem to > suggest it works, but cant seem to get the intended re

Unknow Query exception

2013-12-14 Thread Cool Techi
I am seeing the following exception in solr logs after regular intervals, we are not firing any query to have such error, what could be causing this? ERROR - 2013-12-14 05:35:52.722; org.apache.solr.common.SolrException; org.apache.solr.common.SolrException: org.apache.solr.search.Synt

Solr replicating at 5 mb/sec

2014-02-22 Thread Cool Techi
Hi, I am running solr replication between two machine which are connected by a 1 gb network speed. The best speed I am getting for replication is 5mb/sec, how can this be increased. The replication keeps failing and this is the first time replication of an index over 300Gb in size. We are using

Solr 4.3 Master/Slave Issues

2013-07-05 Thread Cool Techi
We have set up solr 4.3 with master/setup and are facing a couple of issues, Index locking, the index on slave hangs at time and when we restart the core the core get's locked up. I have checked the logs and there are no OOM error or anything else other than the error given below,Caused by: or

RE: Solr 4.3 Master/Slave Issues

2013-07-05 Thread Cool Techi
earlier which left the lock file in place > 2. You have more than one Solr core pointing to the same data directory > 3. A solr process is already running and you are trying to start > another one with the same config. > > On Fri, Jul 5, 2013 at 2:34 PM, Cool Techi wrote: > >

RE: Solr 4.3 Master/Slave Issues

2013-07-05 Thread Cool Techi
4.3 Master/Slave Issues > From: shalinman...@gmail.com > To: solr-user@lucene.apache.org > > On Fri, Jul 5, 2013 at 6:14 PM, Cool Techi wrote: > > > > 1) That was my initial suspicion, but when I run ps -aux | grep "java", but > > there it doesn'

Backup stops replication

2013-07-06 Thread Cool Techi
Hi, We migrated from solr 3.6 to solr 4.3, when we fire a backup command (/replication?command=backup&location=/disk4/backups ) on the salve the slave stops replicating OR starts full replication from the master. This was not the behavior in the earlier version or solr, I have check the logs bu

RE: Solr 4.3 Master/Slave Issues

2013-07-06 Thread Cool Techi
this might point to something > else in your setup that needs fixing. > > Best > Erick > > > On Fri, Jul 5, 2013 at 11:54 AM, Cool Techi wrote: > > > The normal tomcat shutdown doesn't stop the server and take a long time, > > so i do issue a kill -9 command.

solr cloud index corruption

2013-07-08 Thread Cool Techi
Hi, We are frequently getting issues of index corruption on the cloud, this used to not happen in our master slave setup with solr 3.6. I have tried to check the logs, but don't see an exact reason. I have run the index checker and it recovers, but I am not able to understand as to why this is

Autowarming last 15 days data

2013-07-31 Thread Cool Techi
Hi, We have a solr master slave set up with close to 30 million records. Our index changes/updates very frequently and replication is set up at 60 seconds delay. Now every time replication completes, the new searches take a time. How can this be improved? I have come across that warming would h

RE: Autowarming last 15 days data

2013-07-31 Thread Cool Techi
pache.org > Subject: Re: Autowarming last 15 days data > > On 7/31/2013 7:30 AM, Cool Techi wrote: > > We have a solr master slave set up with close to 30 million records. Our > > index changes/updates very frequently and replication is set up at 60 > > seconds delay.

RE: Autowarming last 15 days data

2013-08-01 Thread Cool Techi
Thanks Shwan, get the point. Regards, Ayush > Date: Wed, 31 Jul 2013 09:46:49 -0600 > From: s...@elyograg.org > To: solr-user@lucene.apache.org > Subject: Re: Autowarming last 15 days data > > On 7/31/2013 9:21 AM, Cool Techi wrote: > > Would it make sense if we open a n

Document Missing from Share in Solr cloud

2013-04-16 Thread Cool Techi
Hi, We noticed a strange behavior in our solr cloud setup, we are using solr4.2 with 1:3 replication setting. We noticed that some of the documents were showing up in search sometimes and not at other, the reason being the document was not present in all the shards. We have restarted zookeepe

RE: Document Missing from Share in Solr cloud

2013-04-16 Thread Cool Techi
sounds like you're saying that the > document is not replicated across all the replicas for a specific shard? If > so, that's definitely a problem ... > > > On Tue, Apr 16, 2013 at 11:22 AM, Cool Techi wrote: > > > Hi, > > > > We noticed a strange behavio

RE: Document Missing from Share in Solr cloud

2013-04-17 Thread Cool Techi
> the past? If ongoing, then will probably be easier to track down the root > > cause. > > > > > > On Tue, Apr 16, 2013 at 12:08 PM, Cool Techi wrote: > > > >> That's what I am trying to say, the document is not replicated across all > >

RE: Document Missing from Share in Solr cloud

2013-04-17 Thread Cool Techi
es unexpectedly > > > in > > > the past? If ongoing, then will probably be easier to track down the root > > > cause. > > > > > > > > > On Tue, Apr 16, 2013 at 12:08 PM, Cool Techi > > > wrote: > > > > > >> That's what I

RE: Document Missing from Share in Solr cloud

2013-04-17 Thread Cool Techi
r the results are the same. > > Upayavira > > On Wed, Apr 17, 2013, at 09:14 AM, Cool Techi wrote: > > Shouldnt the number of docs across shards be same, I can see a difference > > > > Shard 1 > > Last Modified:about 2 hours agoNum Docs:26236135Max Doc:26592

Solr Cloud OR Load Balancing

2013-04-20 Thread Cool Techi
We are currently using Solr 3.6 with 1:1 replication on our production servers, but now out data has increased a lot and were looking to migrate to something more scalable. We have been experimenting with Solr Cloud over the past 2 months and noticed servers issues, most of them have been fixe

Solr Hangs on startup

2013-06-14 Thread Cool Techi
Hi, We are using solr4.3 cloud setup, but for some reason solr fails to startup, I see the following in the log file, post this there are no logs., org.apache.solr.search.SolrIndexSearcher ? Opening Searcher@17586ed7 main 15293 [coreLoadExecutor-3-thread-1] INFO org.apache.solr.core.SolrCore

Single Tomcat Multiple Shards

2012-11-21 Thread Cool Techi
Hey Guys, We are experimenting with solr cloud, this is what we want to set up as, 2 Machines each having have 8 master shards, so total of 16 shards. The assumption is we want to store approximately 4-5 TB data over a period of 1 year of so. Replication factor of 1 which are again distributed

Reloading config to zookeeper

2012-11-22 Thread Cool Techi
When we make changes to our config files, how do we reload the files into zookeeper. Also, I understand that we would need to reload the collection, would we need to do this at a per shard level or just at the cloud level. Regards, Ayush

RE: Reloading config to zookeeper

2012-11-22 Thread Cool Techi
I'm using "cloud-scripts/zkcli.sh" script for reloading configuration, for > example: > $ ./cloud-scripts/zkcli.sh -cmd upconfig -confdir -solrhome > -confname -z > > Then I'm reloading collection on each node in cloud, but maybe someone > knows better solution

Solr Cloud 4.0 Production Ready?

2012-12-17 Thread Cool Techi
Hi, We have been using solr 3.5 in our production for sometime now and facing the problems faced by a large solr index. We wanted to migrate to Solr Cloud and have started some experimentation. But in the mean time also following the user forum and seem to be noticing a lot of bugs which were r

Searching for Solr Stop Words

2013-01-05 Thread Cool Techi
On of my solr fields is configured in the following manned, This works in cases where i don't want stemming, but now there is another use case which is causing a problem, people are beginning to seach for the following combinations, T

Solr commit taking too long

2013-01-16 Thread Cool Techi
Hi, We have an index of approximately 400GB in size, indexing 5000 documents was taking 20 seconds. But lately, the indexing is taking very long, committing the same amount of document is taking 5-20 mins. On checking the logs I can see that their a frequent merges happening, which I am guess

Not condition not working for Korean search

2013-02-07 Thread Cool Techi
Hi, I am no Korean expert and am finding it difficult to fix this, my client is searching for the following query, but the NOT condition doesn't seem to be working. (stnostem:((옵티머스 OR "엘지 스마트폰") AND NOT ("옵티머스 프라임" OR 프라임))) the search result (xml attached ) return result with the not condit

Hourly Faceting

2013-02-08 Thread Cool Techi
Hi, I want to facet results on an hourly basis, the following query gives me an hourly breakdown, but with the date part. I want just the hour part across the days. Is there any other way of doing this, 2013-02-01T00:00:00Z-330MINUTES true twitterId:191343557 createdOnGMTDate +1HOUR 2013-02-08

Not condition not working for Korean search

2013-02-10 Thread Cool Techi
Any help here, still not able to understand what might be causing this. I have tried all combinations below, but to no avail, (stnostem:((옵티머스 OR "엘지 스마트폰") AND NOT stnostem:("옵티머스 프라임" OR 프라임))) (stnostem:((옵티머스 OR "엘지 스마트폰") AND - stnostem:("옵티머스 프라임" OR 프라임))) What could be wrong here. Fr

RE: Not condition not working for Korean search

2013-02-10 Thread Cool Techi
get with &debugQuery=true > > Actually this may be the "pure negative" bug where you need to change: > > A AND -B > > into > > A AND (*:* -B) > > -- Jack Krupansky > > -Original Message- > From: Cool Techi > Sent: Monday, February 11

SEVERE RecoveryStrategy Recovery failed - trying again... (9)

2013-02-18 Thread Cool Techi
I am seeing the following error in my Admin console and the core/ cloud status is taking forever to load. SEVERERecoveryStrategyRecovery failed - trying again... (9) What causes this and how can I recover from this mode? Regards, Rohit

RE: SEVERE RecoveryStrategy Recovery failed - trying again... (9)

2013-02-18 Thread Cool Techi
ogged. > > - Mark > > On Feb 18, 2013, at 9:47 AM, Cool Techi wrote: > > > I am seeing the following error in my Admin console and the core/ cloud > > status is taking forever to load. > > > > SEVERERecoveryStrategyRecovery failed -

Solr on https

2012-09-11 Thread Cool Techi
Hi, We are trying to run solr on https, these are few of the issues or problems that are coming up. Just wanted to understand if anyone else is facing these problems, we have some shards running on https, but in shards parameter in solr we don't specify the protocol, how can we achieve thisWil

Solr Sharding Or Solr Cloud

2012-10-09 Thread Cool Techi
Hi, We have reached a state where a single solr server is not proving to be enough and are exploring options of sharding or solr cloud. Just wanted to check the pros and cons of each one of them if there are any. What would be the best size of the shards or Regards, R

New data not indexing, after data deletion.

2012-10-18 Thread Cool Techi
Hi, We have a huge index size, running to around 350Gb+, we yesterday deleted some data on it. The deletion completed successfully, but post the deletion new data was not being indexed. We restarted the server, but neither the tomcat logs or Solr logs are giving any indication of why this might

Architecture Question

2012-11-16 Thread Cool Techi
Hi, I am not sure if this is the right forum for this question, but it would be great if I could be pointed in the right direction. We have been using a combination of MySql and Solr for all our company full text and query needs. But as our customers have grow so has the amount of data and

RE: Architecture Question

2012-11-16 Thread Cool Techi
Hi Otis, Thanks for your reply, just wanted to check what NoSql structure would be best suited to store data and use the least amount of memory, since for most of my work Solr would be sufficient and I want to store data just in case we want to reindex and as a backup. Regards, Ayush > Date:

Question about Solr Cloud

2012-11-16 Thread Cool Techi
Hi, I have just started working with Solr cloud and have a few questions related to the same, 1) In the start script we provide the the following, what's the purpose of providing this. -Dbootstrap_confdir=./solr/collection1/conf Since we don't yet have a config in zookeeper, this parameter cau